Recruitment Room Team

Data Engineer (JHB)

Johannesburg – Gauteng
3 weeks ago
Application ends: January 10, 2025
Deadline date:
January 10, 2025

Job Description


ENVIRONMENT:
OPTIMIZE data pipelines for performance, scalability, and reliability as the next Data Engineer sought by a dynamic Retail and Consumer Finance Concern in Joburg. The ideal candidate will use their passion for Big Data & Analytics to provide insights to the business covering a range of topics. You will play a critical role in the development and maintenance of data infrastructure while ensuring data availability, quality, and accessibility for analysis. You must possess a Bachelor’s Degree in Computer Science/IT or similar discipline, have relevant Certifications such as AWS Certified Data Analytics, Google Cloud Professional Data Engineer and have 5-10 years’ experience and understanding in designing and developing data warehouses according to the Kimball methodology. You will also need proficiency with SQL, Python/R, Scala, Java, Snowflake, Redshift, AWS, SAS Data Studio & ETL tools.
 
DUTIES:
  • Collaborate with Data Scientists, Analysts, and business stakeholders to understand data requirements.
  • Design, develop, and maintain data pipelines and ETL processes.
  • Implement and maintain data warehousing and data storage solutions.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Ensure data quality and integrity through data validation and cleansing processes.
  • Monitor and troubleshoot data infrastructure issues.
  • Stay current with emerging technologies and best practices in Data Engineering.
  • Systematic solution design of the ETL and data pipeline in line with business user specifications.
  • Develop and implement ETL pipelines aligned to the approved solution design.
  • Ensure data governance and data quality assurance standards are upheld.
  • Deal with customers in a customer centric manner.
 
REQUIREMENTS:
Qualifications –
  • Bachelor’s Degree in Computer Science, Information Technology, or a related field.
  • Relevant Certifications (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).
 
Experience/Skills –
  • 5-10 Years’ experience and understanding in designing and developing data warehouses according to the Kimball methodology.
  • Proven experience as a Data Engineer in a professional setting.
  • Proficiency in Data Engineering technologies and Programming languages (e.g., SQL, Python, Scala, Java).
  • Strong knowledge of data storage, database design, and data modelling concepts
  • Experience with ETL tools, data integration, and data pipeline orchestration.
  • Familiarity with data warehousing solutions (e.g., Snowflake, Redshift).
  • Excellent problem-solving and troubleshooting skills.
  • Adept at design and development of ETL processes.
  • SQL development experience, preferably SAS Data Studio and AWS experience. Have the ability to ingest/output CSV, JSON and other flat file types and any related data sources.
  • Proficient in Python or R or willingness to learn. Experience within Retail, Financial Services and Logistics environments.
  • Redshift Technologies.
  • Understanding of data security and compliance best practices.
 
ATTRIBUTES:
  • Effective self-management and teamwork. 
  • Strong communication and collaboration skills.