Recruitment Room Team
Data Engineer (JHB)
Job Description
ENVIRONMENT:
OPTIMIZE data pipelines for performance, scalability, and reliability as the next Data Engineer sought by a dynamic Retail and Consumer Finance Concern in Joburg. The ideal candidate will use their passion for Big Data & Analytics to provide insights to the business covering a range of topics. You will play a critical role in the development and maintenance of data infrastructure while ensuring data availability, quality, and accessibility for analysis. You must possess a Bachelor’s Degree in Computer Science/IT or similar discipline, have relevant Certifications such as AWS Certified Data Analytics, Google Cloud Professional Data Engineer and have 5-10 years’ experience and understanding in designing and developing data warehouses according to the Kimball methodology. You will also need proficiency with SQL, Python/R, Scala, Java, Snowflake, Redshift, AWS, SAS Data Studio & ETL tools.
DUTIES:
- Collaborate with Data Scientists, Analysts, and business stakeholders to understand data requirements.
- Design, develop, and maintain data pipelines and ETL processes.
- Implement and maintain data warehousing and data storage solutions.
- Optimize data pipelines for performance, scalability, and reliability.
- Ensure data quality and integrity through data validation and cleansing processes.
- Monitor and troubleshoot data infrastructure issues.
- Stay current with emerging technologies and best practices in Data Engineering.
- Systematic solution design of the ETL and data pipeline in line with business user specifications.
- Develop and implement ETL pipelines aligned to the approved solution design.
- Ensure data governance and data quality assurance standards are upheld.
- Deal with customers in a customer centric manner.
REQUIREMENTS:
Qualifications –
- Bachelor’s Degree in Computer Science, Information Technology, or a related field.
- Relevant Certifications (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).
Experience/Skills –
- 5-10 Years’ experience and understanding in designing and developing data warehouses according to the Kimball methodology.
- Proven experience as a Data Engineer in a professional setting.
- Proficiency in Data Engineering technologies and Programming languages (e.g., SQL, Python, Scala, Java).
- Strong knowledge of data storage, database design, and data modelling concepts
- Experience with ETL tools, data integration, and data pipeline orchestration.
- Familiarity with data warehousing solutions (e.g., Snowflake, Redshift).
- Excellent problem-solving and troubleshooting skills.
- Adept at design and development of ETL processes.
- SQL development experience, preferably SAS Data Studio and AWS experience. Have the ability to ingest/output CSV, JSON and other flat file types and any related data sources.
- Proficient in Python or R or willingness to learn. Experience within Retail, Financial Services and Logistics environments.
- Redshift Technologies.
- Understanding of data security and compliance best practices.
ATTRIBUTES:
- Effective self-management and teamwork.
- Strong communication and collaboration skills.
