Senior Data Engineer

A registered financial service provider focused on innovation and technology is seeking a senior data engineer. The role involves executing data engineering duties in line with the bank’s standards, frameworks, and roadmaps to empower the business through technology and analytics.

Responsibilities:

• Analyse and organise raw data to derive actionable insights.
• Design data engineering solutions to meet business needs.
• Build scalable data pipelines to clean, transform, and aggregate data from various sources.
• Collaborate with data scientists to prepare datasets for analytical modelling.
• Ensure data quality and reliability through best practices.
• Manage technical delivery of projects from start to finish.
• Mentor and guide junior data engineers.

Qualifications and experience:

• Graduate or postgraduate degree in computer science, information technology, statistics, engineering, or a related field.
• Extensive experience with relational SQL databases.
• Solid understanding and experience with Apache Spark for distributed data processing.
• Expertise in designing, implementing, and performance-tuning Apache Spark solutions.
• Proven experience in complex data warehouse and data lake design.
• Proficiency in building, optimising, and managing data pipelines for large datasets.
• Experience with cloud technologies.
• Familiarity with Python is an advantage.

Details:

• Reference number: NG59965.
• Contract position based in Johannesburg.
• Hourly rate: R550 to R650 (negotiable based on experience).

Contact Nokuthula at nokuthulag@e-merge.co.za or call 011 463 3633 to discuss this and other opportunities. Visit www.e-merge.co.za for more roles.

Know someone who is a developer or technology specialist? Successful referrals earn cash rewards.

Posted on 10 Feb 10:42, Closing date 11 Apr