Senior Data Engineer – Azure

A technology and analytics-driven consulting company empowering clients by solving real-world business challenges that deliver tangible value, with core capabilities spanning data science, data engineering, and software engineering, is seeking a Senior Azure Data Engineer. This role will involve developing best practices and driving improvements in data engineering across various industries such as mining, telecoms, retail, and financial services.

Responsibilities:

• Analyse and organise raw data
• Design data engineering solutions to meet business requirements
• Build scalable data pipelines that clean, transform, and aggregate data from different sources using appropriate tools and technologies
• Collaborate with data scientists to prepare datasets for analytical modelling
• Identify ways to enhance data quality and reliability
• Manage the technical delivery of projects
• Mentor junior data engineers

Qualifications and experience:

• Graduate or postgraduate degree in computer science, information technology, statistics, engineering, or a related technical field
• Two to six years of experience with relational SQL databases
• Solid understanding of Apache Spark as a distributed data processing framework
• Experience in designing, implementing, and performance-tuning solutions in Apache Spark
• Experience in complex data warehouse and data lake design
• Experience in building, optimising, and managing data pipelines for large and complex datasets
• Experience with Azure Storage/Data Lake, Azure SQL Database, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics to implement data pipelines and analytical solutions
• Experience in Python would be beneficial

Reference number for this position is NG59096. This is a permanent position in Johannesburg offering a salary of R900,000 to R1.1 million CTC, negotiable based on experience. For more details, e-mail Nokuthula at [email protected] or call her at 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? E-Merge IT Recruitment is a niche recruitment agency that offers candidates options to successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website at www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 04 Oct 14:01, Closing date 3 Dec