Senior Data Engineer

A technology and analytics-driven consulting company empowering clients by solving real-world business challenges that deliver tangible value counts its core capabilities as spanning the disciplines of data science, data engineering and software engineering. They have an opening for a senior Azure data engineer. Are you ready to empower businesses through technology and analytics?

Responsibilities:

• Analyse and organise raw data to drive actionable insights.
• Design innovative data engineering solutions tailored to business needs.
• Build scalable data pipelines that clean, transform, and aggregate data from diverse sources using cutting-edge tools.
• Collaborate with data scientists to prepare datasets for analytical modelling.
• Enhance data quality and reliability through best practices.
• Manage the technical delivery of projects from start to finish.
• Mentor and guide junior data engineers to foster growth and excellence.

Qualifications and experience:

• Graduate or postgraduate degree in computer science, information technology, statistics, engineering, or a related field.
• Two to six years of experience with relational SQL databases.
• Solid understanding of Apache Spark as a distributed data processing framework.
• Proven experience in designing, implementing, and performance-tuning solutions in Apache Spark.
• Expertise in complex data warehouse and data lake design.
• Proficient in building, optimising, and managing data pipelines for large datasets.
• Experience with Azure technologies: Azure Storage/Data Lake, Azure SQL Database, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Familiarity with Python is a plus.

The reference number for this position is NG59096. This is a permanent position in Johannesburg offering a salary of R900,000 to R1.1 million cost to company, negotiable based on experience. E-mail Nokuthula at [email protected] or call her for a chat on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? E-Merge IT Recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 23 Oct 12:02, Closing date 22 Dec