Job Description
A company based in Johannesburg is looking for a skilled Data Engineer to join their DataWorks team. This role involves creating and improving data systems that help businesses make better decisions using data. You will work in a hybrid setup, meaning you can work both from the office and remotely sometimes.
What you will do:
- Design and build systems that collect, process, and store large amounts of data efficiently.
- Create data pipelines that move data from different sources into a central place for analysis.
- Work with cloud platforms like AWS, Microsoft Fabric, and Databricks to develop these systems.
- Ensure data accuracy, reliability, and usability for reporting and analysis.
- Work with big data tools like Apache Spark to handle large datasets quickly.
- Collaborate with data analysts and business leaders to understand data requirements and build solutions.
- Improve existing data systems for better performance and efficiency.
What you need:
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
- At least seven years of experience in data engineering or building data platforms.
- Experience in the financial services industry is a plus but not required.
- Proficiency in cloud platforms like AWS (Glue, Redshift, S3, Lambda, EMR, Athena) and Microsoft Fabric or Databricks.
- Familiarity with big data tools like Apache Spark, Hadoop, or Kafka.
- Strong skills in programming languages like Python, Pandas, and SQL.
- Experience building and managing data pipelines, data warehouses, and data lakes.
What you will get:
- Permanent job with a salary of up to R1 million per year, depending on experience.
- Hybrid work arrangement (office and remote).
- Opportunity to work on exciting projects and grow skills in a fast-paced environment.