A company based in Johannesburg is looking for a skilled Data Engineer to join their DataWorks team. This role is perfect for someone who enjoys building and improving data systems that help businesses make better decisions. You will work in a hybrid setup, meaning you can work both from the office and remotely.

As a Data Engineer, you will design and build systems that collect, store, and process large amounts of data. Your main tasks will include creating and maintaining data pipelines that move data between different systems, such as databases, cloud services, and software applications. You will also develop cloud-based solutions using platforms like AWS, Microsoft Fabric, and Databricks to make sure data is easy to access and analyze.

Another important part of the job is ensuring data is accurate, reliable, and useful for the business. This means checking data quality, fixing errors, and setting up automated checks to prevent problems. You will also work with big data tools like Apache Spark to handle large datasets efficiently. Additionally, you will collaborate with data analysts, business intelligence teams, and data scientists to understand what data is needed and how to build solutions that meet their requirements.

To succeed in this role, you need at least seven years of experience working with data engineering or data platform development. A degree in Computer Science, Engineering, or a related field is preferred, though not always required. You should have strong experience with cloud platforms like AWS, Microsoft Fabric, or Databricks, and know how to use services such as AWS Glue, Redshift, S3, Lambda, EMR, and Athena.

You will also need to be comfortable working with big data technologies like Apache Spark, Hadoop, or Kafka. Strong programming skills in Python, Pandas, and SQL are essential for writing code that processes and transforms data. Experience in the financial services industry is a plus but not required.

This is a permanent position with a competitive salary of up to R1 million per year, depending on your experience. The role is hybrid, meaning you can split your time between working from home and the office in Johannesburg. You will also have the chance to work on exciting projects that involve advanced analytics and machine learning, helping the business grow and improve.