Data Engineer

Are you a Data Engineer in Gauteng looking for a new position? Look no further!

Our client in the financial industry is searching for a Data Engineer to join them in Central Johannesburg.

Responsibilities:

• Design, build and maintain scalable and reliable data pipelines to process large volumes of data from various sources.


• Develop and maintain data models, databases, and data warehouses to support the analytic teams reporting needs.


• Ensure data quality and accuracy by implementing data validation and monitoring processes.


• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions to support their work.


• Excellent written and verbal communication skills; with the ability to explain complex problems in a simple and effective manner.


• To design and build highly available, scalable, and fault-tolerant data infrastructure to support data processing.


• Develop and maintain infrastructure automation tools, deployment pipelines, and monitoring systems.


• Core to this is the team’s collaboration with other engineers, data scientists, and analysts to ensure the availability and performance of the data infrastructure.


• We evaluate new data technologies and tools that enhances the performance and reliability of the data infrastructure and drive adoption of these technologies within the bigger data community.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field.


• Minimum of 6 years of experience in data engineering.


• Proficiency in at least one programming language (Python, C#, etc.) and SQL.


• Proven experience with data modelling, ETL processes, and data warehousing.


• Experience with cloud platforms such as AWS, GCP, or Azure


• Understanding of data processing technologies and data management principles


• Familiarity with data technologies such as Synapse, Databricks, DeltaLake, and AirFlow

Apply today!