Senior Data Engineer

Our client in the retail space is searching for a motivated Senior Data Engineer to join their data engineering team in Cape Town.

The primary focus of this role will be to leverage technical skills to combine software, systems, and data, extracting meaningful insights from raw data. This candidate will work closely with data scientists, analysts and other stakeholders to ensure data availability, integrity, and optimal performance.

Responsibilities:

• Understand and analyze client requirements and business needs.


• Identify, analyze, visualize, and understand supporting data to propose solid solutions.


• Design and develop data layers to power Big Data analytics.


• Architect data integration pipelines and ensure successful data extraction, transformation, and loading from various sources.


• Create and maintain technical documentation.


• Support existing solutions within GCP and Oracle.


• Develop, test, and ensure the quality of data pipelines and layers.


• Perform peer reviews and comply with the SDLC process and documentation standards.


• Participate actively in the product team and provide cross-training and mentorship.


• Provide timely status updates to the team.


• Log change requests and accurately log time.


• Participate in standby rotation.


• Drive ticket progress and ensure timely resolution.


• Manage GCP costs and IT responsibilities.


• Ensure successful creation of the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.

Requirements include:

• Bachelor's degree in Computer Science, Engineering or IT


• Minimum of 5 years of data warehouse ETL experience


• Knowledge of cloud platforms


• Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server).


• Experience with dimensional modeling and data analysis.


• Preferred experience with data visualization tools and the retail industry.


• Basic understanding of SDLCs


• Proficiency in programming languages such as Python, Java, Korn shell scripting, and SQL.

If you feel this role is for you then do not miss out and apply today. We look forward to hearing from you.