Data Engineer

Swan IT is on the hunt for a Data Engineer for a client in the retail industry for a 12-month contract.

As the Data Engineer, you will be modelling data to provide clean, accurate datasets so that different users within the team can work with them.

Responsibilities:

• Model raw data into clean, tested, and reusable datasets making it easier for other analysts and other stakeholders to view and understand data in the data lake.


• In-depth understanding of data warehousing concepts, as well as experience with ETL (extract, transform, load) tools and processes is essential to designing data pipelines.


• Support in defining data quality expectations and provide ongoing tracking and monitoring of performance of data systems and models.


• Set software engineering best practices for analytics


• Work with data scientists and analytics to collect and clean data for analysis.


• Develop, validate, and execute algorithms and predictive models to collect, merge, analyse, extract, and interpret large and complex datasets.


• Use data to investigate complex problems, detect patterns and extrapolate insights that delivers business value and impact.


• Design data models, as well as, developing and maintaining data pipelines.

Requirements:

• 3-4 year Degree in Data Science, Computer Science, Mathematics, Statistics, Information Technology, Information Systems, or a related field


• Minimum of 4 years experience as a Analytics Engineer or similar


• 4 years of experience applying machine learning, deep learning, data mining, modelling and mathematical and/or statistical concepts and methodology to support business objectives


• AWS knowledge highly advantageous


• Experience using various other data science toolkits such as Python/R, PySpark, Git, Bash, Ubuntu/Linux, SQL, Docker, REST APIs

We can’t wait to hear from you!