Data Engineer

Mission of the Role:

Doctors.net.uk is seeking a Data Engineer to be part of Engineering Team, reporting into Head of Data, to perform the role of Business Intelligence Developer and use their expertise to define methodologies of data modelling, data engineering and to help the Data Science Teams and provide insights that will ultimately deliver value to the business by working with the Engineering and Analytics team.

Essential Duties and Responsibilities:

Including, but not limited to the following:

As a Data Engineer you will be responsible for building robust solutions for extracting, load, transformation and integration of data that enable our clients make efficient decisions with ease. You will implement efficient solutions on Cloud using large amount of data from various sources.

• Contribute to the maintenance of the data warehouse
• Contribute to the core design of the data architecture, determine best practices and implementation plans
• Design, build and maintain data pipeline architecture for ELT/ETL
• Assist in the creation of an infrastructure which can support machine learning capabilities.
• Proactively review existing process to identify opportunities to automate manual processes, optimise data delivery, re-design infrastructure for greater scalability, etc
• Set up and maintain automated data processes
• Collaborating with data scientists & data visualisation team to identify potential opportunities and maximise the value delivered from data models.

Requirements

Competencies:

• Experience as a data engineer in data warehousing / data lake setup
• Developing and maintaining ETL pipelines on cloud-based platform (AWS highly desirable)
• Ability to translate business needs into technical specifications
• Good knowledge of Python and/or R
• Good knowledge of SQL, TSQL and an ability to train on the topic
• Familiar with different data modelling techniques
• Integrating 3rd party data sources using APIs
• Some experience of Business Intelligence (BI) tools such as Qlik desirable, but not necessary
• Experience with SSIS or similar toolset to review the current setup
• Familiarity with CI/CD principles and tools desirable
• Knowledge of the digital media industry preferred, but not necessary

Desirable

• Experience of BI tools such as, Qlik, SSRS, SnapLogic etc.
• Experience of Analytics tools such as Google Analytics, Matomo etc.