Data Engineer

You will report to the Data Engineering Manager and will work with clients from multiple sectors, understand their specific requirements, collaborate with full range of services provided by wider Merkle and design technical solutions. You will typically work with a few clients across stages of maturity, allowing variety in your work and the opportunity to pick up new skills.

Under the direction of a Solutions Architect, you will

• Design great data solutions for our clients

• Implement modern cloud solutions using the full range of cloud components

• Work with local leadership and our global teams, bringing your industry and product expertise, to shape and create client solutions.

• Support our Data Scientists & Ecommerce teams and wider Merkle working on projects

• Provide technical expertise and consultancy to clients to help them understand the power of data for their organization

Requirements

You will have knowledge of Data and cloud engineering with a focus on optimizing data, pipelines, ETL and data modelling.

Essential:

• Implementation of Data Lake patterns in Azure

• Understanding of Data Lake partitioning policies and role-based access controls

• understanding of data modelling, data structures, databases, and data ingestion and transformation

• Cloud engineering and data engineering skills

• Experience of Python, Spark, Scala or similar technologies

• DevOps such as Continuous Integration, Automation, Infrastructures as Code inc. Bicep deployments.

• CI / CD experience within ETL / data transformation environment

• Azure function app architecture

• Data Factory and Databricks knowledge

• GitHub including Github Actions for deployment across 3 environments integrated with Client Website

• SQL database skills

• Team work internally and with external clients.

• 3+ years of experience writing clean, organized code

• Proficiency working in an Agile environment

Beneficial

• Terraform

• Event-driven Message processing.

• Azure certification / demonstratable path towards certification

• Experience of Synapse / Fabric

• Experience of Cosmos DB