Data Engineer

The Team

You will be part of the data engineering team, reporting to the head of data engineering. It is a strong team of 6 with lots of experience in data management and processing. The team manages the central data warehouse and provides data engineering expertise across the business on various projects.

What will you be doing?

• You will play a key part in transforming Octopus to a data-driven organization. You have a passion for data and love finding interesting ways to innovate data development.
• You will be responsible for the development of pipelines to ingest data from various source systems and third parties, the data is extracted through different techniques including API, Change Tracking, Message Queues, Files etc. We use StreamSets and Azure Data Factory for data ingestion.
• You will be actively involved in design and implementation of various star schema models for Reporting and Analysis. We use DBT for data transformation.
• Optimize performance and storage of the data in the Data Warehouse and other operational databases. The data warehouse is an Azure Synapse Instance, and the operational database are on Azure SQL and MySQL instances.
• Liaise with vari...