Data Engineer

About your tasks:

• Design, build, and maintain data pipelines using Microsoft Azure technologies, ensuring data is collected, stored, and processed efficiently.
• Implement observability practices to monitor data workflows and system health, ensuring data quality and system reliability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize and scale our data infrastructure to handle growing data volumes and new data sources.
• Document data flows and system architecture, ensuring transparency and ease of maintenance.

Requirements

About you:

• Expertise in Azure Databricks, Azure Data Factory, Azure SQL Database, Event-Hubs and other Azure-based data services.
• Proven experience in building, managing and monitor ETL/ELT pipelines for Batch and Realtime purposes, with a focus on performance and scalability. Experience in Apache Airflow and dbt is a plus.
• Proficiency in SQL, Spark, Python, or other programming languages commonly used for data engineering tasks and API integration.
• Familiarity with tools like Terraform, Azure DevOps Deployment Pipelines, Azure Monitor, Log Analytics, or similar to ensure system health and observability.
• A passion for continuous learning and staying up to date with the latest technologies and trends in data engineering.

Additional information

About your benefits:

In order to provide you with the best possible support for your individual needs - whether it‘s living a healthy life, having enough time for your family, or developing your skills - we offer a wide range of different, site-specific benefits:

• Sports: Stay healthy. Profit from a membership (M) package at Urban Sports Club, so that you can take advantage of a huge variety of sport offers.
• Mental Health: Get quick and professional help from psychologists of Likeminded if you feel overwhelmed in private or professional life. Anonymous and free of charge.
• Mobility: We provide our employees with a fully costed Deutschland Ticket which can be used at any time. Click here to learn more.
• Personal development: Grow! We support and encourage your individual development through various in- and external trainings.
• Kindergarten Grant: We offer our employees who pay for childcare in kindergarten 100,00 € (total) per month.