Senior Data Engineer / Tech Lead

Our client is a leading global provider of sustainable, multimodal transportation and logistics solutions, with a presence in over 24 countries across Europe, North America, Asia, and Australia. It operates an extensive network that integrates short-sea, road, rail, and inland waterway transport, offering innovative and environmentally conscious logistics services.

The Senior Data Engineer / Tech Lead plays a crucial role in transforming vast and complex datasets into strategic assets, enabling data-driven decisions, and enhancing innovative services. The main focus is on managing internal and external data, enhancing the modern Azure-based data platform, and ensuring seamless integration, storage, and processing of big and streaming data. This position requires both technical leadership and hands-on engineering skills, offering a dynamic and impactful role within the company.

Key Responsibilities:

• Serve as a trusted advisor to the Data Architect, offering alternative approaches and architectures.
• Lead and mentor team members, fostering a collaborative and high-performance environment.
• Proactively drive improvements by optimizing and automating processes.
• Build, deploy, monitor, and manage data pipelines in Azure, with a focus on efficiency and performance.
• Implement delta loads on multiple data sources to enhance system functionality.
• Monitor the performance and implement quality control measures.
• Develop and refine system integrations using scripting languages and tools.

Required Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 4+ years of experience as a Data Engineer.
• Proficiency in SQL (e.g., MySQL, MSSQL, Oracle SQL).
• Solid understanding of Microsoft Azure features, particularly Azure Data Factory and Azure Data Lake.
• Familiarity with CI/CD pipelines using Azure DevOps.
• Knowledge of ETL frameworks, data models, containerization, and data formats such as JSON and Parquet.

Preferred Qualifications:

• Azure Data Engineer Associate certification or equivalent.
• Experience in data analytics, machine learning, or data science.
• Industry experience in transport/logistics is a plus.
• Python scripting experience is an advantage.
• Strong communication skills, with the ability to influence and engage stakeholders.

Personal Attributes:

• Entrepreneurial mindset with a proactive approach to challenges.
• Critical thinking and problem-solving abilities, with attention to detail and accuracy.
• Ability to adapt quickly in a fast-paced, evolving environment.
• Excellent collaboration and negotiation skills.

Challenges:

• Managing imperfect datasets.
• Navigating a changing architecture and application landscape.
• Adapting to shifting business priorities.