Data Infrastructure Lead

In a nutshell

The Data Infrastructure Lead is responsible for leading the data engineering team in designing, implementing, and maintaining scalable data pipelines for loading data into a Snowflake-based data lake from various cloud-based data sources. Additionally, Team Lead will strongly cooperate with data analysts and data scientists in different functions at IPF Digital and IPF Group. This role requires an understanding of cloud architecture, data integration, ETL processes, and Snowflake data lake technologies. The Data Infrastructure Lead will ensure data integrity, security, and availability while optimizing data flow and storage.

Your daily tasks:

• Lead and mentor a team of data engineers, providing guidance and support in daily tasks.
• Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions.
• Co-operate with cloud infrastructure team to design and manage cloud-based data infrastructure using AWS services like AWS Lambda, Step Functions, and Glue.
• Design, implement, and maintain ETL processes to load data from cloud-based services like AWS RDS, and Salesforce into the Snowflake data lake.
• Ensure data is processed in a timely, accurate, and secure manner.
• Implement data quality checks and monitoring to ensure data accuracy and consistency.
• Ensure data security and compliance with relevant regulations and best practices.
• Implement and maintain data governance policies and procedures.
• Stay up-to-date with industry trends and emerging technologies in cloud data engineering.
• Lead the migration of legacy data warehouses to Snowflake, ensuring minimal disruption and high data fidelity.

So, what skills, knowledge and experience do you have?

Skills

• We care about who you are as a person, and having a qualification in computer science would definitely help you in this role.
• AWS Services
• Proficiency in SQL, Python, and data pipeline tools like AWS DMS or AWS AppFlow.
• Database administration basics with MySQL

Knowledge

• Knowledge of Linux Systems, mainly Debian-based ones
• Working experience with applications: Confluence, OpenVPN, JIRA, Bitbucket, Git/Bitbucket
• Knowledge of data lake architecture
• Knowledge of Snowflake
• Knowledge of AWS services, including RDS, S3, Lambda, StepFunctions, Glue, DMS and AppFlow.
• Knowledge of data security and compliance best practices.

Experience

• Overall 8+ years of experience within an information technology environment.
• 3+ years of experience in data engineering, with a focus on cloud data solutions.
• Proven experience in designing and implementing ETL processes for cloud-based data sources.

Qualifications

• We care about who you are as a person, and having a qualification in computer science would definitely help you in this role.
• AWS certifications such as AWS Certified Data Engineer (optional).
• SnowPro Core Certification (optional)

Other

• Fluent in verbal and written English (essential)
• Able to travel internationally for business meetings as required
• Excellent problem-solving and analytical abilities

You...
will love working at IPF Digital if you enjoy a truly international work environment and being part of an international HUB team. You like to be trusted to take responsibility for your tasks; you value friendly and open work culture and appreciate good teamwork.

We look after...
our people by providing all-you-can-eat fresh fruit daily, lunches at the expense of the company, and company parking where you can book a parking place. We support an active and healthy lifestyles and have fun team events both in the office and after work. Our employees' well-being and happiness are one of our top priorities.

Here’s how our team describes our culture:
The culture at IPFD is driven by our shared values. People are put first, we accept differences and encourage individuality. Due to our flat business structure, we enjoy collaborating together. Although recognition is highly valued, failure is accepted...as long as it’s fast. Enjoying some good times together is also highly encouraged!

Sounds good? We all think so at IPF Digital.