Data Platform Engineer

Join us as a (Senior) Data Engineer (m/f/d) in our Data Platform team on a shared journey that matters!

The Data Platform team ensures that all data generated at MOIA can be accessed and processed in our data platform. We rely on a wide variety of AWS services to build our data products and keep our stack as serverless as possible. You will work at the core of MOIA's data engine room and interact with colleagues from 25+ different Teams. We provide automation, tools, operate services and evangelize best practices so that data at MOIA is processed in an efficient, secure and privacy-compliant way. We strive towards enabling our users to work as independently and self-sufficiently as possible.

What you will do

• Show a platform mindset by enabling and supporting others to make use of data with internal tools. Collaborating and communicating with teams across multiple tech stacks and business domains is crucial for the platform team's success! We also aim to support each other’s growth and invite everyone to contribute to our learning days.
• Design, develop, and maintain an internal data platform using AWS Athena, Apache Spark and Apache Airflow, building large scale data pipelines.
• Build and optimize event-based data ingestion pipelines using AWS Kinesis, AWS Lambda and AWS Firehose and Protocol Buffers
• Develop and deploy serverless applications using AWS Lambda and AWS API Gateway.
• Design and build privacy-by-design solutions to make GDPR compliant data processing easier for the teams.
• Design, implement and maintain internal APIs, libraries and tooling using Python and TypeScript.
• Ensure availability, scalability and security of our data infrastructure on AWS.

What will help you to fulfill your role

• Effective communication skills and interest in being part of a highly autonomous team
• We want to act and grow as a team. Collaborating via pair programming, sharing knowledge, communicating effectively and mentoring others should be something you value in your day-to-day work.
• Strong programming skills in Python. Knowledge of the JavaScript/Typescript ecosystem and/or JVM-based languages is a relevant plus.
• Experience developing and running applications in cloud-native environments, for example using AWS Lambda and S3, and deploying them through Infrastructure as Code (e.g. via CDK or Terraform).
• Experience with GDPR compliant Data Engineering and Data Privacy, for example scalable Data Deletion, PII Encryption or Data Isolation
• Familiarity with job orchestration frameworks for data pipeline management, for example Apache Airflow.
• Experience with SQL in analytical and transactional database technologies.
• Experience with DevOps practices, such as continuous integration and deployment using tools and methods like CI/CD, Containers, Monitoring, Alerting
• Familiarity with dbt (Data Build Tool) for data transformation is a plus
• Previous experience in designing and building (data) APIs is a plus

We encourage you to apply even if your profile does not meet all the requirements for the role since we are looking for a diverse range of experiences, skills, and interests. We are certain that there will be something for everyone because we are working on such a variety of tasks and embrace individual growth at MOIA.

In case you have questions regarding your application, you can approach the recruiter Dennis directly.