Data Engineer II

The Central Business Intelligence team builds and maintains the SIXT Data Platform and its Data Catalogue, servicing thousands of users at a global scale. Our main product, the SIXT Data shop, collects tens of millions of events daily, processes them according to our consumer’s needs, and services them via a toolbox ranging from self-service batch processes to real-time ML model endpoints. Our main challenges currently include better automation of our operations, increased self-service capabilities (for ingestion, ETLs, and distribution), and enabling new use-cases for our customers. Our team, which consists of 15 team members (Data Engineers and Business Intelligence Engineers), is hands-on and constantly dives into the latest technology releases. SIXT stands for success, agility, ownership, and an intercultural team.

What you’ll do? – Perform as smoothly as our cars:

• You develop the end-to-end automation of data pipelines to make ingestion, transformation, and distribution of data more efficient and self-service for our users
• You explore and learn the latest AWS and big data technologies to uncover hidden use-cases, enable new capabilities, and build new integrations for our SIXT Data shop product
• You interact with Data Engineers, BI Analysts and Data Scientists to find the best solutions for different analytical use cases (Dashboarding, ad hoc Analytics, Data-as-a-product, Machine Learning)
• You contribute to the Data Platform vision and execution with experience, new ideas, and your own curiosity.
• You show extreme work ethics and integrity to deal with sensitive data while protecting our end-customer

Requirements

What do you need to succeed? – Your willingness to accelerate:

• You must have a Bachelor’s degree (B.E/B.Tech) or Master’s degree (M.Tech/MCA) in computer science or related fields preferred.
• You have relevant experience of 4-7 years.
• You have got experience with combined Data Lake and Data Warehouse architectures and automation from data sources to analytical dashboards with ELT
• You are experienced in analytical cloud datawarehouses (Redshift/Snowflake) & you know how to create transformed data models (dbt) and to automate interdependent jobs (Apache Airflow)
• You are experienced in working with AWS services in CLI and Console (S3, EC2, EMR, Lambda, Kinesis, IAM...) and infrastructure as code (Terraform, CloudFormation)
• You work with engineering best practices across the development lifecycle, including agile methodologies, code reviews, source management (GitHub), deployment processes (Jenkins), testing, operations, etc. and you also have got an understanding of data management fundamentals, distributed systems, and data storage/compute principles
• Knowing Python and SQL is a must.