Data Science Lead Engineer

dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.

Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world’s most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First.

dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola, Meijer, Procter & Gamble and Metro.

We are looking for a talented Data Science lead engineer to lead a team of data science engineers who develop and maintain tools/products aimed at making the data science development work easier. The right candidate will be passionate about technology strategy, change management, learnings, delivering high-quality codes and cutting-edge technologies in Bigdata landscape. The candidate will have evangelical mindset to identify, practice and promote better working methods in the fields of distributed computing to be used in data science engineering.

What we expect from you

• Design a futuristic toolkit plan for an evolving Data Science team and build an implementation roadmap
• 10+ years of relevant experience in analyzing complex data pipelines to identify performance bottlenecks, and suggest robust ways to optimize the workload in reasonable costs
• Collaborate with technology infrastructure and platform teams to enable the right toolkit components for the Data Science community in a timely manner
• Build and promote the right best practices from an engineering standpoint for optimal use of tech resources, keeping in mind skillsets, business and innovation needs, cloud infrastructure needs and costs
• Lead a team of engineers to develop and maintain engineering tools/products needed for simple and efficient data science development
• Work with the infra team to ensure robust, performant and scalable platform is available for data science development work
• Proficiency in Hadoop, PySpark, Pandas, NumPy and python version > 3.5
• Good Working experience of Partitions, Joins, cache, HDFS, handling data skewness and code optimisation in general
• Working knowledge of Kubernetes and Docker
• Experience in developing web applications using modern frontend and backend technologies, e.g Node Js, React, Dash, Django, Voila, Streamlit
• Good knowledge of Airflow or any other data process orchestration tools like Nifi , Lungi
• Good knowledge of SQL
• Proficiency in shell scripting and has working knowledge of devops/dataops
• Proficiency in web application development and application integration (REST APIs, Web services)
• Experience in re-engineering, automating and productionising code
• Should have experience in handling/optimising various file formats like parquet, Avro etc

What you can expect from us

We won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards package you’d expect from a leading technology company. But also, a degree of personal flexibility you might not expect. Plus, thoughtful perks, like flexible working hours and your birthday off.

You’ll also benefit from an investment in cutting-edge technology that reflects our global ambition. But with a nimble, small-business feel that gives you the freedom to play, experiment and learn.

And we don’t just talk about diversity and inclusion. We live it every day – with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One and dh Thrive as the living proof. Everyone’s invited.

Our approach to Flexible Working

At dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work.

We believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process.

For further information about how we collect and use your personal information please see our Privacy Notice which can be found (here)