Senior Data Engineer

Help us use technology to make a big green dent in the universe!

Kraken powers some of the most innovative global developments in energy.

We’re a technology company focused on creating a smart, sustainable energy system. From optimising renewable generation, creating a more intelligent grid and enabling utilities to provide excellent customer experiences, our operating system for energy is transforming the industry around the world in a way that benefits everyone.

It’s a really exciting time in energy. Help us make a real impact on shaping a better, more sustainable future.

About the team

At Kraken we have developed a platform to provide data services to our retail businesses and clients across 22 deployments globally.

The data platform engineering team develops and manages the back-end systems and processes supporting this platform, predominantly working with time-series data fed into the system by our customers’ smart meters. We have developed a suite of applications to process, transform, and make this data available to downstream services.

To process the volume of data we typically see, our applications run PySpark or dbt jobs using Databricks as our Spark engine. We also leverage Airflow and Kubernetes heavily. We also employ software engineering best practices to design, test, and deploy our data platform and services.

More about the role

This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers use energy.

As a Senior Data Engineer, you will be responsible for supporting the constant improvement of our data systems. As well as working on our core datalake transformations you may be developing custom applications to process third-party data, managing infrastructure in our AWS deployment, or working to expand our presence across our APAC, with offices in Australia, New Zealand, and Japan.

Key responsibilities:

- Supporting the development of our core Python applications

- Supporting the development of our dbt models

- Building and maintaining data pipelines in Airflow

- Responding to internal requests for tooling and data pipelines

More about you, our ideal candidate

We are looking for someone who will self-manage, adapt to our changing business requirements, and proactively work to scope problems and deliver pragmatic solutions.

Ideally, you have experience:

- Building applications in Python

- Working in a Spark or Databricks environment

- Working in a software or data engineering environment

We also want our data engineers to be great software engineers with a passion for writing quality code, so it would be helpful to have experience in at least some of the following:

- SQL

- dbt

- Cloud data platforms (Ideally AWS)

- Kubernetes

- Version control and DevOps best practices

What you will love about us

• Our company culture - We are organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people.
• Flexible working environment - genuine work life balance here, we are in the top 5 companies in the UK, we treat you as a human, and do our best to make work and life merge smoothly together
• Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success
• Office - have a certain tech requirement? We’ll do our best to get it. We also have drinks, snacks and a coffee machine at the WeWork office space.
• Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you

We would prefer someone who can work in our Melbourne office hybrid / remote of 1-2 days a week onsite but it's not a deal breaker. You do need to have the rights to work in Australia.

We're very excited to be growing our team. We're looking for skills and experience to help shape and define the future of not only our team, but the wider business at a global scale. If you're reading this and grinning, please apply! There are huge challenges to tackle, and we need amazing people who are keen to get stuck in.