Data Engineering Lead

Who are we?

Toyota Connected Europe wants to create a better world through connected mobility for all. We are a new company created to bring big data and a customer focus into all aspects of the mobility experience, so everyone’s experience is more personal, convenient, fun and safe. We create and enable technologies to delight and simplify the lives of everyone who use our products and empower them to think of and use our services in new ways.

You will be joining us at the beginning of Toyota Connected Europe’s journey of building our team and products. We are building teams to inspire, innovate and build technologies and products that are used by millions of people from all walks of life. We want every member of our team to live and breathe the start-up culture of Toyota Connected Europe and feel and act like an owner every day. This is an opportunity to have an immediate impact and voice: what you create today, you will see being used tomorrow.

What is the purpose of the role?

The Data Engineering team enables and manages the ingestion of low latency, high volume car telemetry data that powers our engineering and data science teams to build smart and insightful products. As Data Engineering Lead, you will play the key role in leading the team, TCEU’s data engineering capability and engineering delivery - through strategy, coaching, design, development, implementation, testing and documentation of large-scale, distributed software applications, systems and services.

What will you be doing?

• Design and build next generation consolidated data streaming pipelines to consume Toyota car telemetry data – ensuring high quality, performance, scale and extensibility
• Define and drive the adoption of leading principles, practices, standards and technologies to develop robust data streaming solutions
• Influence and lead teams, encourage the best data engineering practices in accordance with architecture standards and blueprints and set the optimum direction of the backlog
• Define and drive the adoption of leading principles, practices, standards and technologies to develop high quality, robust and secure technology solutions
• Work closely with product and stakeholders to best solve business problems, shape and deliver features to customers, partner to set the optimum direction of the product roadmap and thrive as an independent, autonomous, creative thinker that can break out from conventional solutions
• Plan and drive the development of data engineering solutions ensuring balance of functional and non-functional requirements. Monitor application of data standards and architectures including security and compliance. Contribute to organisational policies, standards, and guidelines for data engineering
• Technical responsibility for software development across all stages and iterations. Plan and drive software construction activities, adopt and adapt appropriate software development methods, tools and techniques. Measure and monitor applications of project/team standards for software construction, including software security, contributing to the development of policies, standards, and guidelines
• Systems and software design of large or complex systems, undertake impact analysis on major design options and trade-offs, ensuring balance of functional and non-functional requirements and that appropriate methods, tools and techniques are applied effectively, making recommendations and assess and manage associated risks. Adopt and adapt system design methods, tools and techniques; contributing to development of system design policies, standards and selection of architecture components
• Plan and drive systems development projects which support the organisation's objectives, select, adopts and adapts appropriate systems development methods, tools and techniques. Ensure that stakeholders are aware of required resources and manage optimum availability and utilisation. Ensure projects are carried out in accordance with agreed architectures, standards, methods and tools and addresses security and privacy requirements
• Plan and drive activities to develop systems integration and build capabilities including automation and continuous integration, identify evaluate and manage the adoption of tools, techniques and processes to create a robust integration framework. Lead integration work in line with the agreed system and service design, assess risk and take preventative action.
• Contribute to identifying new areas of capability improvement within the organisation, select and prioritise improvement opportunities, generate buy-in and plans improvement activities justified by measurable benefits
• Determine development needs for a professional practice area, align development activities with organisational priorities, learning and development strategies and career pathways. Assist with the creation of development plans, ensuring alignment with professional development plans and career opportunities
• Partner closely with a diverse set of stakeholders to solve data and business problems
• Collaborate with product owners to shape and deliver features to customers, thriving as an independent, autonomous, creative thinker, breaking out from conventional solutions
• Coach Data Engineers, through collaboration, peer programming, code reviews and delivering feedback
• Work side-by-side with other talented lead engineers in a team-oriented, agile software engineering environment to evolve maturity and expertise
• Accountable for data service delivery - availability, reliability, robustness and quality of our data engineering platforms and projects
• Own delivery and operations from concept to code to production (build and run)
• Drive operational data quality, ensuring observability of key metrics
• Coach through continuously sharing knowledge and lookout for improvement opportunities in technology as well as ways of working
• Evolve technology and team capabilities - define and own and technology strategy and delivery via a balanced roadmap

What are we looking for from you?

• Great technology data leader and team player, focused on achieving best team outcomes through coaching and collaboration
• Highly technical seasoned technologist, with hands-on expertise, combined with strong communication skills who can articulate and deliver best fit solutions covering functional and non-functional requirements within constraints of time and team capacity/velocity
• Passion for excellence in data engineering, cloud and secure practices – able to make positive impact at both the team and enterprise level for strategic initiatives
• Experience of building and designing event driven and/or streaming data services, IoT domain would be great but not essential
• Experience/knowledge with at least one major messaging stacks (Kafka / Pulsar / RabbitMQ or similar)
• Experience/knowledge of at least of one of the major real-time data processing frameworks, preferably Flink (Spark / Storm Kafka Streams or similar)
• Expert programming experience in Java (11+) and show a sense of ownership and pride in your code; make us believe you will excel
• Experience with at least one major cloud provider (ideally AWS), ideally provisioning infrastructure and services through code (IaC)
• Expertise and experience working with RESTful APIs (designing with OpenAPI is desirable) and web services, CI/CD pipelines (GitLab desirable) and automated testing (BDD, Performance, Security), Kubernetes and cloud native practices, containerized workloads with tools such as Docker
• Experience and expertise of implementing best practice data engineering patterns, including those used in highly scalable, distributed, and resilient systems
• Coach team on data/source system analysis and factoring in data volumes and variances into robust, accurate, performant and resilient data pipeline designs
• Experience of establishing enterprise-scale data integration procedures across data development lifecycle and ensure data services work effectively and efficiently across the enterprise
• Able to identify and champion areas of innovation in data tooling and techniques and understand timing for adoption
• Experience of setting best standards of integration architectures and design; ensure adherence and keeping up to date with industry trends
• Experience of setting standards and using tools to design, code, test, correct and provide documentation
• Expert in data modelling concepts and principles having extensive experience of building data architectures consolidating multiple complex sources
• Passion for and experience of agile practices, incremental delivery, DevSecOps, continuous improvement and ability to cultivate a strong generative team culture