Senior Data Engineer

Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.

As a Senior Data Engineer at Endava, you will focus on the technical implementation of various data projects, ranging from designing and building data warehouse solutions to developing end-to-end migration frameworks or constructing data reporting systems

Responsibilities:

• Work closely with Data Analysts/Data Scientists to understand evolving needs and define the data processing flow or interactive reports.
• Collaborate with stakeholders from other teams to gain a deeper understanding of how data flows are used within the existing environment.
• Propose solutions for cloud-based architecture and deployment flow.
• Design and build processes, data transformations, and metadata to meet business requirements and platform needs.
• Design and propose solutions for Relational and Dimensional Models based on platform capabilities.
• Develop, maintain, test, and evaluate big data solutions.
• Focus on the production status and data quality of the data environment.
• Spearhead initiatives around data quality, integrity, and security.
• Effectively gather requirements and seek clarification when needed.

Requirements

• 5+ years of experience in Data Engineering.
• Proficient in Python and open to working with other programming languages.
• Experience in software development is a plus.
• Experience leading IT projects and managing stakeholders.
• Experience implementing ETL processes and Data pipelines.
• Experience with Snowflake.
• Strong SQL scripting skills.
• Experience with cloud data technologies and tools.
• Familiar with data tools and technologies such as:
  • Spark, Hadoop, Apache Beam, Dataproc, or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Real-time pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.
• Strong analytical skills related to working with both structured and unstructured data.

Additional information

Discover some of the global benefits that empower our people to become the best version of themselves:

• Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
• Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
• Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
• Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
• Health: Global internal wellbeing programme, access to wellbeing apps;
• Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.