Senior Big Data Engineer

Roles & Responsibilities

• Lead the design and implementation of data products based on the project requirements.
• Manage the day-to-day activities of the team.
• Collaborate with cross-functional teams to gather requirements, define data schemas, and design scalable data pipelines and workflows.
• Mentor and coach junior members of the data engineering team, providing guidance on best practices, code reviews, and technical solutions.
• Drive innovation and continuous improvement in data engineering processes and methodologies, staying abreast of emerging trends and technologies in the field.
• Ensure data quality, integrity, and security standards are maintained across all data products and pipelines.
• Serve as a technical leader and subject matter expert in data engineering, providing thought leadership and driving adoption of best practices within the organization.
• Understand business requirements and convert them into technical requirements while providing effort estimation of the user stories.
• Deployment to higher environment using GIT and Terraform.

Requirements

• 8+ years of experience in Data Engineering/Big Data field.
• Good experience in AWS and Snowflake.
• Procedures in Snowflake are orchestrated through Airflow, hence working knowledge on Python or Airflow is also desirable.
• Demonstrated leadership skills, with experience leading small teams and driving successful project delivery.
• Excellent communication and interpersonal skills, with the ability to collaborate effectively with stakeholders at all levels of the organization.
• Strong problem-solving skills and attention to detail, with a commitment to delivering high-quality solutions on time and within budget.

Additional information

Nice-to-have skills:

• SSIS
• AWS Lambda
• Python
• Apache Nifi and Kafka