Senior Data Engineer

• Use CI/CD tools to facilitate deployment of code to stage and production environments.
• Participate on architecture of end-to-end solutions for our customers on AWS, Azure and other cloud platforms.
• Maintain GIT repositories using Gitflow framework.
• Collaborate on feature deliverables to meet milestones and quality expectations.
• Communicate with the stakeholders, vendors and technology subject matter experts.
• Document implemented logic in a structured manner using Confluence; plan your activities using Agile methodology in Jira.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs, like optimizing existing data delivery, re-designing infrastructure for greater scalability, etc.

Requirements

• Experience in building and productionizing public cloud infrastructure.
• Experience using GitHub, Bitbucket or other code repository solution.
• Experience in setting up and using CI/CD automation tools like like Github Actions, Azure DevOps or AWS CodePipeline.
• Experience with infrastructure as a code frameworks like Terraform, AWS CloudFormation, ARM templates.
• Understanding of containerization concepts and container orchestration services like Docker, Fargate, Kubernetes.
• Experience with scripting languages like Python, Bash, PowerShell etc.
• Strong analytic skills related to working with structured and unstructured datasets.
• Person who is precise, well organized, has good communication skill, can adapt to changing circumstances and is not afraid of responsibility for his / her work will do great in this role.

Preferred Skills

• Understanding data concepts and patterns of big data, data lake, lambda architecture, stream processing, DWH, BI & reporting.
• Experience with data pipeline / workflow management tools like dbt, AWS Step Functions, AWS Glue, Azure Data Factory, Airflow.
• Knowledge of SQL