Data Engineer

We seek a driven, autonomous, and organized individual experienced in ETL processes utilizing AWS services and various database technologies. The role encompasses task management, data sourcing, interaction with third parties, and oversight of the entire data lifecycle. The data engineer will oversee ETL processes, manage, and support the entire data journey, from acquisition to accurate processing. The position demands a high degree of automation and meticulous attention to detail to ensure smooth and effective process flow. The incumbent will collaborate with our Analytics team to guarantee data processing aligns with specifications.

Role Responsibilities:

• Manage the complete data lifecycle, from acquisition through processing to delivery.
• Develop an ETL process for new data sets, including thorough validation and data quality checks.
• Maintain and operate data processes.
• Collaborate with the broader development team to enhance processes.
• Extract data for potential customers to evaluate models.

Requirements

Skills & Experience:

• 3-5 years of experience in a data management role, including developing ETL pipelines, preferably within the AWS ecosystem.
• Proficiency in Relational Database Management Systems (RDBMS), SQL, NoSQL (DynamoDb, Redshift) with over 3 years of experience.
• Experience with third-party data vendors.
• Skilled in defining data process improvements and requirements.
• Broad knowledge of AWS Cloud services (e.g., AWS Batch, Lambda, Step Functions, S3/Event); AWS certification is a plus.
• Over 2 years of experience in data engineering and building ETL pipelines.
• Proficiency in Python and/or .NET programming, or similar, with experience interfacing with RDBMS.
• Experience with visualization tools (PowerBI/Tableau).
• Strong understanding of automation for processing scalability and speed.
• Experience in data handling, including validation and quality control processes.
• University degree in Information Technology or a related field.

#LI-CI #Hybrid