Data Engineer

Description:

We are looking for a Data Engineer who is adept at building and maintaining data engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. This role involves hands-on development and optimization of data pipelines, ensuring they are efficient and aligned with the bank's data strategy.

Key Responsibilities:

· Experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.

· Proven experience in building advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.

· Strong understanding of writing efficient, reliable, and maintainable code to manage data workflows.

· Solid foundation in software engineering, including Object-Oriented Design (OOD) and design patterns.

· Optimize data processing pipelines for performance and scalability.

· Collaborate with data architects to implement best practices and improve data framework capabilities.

· Assist in resolving technical challenges and provide support to the data engineering team.

Minimum Qualifications:

· Bachelor’s degree in Computer Science, Engineering, or a related technical field.

· 3+ years of hands-on experience with AWS services, specifically EMR and Glue.

· Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.

· Solid understanding of SQL, data modeling, and ETL processes. Preferred Qualifications:

· Experience with version control systems and CI/CD pipelines.

· Familiarity with additional AWS services and data analytics tools.