Data Engineering Framework Architect

Description:

We are in search of a Data Engineering Framework Architect with a specialty in designing and building innovative data solutions on AWS. The ideal candidate will have a deep understanding of data engineering frameworks such as DBT, SQLMesh, and Coalesce, and will lead the architecture and implementation of these frameworks within AWS EMR/Glue environments.

Key Responsibilities:

Ø Extensive experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.

Ø Proven Architect and design advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.

Ø Strong experience with DBT or similar framework and modern data architecture principles.

Ø Develop strategic plans for scalable data solutions, overseeing their implementation and maintenance.

Ø Define and enforce architectural standards and frameworks for data ingestion, processing, storage, and retrieval.

Ø Lead collaboration with cross-functional teams to ensure adoption of data engineering frameworks are leveraged to deliver solutions

Ø Provide mentorship and architectural guidance to the data engineering team.

Minimum Qualifications:

Ø Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.

Ø 7+ years of experience in data engineering with a focus on AWS-based solutions.

Ø Proficient in designing and implementing data engineering frameworks such as DBT, SQLMesh, or Coalesce.

Ø Extensive knowledge of AWS services, particularly EMR and Glue.

Ø Strong grasp of data warehousing, ETL concepts, and data modeling techniques.

Preferred Qualifications:

Ø AWS Certified Solutions Architect or AWS Certified Big Data Specialty certification.

Ø Experience with infrastructure as code (e.g., Terraform, AWS CloudFormation).