Data Engineer

Mid-level
Melbourne, 🇦🇺 Australia
Data Engineer
Technology

AWS Data Engineering Framework Specialist

Description: We are looking for a Data Engineer who is adept at building and maintainingdata engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. This role involves hands-on development and optimization of data pipelines, ensuring they are efficient and aligned with the bank's data strategy.

Key Responsibilities:

Experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.

Proven experience in building advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.

Strong understanding of writing efficient, reliable, and maintainable code to manage data workflows.

Solid foundation in software engineering, including Object-Oriented Design (OOD) and design patterns.

Optimize data processing pipelines for performance and scalability.

Collaborate with data architects to implement best practices and improve data framework capabilities.

Assist in resolving technical challenges and provide support to the data engineering team.

Minimum Qualifications:

Bachelor’s degree in Computer Science, Engineering, or a related technical field.

3+ years of hands-on experience with AWS services, specifically EMR and Glue.

Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.

Solid understanding of SQL, data modeling, and ETL processes.

Preferred Qualifications:

Experience with version control systems and CI/CD pipelines.

Familiarity with additional AWS services and data analytics tools.

 

Rackspace

Rackspace

Rackspace Technology is the multicloud solutions expert, delivering end-to-end solutions across applications, data, and security

Cloud Computing
Cybersecurity

Other jobs at Rackspace

 

 

 

 

 

 

 

 

View all Rackspace jobs

Notifications about similar jobs

Get notifications to your inbox about new jobs that are similar to this one.

🇦🇺 Australia
Data Engineer

No spam. No ads. Unsubscribe anytime.

Similar jobs