QA Tester - Data Testing

Job Overview:

We are seeking a meticulous and highly skilled QA Tester to join our IT team. The ideal candidate will have extensive experience in testing large volumes of data from source systems to our Microsoft Fabric Delta Lakehouse. This role requires a deep understanding of data architecture, data warehousing, and the ability to create and execute automated tests using SQL, Python, and industry-standard open source tools and libraries.

Key Responsibilities:

• Data Testing:
  • Develop, execute, and maintain automated tests to validate data integrity and quality from source systems to the Microsoft Fabric Delta Lakehouse.
  • Design and implement data validation strategies to ensure accurate data migration and transformation.
  • Perform comprehensive data testing, including data completeness, data accuracy, and data consistency checks.
• Automation:
  • Utilize SQL and Python to create automated test scripts.
  • Implement and manage automated testing frameworks and tools such as Apache Airflow, Great Expectations, and pytest to streamline the QA process.
  • Ensure that automated tests are integrated into the CI/CD pipeline to enable continuous testin...