Staff Software Quality Engineer

About the team :

Join the AI Search team at ServiceNow, where we are at the forefront of innovation in Enterprise Search solutions. Utilizing the latest advancements in Retrieval-Augmented Generation (RAG) technology and Generative AI, we are reshaping how organizations access and leverage information. Our mission is to empower businesses with intelligent search capabilities that enhance productivity, decision-making, and user experience. As a member of our team, you will collaborate with top-tier talent to pioneer new capabilities in AI-driven search, setting new standards for performance, reliability, and scalability.

Location : Kirkland, Washington or Waltham, Massachusetts

What you get to do in this role:

• Develop and execute test strategies to validate AI-driven Search functionalities and ensure scalability. Collect and report quality metrics from test execution.
• Evaluate the quality of Retrieval and Search features, including Language Models (LLMs), and propose enhancements.
• Work with developers and Product Managers to design specific testing strategies for features being developed and automate them.
• Support engineering organizations in troubleshooting or addressing issues with applications and dev/test environments.
• Take ownership of challenging projects, multitask effectively, learn quickly, and innovate to drive continuous improvement in product quality and performance.

Requirements

Qualifications

To be successful in this role you have:

• 6+ years professional experience in quality assurance or application development and in leading quality efforts within a scrum team of 4-6 QE engineers.
• Experience in Java, Python, JavaScript and Selenium, Junit, JMeter and TestNG.
• Experience with Eclipse, Jenkin, Maven, and Git.
• Experience with Large Language Models/Generative AI is plus.
• Knowledge of Open Source or Commercial Search technology like Lucene, Solr, Elastic Search is plus.
• Experience with different testing techniques (e.g. performance, unit, integration, automated), their strengths and weakness, and ability to use them to best effect.
• Advanced working knowledge and ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks.
• Experience driving cross-team technical discussions with an understanding of SDLC concepts.

Location : Kirkland, Washington or Waltham, Massachusetts

FD21

For positions in the Seattle metro/Kirkland areas, we offer a base pay of $137,500 - $240,500, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs (subject to eligibility requirements). Compensation is based on the geographic location in which the role is located, and is subject to change based on work location.