Benchmarking Engineer

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities.

As a Competitive Analysis / Benchmarking Engineer at Tenstorrent, you'll be at the forefront of our effort to stay ahead in the fast-paced AI industry. You will be instrumental in providing insights that shape the direction of our software and hardware offerings. Your work will involve detailed analysis and benchmarking of Tenstorrent's software on a variety of hardware configurations against our main competitors' solutions.

This role ishybrid, based out of Toronto, ON, Austin, TX, Santa Clara, CA.

We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting.

Responsibilities:

• Conduct comprehensive benchmarking of Tenstorrent's software across various hardware configurations, including single and multi-chip setups.
• Perform in-depth benchmarking analysis of competitor hardware and software platforms.
• Stay ahead of the curve by monitoring competitor releases and trends in the AI industry to maintain and update our benchmarking standards.
• Develop and refine a sophisticated benchmarking framework and methodology, ensuring precision and consistency in performance testing.
• Collaborate with technical teams to translate benchmarking insights into actionable recommendations for product enhancements.
• Automate benchmarking processes where possible, and validate performance metrics against industry and internal benchmarks.

Experience & Qualifications:

• Proficient in AI/ML frameworks like PyTorch, TensorFlow, CUDA, TensorRT, and adept at applying these in performance benchmarking scenarios.
• Knowledge of popular deep learning models and tasks, how to effectively benchmark them, understanding the intricacies of how models work, and the ability to translate these insights into the benchmarking process.
• Hands-on experience in software development with a strong command of Python, C++, and version control systems like Git.
• Expertise in computer architecture, performance measurement, and analysis, including experience with benchmarking tools and profilers.
• Proven competence in setting up and managing a hardware lab, including procuring and maintaining a diverse array of systems and components.
• Excellent organizational skills for managing hardware inventory and conducting systematic benchmarking experiments.
• Knowledge of data analysis and visualization tools to effectively communicate performance findings.
• Strong problem-solving abilities and a meticulous approach to documenting benchmarking processes and results.
• A proactive learner, staying informed about new benchmarking methodologies and tools, as well as emerging trends in AI hardware and software.
• Ability to work collaboratively with cross-functional teams, providing clear and concise technical guidance.

Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets. Experience, skills, education, background and location all impact the actual offer made.

Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.

Due to U.S. Export Control laws and regulations, Tenstorrent is required to ensure compliance with licensing regulations when transferring technology to nationals of certain countries that have been licensing conditions set by the U.S. government.

Our engineering positions and certain engineering support positions require access to information, systems, or technologies that are subject to U.S. Export Control laws and regulations, please note that citizenship/permanent residency, asylee and refugee information and/or documentation will be required and considered as Tenstorrent moves through the employment process.

If a U.S. export license is required, employment will not begin until a license with acceptable conditions is granted by the U.S. government. If a U.S. export license with acceptable conditions is not granted by the U.S. government, then the offer of employment will be rescinded.