Job Overview

Baseten is currently hiring for the position of Software Engineer, Model Performance Tooling.
This opportunity is based in New York, NY with a On Site work model. Candidates looking for jobs in the AI Infrastructure,Artificial Intelligence (AI) industry can apply for this role.

Job Details

• Company Size: 101-250
• Industry: AI Infrastructure,Artificial Intelligence (AI)
• H1B Sponsorship: not sure
• Open for Freshers / New Graduates:

Required Qualifications

1. A Love for Systems & Hardware: You aren’t just interested in the AI; you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
2. An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the ‘breaking point’ of a system.
3. Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
4. Interest in Optimization: You are excited to learn about (or already play with) quantization, speculative decoding, disaggregated serving, and kernel-level optimizations.
5. Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack.

How to Apply

Interested candidates can apply directly using the link below:

👉
Apply for Software Engineer, Model Performance Tooling at Baseten