Ai Inference Engineer
$165k - $330k per yearBaseten
About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.THE ROLE
As a Forward Deployed Engineer at Baseten, you will partner directly with customers to architect, build, and deploy high-scale production AI applications on Baseten’s platform. You’ll own the journey with customers from initial exploration to production deployment, translating ambiguous business goals into reliable, observable services with clear quality, latency, and cost outcomes.This role is a great fit for entrepreneurial engineers who want a front-row view into how modern companies adopt AI at scale and who enjoy working across product, software development, performance engineering, and customer-facing implementations.To be clear, this is an engineering role with hands-on coding and software development that also includes aspects of product management, technical customer success, and pre-sales solution engineering mixed in.EXAMPLE INITIATIVES
Take a look at these blog posts written by members of our Forward Deployed Engineering team:Forward Deployed Engineering on the frontier of AIThe fastest, most accurate Whisper transcriptionDeploy production-ready model servers from Docker imagesDeploy custom ComfyUI workflows as APIsResponsibilities
Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion.Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customersOptimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs.Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end-to-end execution.Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.Requirements
Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.2+ years of professional work experience in a fast-paced, high-growth environment.Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python.Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment.Strong communication skills, particularly on complex technical topics.Experience in building or optimizing AI/ML projects is highly valued.Benefits
Competitive compensation, including meaningful equity.100% coverage of medical, dental, and vision insurance for employee and dependentsFlexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)Paid parental leaveFertility and family-building stipend through CarrotCompany-facilitated 401(k)Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).Compensation Range: $165K - $330K
#J-18808-Ljbffr
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.THE ROLE
As a Forward Deployed Engineer at Baseten, you will partner directly with customers to architect, build, and deploy high-scale production AI applications on Baseten’s platform. You’ll own the journey with customers from initial exploration to production deployment, translating ambiguous business goals into reliable, observable services with clear quality, latency, and cost outcomes.This role is a great fit for entrepreneurial engineers who want a front-row view into how modern companies adopt AI at scale and who enjoy working across product, software development, performance engineering, and customer-facing implementations.To be clear, this is an engineering role with hands-on coding and software development that also includes aspects of product management, technical customer success, and pre-sales solution engineering mixed in.EXAMPLE INITIATIVES
Take a look at these blog posts written by members of our Forward Deployed Engineering team:Forward Deployed Engineering on the frontier of AIThe fastest, most accurate Whisper transcriptionDeploy production-ready model servers from Docker imagesDeploy custom ComfyUI workflows as APIsResponsibilities
Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion.Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customersOptimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs.Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end-to-end execution.Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.Requirements
Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.2+ years of professional work experience in a fast-paced, high-growth environment.Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python.Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment.Strong communication skills, particularly on complex technical topics.Experience in building or optimizing AI/ML projects is highly valued.Benefits
Competitive compensation, including meaningful equity.100% coverage of medical, dental, and vision insurance for employee and dependentsFlexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)Paid parental leaveFertility and family-building stipend through CarrotCompany-facilitated 401(k)Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).Compensation Range: $165K - $330K
#J-18808-Ljbffr
Vacancy posted 48 minutes ago
Similar jobs that could be interesting for youBased on the Ai Inference Engineer in Winnipeg, MB vacancy
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products.THE ROLE As a Forward Deployed...SuggestedInternshipFlexible hours$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production...SuggestedWork at officeLocal areaFlexible hours2 days per week3 days per week- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered...Suggested
- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Suggested
- Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+...Suggested
- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo... ...EquityResponsibilities Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency....
- ...supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen... ...looking for a Senior Software Development Engineer to own the end-to-end model execution... ...infrastructure at scale and high-performance inference serving. The PersonThis role demands...InternshipManual labor
- Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise... .... You will own the architecture for complex inference challenges, enable low latency and high throughput,...
- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional teams to deploy and scale cutting-edge AI workloads. In this influential role, you will be embedded within Platform Engineering...
- ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver...
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products. Baseten powers mission-critical...Long term contractFlexible hours- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer...
- ...rapid-growth technology firm in Toronto is seeking a Staff LLMOps Engineer to lead the design and optimization of large language model... ...architecting deployment pipelines and ensuring high-performance AI applications. Competitive salary and equity are included in the offer...
- AMD is seeking a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs, covering training infrastructure at scale and high-performance inference serving. You will ship LLMs on real hardware, optimize GPU kernels, and ensure frontier...
$111k - $160k per year
...that help people, businesses and governments realize their greatest potential.Title and Summary Senior Software Engineer (Sanctions Service & AI Inference)Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and...InternshipWorldwide- FullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You... ...into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML engineering...Flexible hours
- Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale AMD GPU infrastructure to ensure reliability, numerical correctness, observability, and high performance...
- Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment. At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance...
- ...Systems builds the world's largest AI chip, 56 times larger than... ...industry-leading training and inference speeds; over 10 times... ...the software systems that power engineering workflows across Cerebras.... ...orchestration frameworks, execution engines, scheduling systems, test infrastructure...
$165k - $330k per year
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma... ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEAs an Engineer on...Flexible hours- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference...
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ...us and help build the platform engineers turn to ship AI products.About... ...or contributions to LLM inference engines and frameworks such as vLLM, SGLang...Flexible hours- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies... ...with continuous batching techniquesEquity in a well-funded AI startup Premium health and dentalRemote-first cultureHome...Work at office
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to...
$114.4k - $164.4k per year
Company: Qualcomm Canada ULCJob Area: Engineering Group, Engineering Group Machine... ...Summary: As a member of the Low Power AI Solution team, you will conduct advanced... ...push the boundaries of efficient on‑device inference. You will lead and contribute to high-...Work from home$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ...Join us and help build the platform engineers turn to ship AI products.About... ...across the stack, from the inference engine and runtime through scheduling, serving...Flexible hours- ...leading security-first enterprise AI company. We build cutting-edge... ...is a team of researchers, engineers, designers, and more, who are... ...ambiguous, customer-specific inference challenges—ranging from multi-... ...experience with modern inference engines and optimization stacks (e.g.,...Full timeWork at officeLocal areaRemote workHome office
- Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services. Candidates for this position must have over five years of backend engineering...Remote work
- Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our... ...beneficial AI systems. About the roleOur Inference team is responsible for building and...Long term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- Qualcomm Canada ULC is seeking an engineer to deploy ML models on a low power AI accelerator. You will map high level operators to hardware instructions, optimize... ...with quantization. The role focuses on improving inference efficiency and accuracy on Qualcomm's hardware,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Inference Engineer. Be the first to apply!

