Observability Engineer For Scalable Ai Infra
$165k - $330k per yearBaseten
About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Baseten is seeking talented and experienced Software Engineers to join our Observability team within the Infrastructure organization. As an early member of the Observability Team, you will be pivotal in building and shaping the observability experience for our internal and external customers. By joining this team, you’ll have a direct impact on the reliability and operational excellence of Baseten's product systems.
As Baseten scales its infrastructure across different cloud providers and diverse hardware, the volume and complexity of operational data is growing by orders of magnitude. This team is responsible for building high-throughput ingest pipelines, cost-efficient storage, and agentic diagnostic tools to ensure that we can detect, diagnose, and resolve issues in minutes rather than hours, even as the systems they operate become more complex.
Responsibilities
Design and build scalable telemetry ingest and storage pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructureOwn and evolve core observability platforms, driving migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growthBuild instrumentation libraries, SDKs, and integrations that make it easy for engineering teams to emit high-quality telemetry from their servicesDrive alerting and SLO infrastructure that enables teams to define, monitor, and respond to reliability targets with minimal noisePartner with Inference, Product, and Infrastructure teams to ensure observability solutions meet the unique needs of each organization
Requirements
Have deep experience with at least one observability signal area (metrics, logging, tracing, or error analytics) and familiarity with the othersUnderstand high-throughput data pipelines, columnar storage engines, and the tradeoffs involved in ingesting and querying telemetry data at scaleHave experience operating or building on top of observability platforms such as Prometheus, Grafana, ClickHouse, OpenTelemetry, or similar systemsHave strong proficiency in at least one of Python, Rust, or GoHave excellent communication skills and enjoy partnering with internal teams to improve their operational visibility and incident response capabilitiesInterest in applying AI/LLMs to operational workflows such as automated root cause analysis, anomaly detection, or intelligent alertingAre excited about building foundational infrastructure and are comfortable working independently on ambiguous, high-impact technical challenges
Benefits
Competitive compensation, including meaningful equity(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependentsFlexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)Paid parental leaveFertility and family-building stipend through Carrot(U.S. only) Company-facilitated 401(k)Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now
to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Compensation Range: $165K - $330K
#J-18808-Ljbffr
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Baseten is seeking talented and experienced Software Engineers to join our Observability team within the Infrastructure organization. As an early member of the Observability Team, you will be pivotal in building and shaping the observability experience for our internal and external customers. By joining this team, you’ll have a direct impact on the reliability and operational excellence of Baseten's product systems.
As Baseten scales its infrastructure across different cloud providers and diverse hardware, the volume and complexity of operational data is growing by orders of magnitude. This team is responsible for building high-throughput ingest pipelines, cost-efficient storage, and agentic diagnostic tools to ensure that we can detect, diagnose, and resolve issues in minutes rather than hours, even as the systems they operate become more complex.
Responsibilities
Design and build scalable telemetry ingest and storage pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructureOwn and evolve core observability platforms, driving migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growthBuild instrumentation libraries, SDKs, and integrations that make it easy for engineering teams to emit high-quality telemetry from their servicesDrive alerting and SLO infrastructure that enables teams to define, monitor, and respond to reliability targets with minimal noisePartner with Inference, Product, and Infrastructure teams to ensure observability solutions meet the unique needs of each organization
Requirements
Have deep experience with at least one observability signal area (metrics, logging, tracing, or error analytics) and familiarity with the othersUnderstand high-throughput data pipelines, columnar storage engines, and the tradeoffs involved in ingesting and querying telemetry data at scaleHave experience operating or building on top of observability platforms such as Prometheus, Grafana, ClickHouse, OpenTelemetry, or similar systemsHave strong proficiency in at least one of Python, Rust, or GoHave excellent communication skills and enjoy partnering with internal teams to improve their operational visibility and incident response capabilitiesInterest in applying AI/LLMs to operational workflows such as automated root cause analysis, anomaly detection, or intelligent alertingAre excited about building foundational infrastructure and are comfortable working independently on ambiguous, high-impact technical challenges
Benefits
Competitive compensation, including meaningful equity(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependentsFlexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)Paid parental leaveFertility and family-building stipend through Carrot(U.S. only) Company-facilitated 401(k)Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now
to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Compensation Range: $165K - $330K
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Observability Engineer For Scalable Ai Infra in Winnipeg, MB vacancy
- Baseten is seeking a Site Reliability Engineer to define day‑2 operations standards for our ML infrastructure platform. You will build robust systems, automate mitigations, and develop observability tooling to keep services reliable at scale while enabling the broader team to...Suggested
- Handshake is seeking a Senior Software Engineer to join the ML Infrastructure & Platform team. You will build and operate shared infra behind Handshake’s core marketplace and Handshake AI, enabling scalable production ML and AI systems. You’ll work at the intersection of software...Suggested
- Walt Disney Animation Studios seeks a Senior Site Reliability Engineer to design, implement, and operate scalable, reliable infrastructure across on‑prem and cloud environments. You will drive observability, automation, and performance optimization, partnering with teams to...Suggested
- ...tech, crypto infrastructure, digital assets, venture capital, and AI since its launch in 2020. Delivering end-to-end go-to-market... ...role sits at the intersection of competitive intelligence, data engineering, and agentic AI. You'll pull signals from social platforms, on-chain...SuggestedInternshipRemote work
- A premier staffing agency is seeking a Senior Specialist in Systems Engineering in Toronto, ON. This role involves collaborating with diverse teams to design and maintain secure infrastructure platforms while handling OS and middleware upgrades and ensuring SLA adherence. Candidates...Suggested
- MedMe Health is hiring a senior platform engineer (infrastructure and observability) for Nova in Toronto. You’ll own major platform initiatives, deepen AWS/CDK know‑how (TypeScript), and help consolidate deployment pipelines with a bias for accuracy. Join a small, high‑trust...
$80k - $175k per year
...track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM... ...Bachelor's Degree in Computer Science, Engineering or other relevant domain 7-10 years experience... ...Experience in Artificial Intelligence Observability Engineering, facilitating the ability to...Part time- Extend Tempo for AI and agent workloads through structured APIs, observability systems, and scalable engineering. Work remotely with modern coding assistants.As a Senior Engineer on Tempo, you will build capabilities for Grafana’s AI assistant, external integrators, and agent...Remote work
- Join Honeycomb as a Software Engineer I, focusing on AI observability in a fully remote role. Contribute your software engineering expertise to enhance... ...observability capabilities • Develop the data model for agent observations • Build systems for analyzing AI-specific signals •...Remote work
$138.3k - $185.9k per year
Elastic, the Search AI Company, enables everyone to find the answers they need in real... ...solutions for search, security, and observability help organizations deliver on the promise... ...platform. The observability clusters show Cloud engineers how production is behaving right now, and...Local areaFlexible hours- Transform industries as a Generative AI Engineer focused on scalability. Utilize advanced Python capabilities and relevant AI experiences to implement impactful AI solutions. This mid-senior engineer role is tailored for professionals with at least 4 years in Generative AI...
- ...Data Center team. You will design, deploy, and maintain secure, scalable Linux-based systems and services on-site to meet business needs.... ...performance, and enforce security standards while mentoring junior engineers and maintaining operational documentation. #J-18808-Ljbffr
- ...Capital One Canada is hiring a Principal Associate, AI Engineer to join the IFX team in Toronto. You will partner with engineers, researchers... ...components, including foundation model training, LLM inference, and observability, using Open Source and SaaS AI stacks. #J-18808-Ljbffr
- ...Description Insight Global is looking for an observability engineer for one of our clients platform and... ...teams migrating to Datadog using APM, Infra, and Serverless agents, ensuring our... ...SSDLC standards into pipelinesIntegrate AI-assisted workflows into CI/CD, code review...
- ...Scientist to join a world-class team of engineers and data scientists in Toronto. You will... ...world problems, building production-grade AI/ML systems and turning cutting-edge... ...and product instincts, with a focus on scalable, observable ML architectures and data privacy considerations...
- ...with a full-stack portfolio of AI-enabled, AI-ready, and AI-... ...workloads. Define intelligent observability and diagnostic technologies... ...-offs involving performance, scalability, reliability, availability,... ...Establish reusable frameworks, engineering practices, evaluation...Permanent employmentLocal area3 days per week
- ...with a full-stack portfolio of AI-enabled, AI-ready, and AI-... ...infrastructure to address performance, scalability, reliability, and energy-... ...to junior researchers and engineers. Minimum Qualifications... ...profiling, telemetry analytics, observability, performance diagnosis, or...Permanent employmentLocal area3 days per week
- ...Sagard is pursuing an AI-first strategy; the AI Builder / Forward Deployed Engineer will collaborate with investment, finance, compliance and operations to uncover... ...quality data workflows, secure access controls, and scalable AI deployments, including RAG pipelines and LLM integration...
- A leading technology firm is seeking a Software Engineer to design and develop platform features that enable developers and AI agents to enhance large-scale software services. The ideal candidate will have a Bachelor's Degree in Computer Science, proficiency in multiple programming...
- Deel is hiring a Backend Engineer, AI to ship scalable backend features across 150+ countries. You will leverage AI tools like Claude to accelerate development while maintaining high engineering standards. You will own features end-to-end, collaborate with Product, Frontend...Remote work
- ...this is the place.About the Role:The VP of Engineering is a key member of Ndustrial’s leadership... ...with company objectives.We are an AI-forward engineering organization, and this... ...capabilities, security, reliability, and scalability while empowering the team to own implementation...InternshipWork at officeLocal area
- Get notified about new Director Of Software Engineering jobs in United States . 7,000+ Director Of Software Engineering Jobs in United States... ...Engineering – Acute Devices Director, Software Engineering - AI Platform and Full Stack Engineering - Office-based in Minneapolis...Work at officeRemote work
- ...lead the IT Operations team spanning networks, systems, DevOps, and IT support. You will ensure reliable, secure, and scalable technology powering engineers and mission systems. In a player-coach role you set priorities, mentor staff, and stay hands-on with escalations, infrastructure...
- ...Systems builds the world's largest AI chip, 56 times larger than... ...AI Data Center Infrastructure Engineer to turn cluster architecture... ...system performance, reliability, scalability, and serviceability. You will... ...increasingly repeatable and scalable. Qualifications A bachelor’...Contract work
- ...Centre Canada ULC - K03 in Toronto is hiring software engineers to design, build, and operate scalable cloud-native products that impact millions of customers... ...languages (Java, Python, C++, C#), distributed systems, and AI-enabled tooling, with on-call responsibilities and a...
- ...financial future for Ontario healthcare workers. As Lead Agentic AI Engineer, you will collaborate with engineers, security, governance, and... ...problems using AI and emerging tech, delivering secure, scalable IT solutions that fulfill the pension promise. We cultivate...
$155k - $195k per year
A leading dental software company in Surrey is seeking a Staff Software Engineer to join their Ascend Specialty domain. This hybrid role focuses on architectural leadership, engineering best practices, and modernizing the platform. Ideal candidates will have 8+ years of software...- Cerebras Systems is seeking a seasoned cluster engineer to join the team responsible for turning thousands of wafers, servers, and switches into a reliable, observable cloud. The role focuses on automating bare-metal provisioning, upgrades, and security patches, with a strong...
$140k - $240k per year
...InvestorLine from general-purpose AI assistants to an AI-augmented... ...emerging AI capabilitiesAI Scalability & Enterprise Alignment... ...stack; this is not an AI engineering role, but you must be fluent... ..., guardrails, orchestration, observability, agent identity management)Deep...Part timeInternship$110k - $151.8k per year
Secure Every Identity, from AI to HumanIdentity is the key to unlocking... ...let's talk.The Auth0 Platform Observability team owns the observability... ...looking for an Observability Engineer to help ensure that our... ...servicesDesign, build, and maintain scalable observability infrastructure...Local areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Observability Engineer For Scalable Ai Infra. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

