Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

$90 - $120 per hour
Temporary

Mercor

Pay: $90 – $120/hour
Commitment: Hourly, ~40 h/week
Field: Software Engineering

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

1\. Overview

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps and ML systems engineers with hands-on experience in large language model infrastructure across any of four areas: accelerator kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. Experience with JAX, XLA or TPUs is especially valuable. This role involves AI model training and evaluation work, including writing and assessing ML systems tasks and solutions to generate high-quality training data for frontier AI systems.

This is a fully remote role open to candidates worldwide. Depending on where you are based, your engagement will be arranged through Cincinnatus LLC or one of its trusted employer-of-record partners in your country, with the opportunity to be placed at a leading AI lab as part of their extended workforce. This is a 40-hour full-time engagement, with no conflicts/no other engagements.

2\. Key Responsibilities

  • Design challenging tasks across kernels, profiling, debugging and inference serving, including adversarial problems that expose where frontier models fail on accelerator code (for example Pallas kernels on TPU), and write accurate, well-structured solutions to them.
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, compilers and training infrastructure topics.
  • Evaluate ML systems tasks and solutions, and provide clear written technical feedback that stands up to expert review.
  • Develop guidelines and detailed rubrics covering kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
  • Collaborate with other subject matter experts to keep training data consistent and accurate.

3\. Core Qualifications

  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one.
  • Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS); performance profiling and trace analysis (JAX/XLA profiler, Kineto, torch.profiler, Nsight); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, JetStream, KV cache, paged attention, continuous batching).
  • Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, sharding and distributed training (pjit/shard_map, FSDP, Megatron, MaxText), or compiler and graph-level work (XLA/StableHLO, torch.compile, MLIR).
  • Experience with modern accelerators such as TPU (v4 to v6e), H100, B200, Trainium or MI300, and the ability to reason about throughput, latency and memory trade-offs.
  • Demonstrable career progression.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain complex technical decisions clearly.

About Cincinnatus LLC:

Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and engage highly skilled professionals for contingent and contract-based opportunities. Working directly or through local employer-of-record partners, Cincinnatus handles the employment or contracting relationship, payroll, benefits where applicable, and compliance in each country, while placing professionals directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity:

Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the MLOps Engineer, LLM Performance (Kernels, Profiling, Serving) in Remote vacancy
  •  ...further optimising to ensure the highest performant experience for all users. There is a...  ...squads to meet this challenge. The Canonical Kernel Team - those responsible for the build,...  ...to prove a strong aptitude for software engineering at the hardware level. While direct... 
    Performance
    Full time
    Local area
    Remote work
    Work from home
    Worldwide

    Canonical

    Remote
    13 days ago
  •  ...We are seeking a Senior MLOps Engineer based in Canada to join our data and machine learning team...  ...standards for model deployment, serving, scaling and infrastructure efficiency....  ...automated testing, release controls and performance monitoring. - Design and scale model-serving... 
    Performance
    Full time
    Work at office

    Fluent, LLC

    Remote
    11 days ago
  •  ...all applications and next steps. Our partner is looking for a MLOps / Data Engineer based in Canada . As an MLOps / Data Engineer, you will play...  ...machine learning models into reliable, scalable, and high-performance solutions. You will contribute to the development of advanced... 
    Performance
    Long term contract
    Full time
    Remote work

    Jobgether

    Remote
    13 days ago
  •  ...applications and next steps. Our partner is looking for a Senior AI & MLOps Engineer based in Canada. As a Senior AI & MLOps Engineer, you will...  ...implement MLOps and LLMOps best practices, and ensure optimal performance through monitoring and continuous improvement. Working closely... 
    Performance
    Remote work

    Jobgether

    Remote
    3 days ago
  •  ...works with top AI labs and fast-growing companies. Our community of engineers works on real projects, from evals and RL environments to...  ...few minutes with your real details and links. # We review your profile and send you a short technical assessment. # Once you pass, you... 
    Suggested
    Full time
    Immediate start

    G2i

    Remote
    17 days ago
  •  ...date). Responsibilities Research and develop state-of-the-art LLM and/or video or multimodality models to accelerate open-source...  ...recruiter’s identity. All our recruiters have verified LinkedIn profiles. If you’re unsure, you can confirm their identity by checking their... 
    Permanent employment
    Full time
    Internship
    Immediate start
    Remote work
    Worldwide

    Tether Operations Limited

    Remote
    19 days ago
  • usd153k - usd213k per year

     ...mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be trained... 
    Work at office
    Remote work
    Flexible hours

    Affirm

    Remote
    2 days ago
  •  ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Backend (ML Training and Serving) based in Canada. Join a Machine Learning engineering team building the critical infrastructure that enables... 
    Full time
    Immediate start

    Jobgether

    Remote
    3 days ago
  •  ...mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be trained... 

    Affirm

    Remote
    4 days ago
  • $218.89k - $245.95k per year

     ...individual conversations so they can debug them. We're bringing LLM and agent observability together, and we own both the data foundation...  ...on top of it. You'll work in a small, cross-functional group of engineers with a dedicated product manager and designer, shipping features... 
    Full time
    Remote work
    Shift work

    Honeycomb

    Remote
    a month ago
  •  ...partner is looking for a Product Lead, Self-Serve Growth based in Canada. The Product Lead...  ...account expansion. Working closely with engineering, design, marketing, customer success,...  ...acquisition and long-term business performance. - Own and optimize the complete self-serve... 
    Performance
    Long term contract
    Full time

    Jobgether

    Remote
    4 days ago
  • $70 per hour

     ...then matches you to projects like Civil Servant. Keep your CV open and cover these: 5+...  ...: Generalist No Degree Required Engineering & Robotics Expert AI Training Related...  ...for projects on Ethos? No. Once your profile is live, Ethos's algorithm matches you to... 
    Hourly pay
    Contract work
    Manual labor
    Immediate start
    Remote work
    Flexible hours

    Ethos

    Remote
    a month ago
  •  ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-world... 
    Contract work

    AfterQuery

    Remote
    a month ago
  •  ...AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Engineering evaluator, you will create cutting-edge datasets for training,... 
    Performance
    Full time
    Part time
    For contractors
    Flexible hours

    Turing

    Remote
    a month ago
  • $26 - $99 per hour

     ...user inputs into test cases, scoring them with code checks and an LLM judge, and reading which cases a prompt change made worse....  ...YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed.... 
    Contract work
    Internship
    Manual labor
    Local area
    Remote work
    Worldwide
    Shift work

    YPAI

    Remote
    5 days ago
  •  ...About the Role We are looking for software engineers to validate real-world repositories used...  ...Edit and run code locally to see how LLMs perform on bug-fixing tasks. Help pick...  ...setting. Preferred Qualifications Prior LLM research or evaluation projects. Experience... 
    Hourly pay
    For contractors
    Remote work

    RemoExperts

    Remote
    a month ago
  •  ...suggestions, and providing structured feedback to improve model performance. Skills Travel Planning, Fact-Checking, Destination Research...  ...Writing Duration Continuous / Fast-Moving New to LLM Training?These are projects where you use your technical expertise... 
    Performance
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    9 days ago
  • $80 per hour

     ...work turning published ML systems and GPU kernels research into coding tasks for frontier...  .... For PhD-level researchers and research engineers who publish and ship code. Domain: ML Systems...  ..., Triton and CUTLASS kernels, inference serving and ML compilers) Requirements Experience... 
    Contract work
    Remote work

    AfterQuery

    Remote
    17 days ago
  •  ...Media & Entertainment Analysis, Fact-Checking, Critical Thinking, Content Evaluation Duration Continuous / Fast-Moving New to LLM Training?These are projects where you use your technical expertise to help improve AI models. You'll work on tasks like evaluating code... 
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    9 days ago
  •  ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering... 
    Performance
    Contract work
    Part time
    For contractors
    Freelance
    Manual labor
    Remote work

    Turing

    Remote
    a month ago
  •  ...seeking talented developers proficient Java Engineer. The engineer will be working together on...  ...evaluations (Evals) to benchmark model performance and analyze results for continuous...  ...processes. Required Skills: Train LLM models with high-quality, stable, and scalable... 
    Performance
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    a month ago
  •  ...Main Activities As a Health & Fitness Specialist in LLM Training, you will evaluate AI-generated health, wellness, and exercise content to ensure safety, biological accuracy, and high quality. Your key activities will include: Prompt Analysis: Reviewing user prompts... 
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    9 days ago
  •  ...What You'll Do Review artist profiles including bios, genres, and performance clips. Assess whether an artist is a good fit for live booking. Recommend specific types of rooms or venues for each artist. Provide a one-line note summarizing your booking decision. Who Should... 
    Performance
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    23 days ago
  •  ...Main Activities As a Learning Specialist in LLM Training, you will help refine AI models to deliver accurate, engaging, and pedagogically sound educational content. Your key responsibilities will include: Prompt & Curriculum Analysis: Reviewing learning prompts, lesson... 
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    9 days ago
  •  ...open-ended computer dialogues, is looking for Go develoeprs. The engineer will be working together on the definition, design, and delivery...  ...to have candidates who have used Github in the past. Train LLM models with high-quality, stable, and scalable back-end components... 
    Contract work
    Part time
    Flexible hours

    Turing

    Remote
    a month ago
  • usd150k - usd190k per year

     ...well-funded team of researchers and engineers on a mission to democratize AI through performance and accessibility. Our cloud...  ...a GPU cloud, inference provider, MLOps platform, AI/developer tooling company...  ...~ Working knowledge of modern LLM inference — serving stacks (vLLM,... 
    Performance
    Full time
    Internship
    Immediate start

    Featherless AI

    Remote
    6 days ago
  •  ...public cloud, data science, AI, engineering innovation and IoT. Our...  ...end-to-end data analytics and MLOps solutions composed of popular,...  ...desktops, or as web services. We serve the needs of individuals and...  ...the entire Linux stack, from kernel, networking, and storage, to the... 
    Performance
    Full time
    Local area
    Remote work
    Work from home
    Worldwide

    Canonical

    Remote
    13 days ago
  •  ...skilled Artificial Intelligence Engineer to join our team and...  ...refine prompts to ensure optimal performance of Large Language Models (LLMs...  ...and domain experts to integrate LLM capabilities into WRS Health’s...  ...Machine Learning Operations (MLOps) and Large Language Model Operations... 
    Performance
    Full time
    Remote work

    WRS Health

    Remote
    2 days ago
  • $55 - $100 per hour

    Pay: $55–100/hour You'll systematically probe large language models to find inputs that cause them to bypass safety guidelines and produce harmful, disallowed, or policy-violating outputs. Your work involves crafting adversarial prompts across defined harm categories — ...
    Contract work

    Claru

    Remote
    a month ago
  • $145.8k - $186.17k per year

     ...The role You will take on the ongoing maintenance and engineering work in Firefox’s Graphics area (rendering, compositing, images, canvas...  ...review and routine upkeep so the FTE engineers can focus on performance. Definition of done A healthy Graphics area, backlog and... 
    Performance
    Ongoing contract
    Contract work

    Mozilla

    Remote
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to MLOps Engineer, LLM Performance (Kernels, Profiling, Serving). Be the first to apply!