MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)
$90 - $120 per hourMercor
Pay: $90 – $120/hour
Commitment: Hourly, ~40 h/week
Field: Software Engineering
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.
1\. Overview
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps and ML systems engineers with hands-on experience in large language model infrastructure across any of four areas: accelerator kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. Experience with JAX, XLA or TPUs is especially valuable. This role involves AI model training and evaluation work, including writing and assessing ML systems tasks and solutions to generate high-quality training data for frontier AI systems.
This is a fully remote role open to candidates worldwide. Depending on where you are based, your engagement will be arranged through Cincinnatus LLC or one of its trusted employer-of-record partners in your country, with the opportunity to be placed at a leading AI lab as part of their extended workforce. This is a 40-hour full-time engagement, with no conflicts/no other engagements.
2\. Key Responsibilities
- Design challenging tasks across kernels, profiling, debugging and inference serving, including adversarial problems that expose where frontier models fail on accelerator code (for example Pallas kernels on TPU), and write accurate, well-structured solutions to them.
- Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, compilers and training infrastructure topics.
- Evaluate ML systems tasks and solutions, and provide clear written technical feedback that stands up to expert review.
- Develop guidelines and detailed rubrics covering kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
- Collaborate with other subject matter experts to keep training data consistent and accurate.
3\. Core Qualifications
- 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one.
- Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS); performance profiling and trace analysis (JAX/XLA profiler, Kineto, torch.profiler, Nsight); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, JetStream, KV cache, paged attention, continuous batching).
- Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, sharding and distributed training (pjit/shard_map, FSDP, Megatron, MaxText), or compiler and graph-level work (XLA/StableHLO, torch.compile, MLIR).
- Experience with modern accelerators such as TPU (v4 to v6e), H100, B200, Trainium or MI300, and the ability to reason about throughput, latency and memory trade-offs.
- Demonstrable career progression.
- Ability to engage reliably for at least 40 hours/week during weekdays.
- Strong written communication skills and the ability to explain complex technical decisions clearly.
About Cincinnatus LLC:
Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and engage highly skilled professionals for contingent and contract-based opportunities. Working directly or through local employer-of-record partners, Cincinnatus handles the employment or contracting relationship, payroll, benefits where applicable, and compliance in each country, while placing professionals directly within client teams to work on high-impact initiatives.
Equal Employment Opportunity:
Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.
- ...further optimising to ensure the highest performant experience for all users. There is a... ...squads to meet this challenge. The Canonical Kernel Team - those responsible for the build,... ...to prove a strong aptitude for software engineering at the hardware level. While direct...PerformanceFull timeLocal areaRemote workWork from homeWorldwide
- ...We are seeking a Senior MLOps Engineer based in Canada to join our data and machine learning team... ...standards for model deployment, serving, scaling and infrastructure efficiency.... ...automated testing, release controls and performance monitoring. - Design and scale model-serving...PerformanceFull timeWork at office
- ...all applications and next steps. Our partner is looking for a MLOps / Data Engineer based in Canada . As an MLOps / Data Engineer, you will play... ...machine learning models into reliable, scalable, and high-performance solutions. You will contribute to the development of advanced...PerformanceLong term contractFull timeRemote work
- ...applications and next steps. Our partner is looking for a Senior AI & MLOps Engineer based in Canada. As a Senior AI & MLOps Engineer, you will... ...implement MLOps and LLMOps best practices, and ensure optimal performance through monitoring and continuous improvement. Working closely...PerformanceRemote work
- ...works with top AI labs and fast-growing companies. Our community of engineers works on real projects, from evals and RL environments to... ...few minutes with your real details and links. # We review your profile and send you a short technical assessment. # Once you pass, you...SuggestedFull timeImmediate start
- ...date). Responsibilities Research and develop state-of-the-art LLM and/or video or multimodality models to accelerate open-source... ...recruiter’s identity. All our recruiters have verified LinkedIn profiles. If you’re unsure, you can confirm their identity by checking their...Permanent employmentFull timeInternshipImmediate startRemote workWorldwide
usd153k - usd213k per year
...mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be trained...Work at officeRemote workFlexible hours- ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Backend (ML Training and Serving) based in Canada. Join a Machine Learning engineering team building the critical infrastructure that enables...Full timeImmediate start
- ...mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be trained...
$218.89k - $245.95k per year
...individual conversations so they can debug them. We're bringing LLM and agent observability together, and we own both the data foundation... ...on top of it. You'll work in a small, cross-functional group of engineers with a dedicated product manager and designer, shipping features...Full timeRemote workShift work- ...partner is looking for a Product Lead, Self-Serve Growth based in Canada. The Product Lead... ...account expansion. Working closely with engineering, design, marketing, customer success,... ...acquisition and long-term business performance. - Own and optimize the complete self-serve...PerformanceLong term contractFull time
$70 per hour
...then matches you to projects like Civil Servant. Keep your CV open and cover these: 5+... ...: Generalist No Degree Required Engineering & Robotics Expert AI Training Related... ...for projects on Ethos? No. Once your profile is live, Ethos's algorithm matches you to...Hourly payContract workManual laborImmediate startRemote workFlexible hours- ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-world...Contract work
- ...AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Engineering evaluator, you will create cutting-edge datasets for training,...PerformanceFull timePart timeFor contractorsFlexible hours
$26 - $99 per hour
...user inputs into test cases, scoring them with code checks and an LLM judge, and reading which cases a prompt change made worse.... ...YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed....Contract workInternshipManual laborLocal areaRemote workWorldwideShift work- ...About the Role We are looking for software engineers to validate real-world repositories used... ...Edit and run code locally to see how LLMs perform on bug-fixing tasks. Help pick... ...setting. Preferred Qualifications Prior LLM research or evaluation projects. Experience...Hourly payFor contractorsRemote work
- ...suggestions, and providing structured feedback to improve model performance. Skills Travel Planning, Fact-Checking, Destination Research... ...Writing Duration Continuous / Fast-Moving New to LLM Training?These are projects where you use your technical expertise...PerformanceContract workFreelanceFlexible hours
$80 per hour
...work turning published ML systems and GPU kernels research into coding tasks for frontier... .... For PhD-level researchers and research engineers who publish and ship code. Domain: ML Systems... ..., Triton and CUTLASS kernels, inference serving and ML compilers) Requirements Experience...Contract workRemote work- ...Media & Entertainment Analysis, Fact-Checking, Critical Thinking, Content Evaluation Duration Continuous / Fast-Moving New to LLM Training?These are projects where you use your technical expertise to help improve AI models. You'll work on tasks like evaluating code...Contract workFreelanceFlexible hours
- ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering...PerformanceContract workPart timeFor contractorsFreelanceManual laborRemote work
- ...seeking talented developers proficient Java Engineer. The engineer will be working together on... ...evaluations (Evals) to benchmark model performance and analyze results for continuous... ...processes. Required Skills: Train LLM models with high-quality, stable, and scalable...PerformanceContract workPart timeFor contractorsFreelanceRemote work
- ...Main Activities As a Health & Fitness Specialist in LLM Training, you will evaluate AI-generated health, wellness, and exercise content to ensure safety, biological accuracy, and high quality. Your key activities will include: Prompt Analysis: Reviewing user prompts...Contract workFreelanceFlexible hours
- ...What You'll Do Review artist profiles including bios, genres, and performance clips. Assess whether an artist is a good fit for live booking. Recommend specific types of rooms or venues for each artist. Provide a one-line note summarizing your booking decision. Who Should...PerformanceContract workFor contractorsRemote work
- ...Main Activities As a Learning Specialist in LLM Training, you will help refine AI models to deliver accurate, engaging, and pedagogically sound educational content. Your key responsibilities will include: Prompt & Curriculum Analysis: Reviewing learning prompts, lesson...Contract workFreelanceFlexible hours
- ...open-ended computer dialogues, is looking for Go develoeprs. The engineer will be working together on the definition, design, and delivery... ...to have candidates who have used Github in the past. Train LLM models with high-quality, stable, and scalable back-end components...Contract workPart timeFlexible hours
usd150k - usd190k per year
...well-funded team of researchers and engineers on a mission to democratize AI through performance and accessibility. Our cloud... ...a GPU cloud, inference provider, MLOps platform, AI/developer tooling company... ...~ Working knowledge of modern LLM inference — serving stacks (vLLM,...PerformanceFull timeInternshipImmediate start- ...public cloud, data science, AI, engineering innovation and IoT. Our... ...end-to-end data analytics and MLOps solutions composed of popular,... ...desktops, or as web services. We serve the needs of individuals and... ...the entire Linux stack, from kernel, networking, and storage, to the...PerformanceFull timeLocal areaRemote workWork from homeWorldwide
- ...skilled Artificial Intelligence Engineer to join our team and... ...refine prompts to ensure optimal performance of Large Language Models (LLMs... ...and domain experts to integrate LLM capabilities into WRS Health’s... ...Machine Learning Operations (MLOps) and Large Language Model Operations...PerformanceFull timeRemote work
$55 - $100 per hour
Pay: $55–100/hour You'll systematically probe large language models to find inputs that cause them to bypass safety guidelines and produce harmful, disallowed, or policy-violating outputs. Your work involves crafting adversarial prompts across defined harm categories — ...Contract work$145.8k - $186.17k per year
...The role You will take on the ongoing maintenance and engineering work in Firefox’s Graphics area (rendering, compositing, images, canvas... ...review and routine upkeep so the FTE engineers can focus on performance. Definition of done A healthy Graphics area, backlog and...PerformanceOngoing contractContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to MLOps Engineer, LLM Performance (Kernels, Profiling, Serving). Be the first to apply!
