Senior Machine Learning Engineer / Model Evaluations Expert
$125 per hourEthos
Requirements
Must be eligible to work in Remote
Fluent proficiency in English (Written & Verbal)
Reliable high-speed internet connection
Bachelor's degree or equivalent professional experience
Demonstrated expertise in Software Engineering
How long hiring takes
Across the platforms we work with, people typically hear back about a hire within
about
30 days
of being referred.
Some are quicker, some take longer.
Within 2 weeks
~25%
Within 6 weeks
~60%
Within 3 months
~80%
Why this role
$125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the overhead of running a consulting practice around it.
Skills and categories
Explore other opportunities in related specializations:
Software Engineering
High-Pay ($100+/hr)
No Degree Required
Software Engineering & Coding
Machine Learning
Engineering & Robotics
Expert
Related jobs
Data Science Consultant Expert
ethos ⢠Software Engineering
$100
/hr
AI Engineer (LLMs & Agents) Expert
ethos ⢠Software Engineering
$100
/hr
Software / AI / IT & Data Generalist Expert
ethos ⢠Software Engineering
$80
/hr
Machine Learning Engineer Expert
ethos ⢠Software Engineering
$80
/hr
Browse All Jobs from Ethos
Discover more opportunities on Ethos that match your skills and interests.
View All Ethos Jobs â
Verified Reviews
Loading reviewsâ¦
Community Reviews
Loading reviewsâ¦
ð¬
Share your experience with Ethos
Help other candidates make better decisions by leaving a review.
Sign in to leave a review
Common questions
Do I need to keep applying for projects on Ethos?
No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.
How and when does Ethos pay experts?
Within 30 days of invoice submission after a project closes. That net-30 schedule is standard for enterprise expert networks, but it's slower than the weekly payouts some AI training platforms offer, so plan your cash flow around it.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
Is AI training work the same as traditional consulting?
No. Instead of client deliverables, you're given complex scenarios to evaluate: grading the AI's logic, correcting its hallucinations, and supplying expert-level reasoning it doesn't have on its own. The job is closer to teaching than consulting.
What does Software Engineering work look like for a Senior Machine Learning Engineer / Model Evaluations Expert?
Tasks here are scoped to Software Engineering, not generic labeling. As a Senior Machine Learning Engineer / Model Evaluations Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $125/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who built Ethos and is it legitimate?
Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.
$80 per hour
...Software Engineering Machine Learning Engineer Expert Ethos ⢠Remote Education Not stated Type Hourly Pay Rate $80/hr Listed 40d ago â How Ethos hiring works Your application is a 10-minute call. Ethos's AI interviewer asks about...SuggestedHourly payContract workManual laborImmediate startRemote workFlexible hours- ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Ranking based in Canada. We are seeking an experienced Machine Learning Engineer to advance recommendation and ranking...SeniorFull timeInternshipRemote workMonday to fridayFlexible hours
$243.33k - $282.08k per year
...providing a unique platform to learn and connect with others.... ...subscription, every frontier model, and the collaboration layer that... ...the Team and Role: Our small engineering team works on challenging problems... ...looking for an experienced machine learning engineer to join our...SeniorFull timeRemote workMonday to fridayFlexible hours$40 - $150 per hour
...hours · Payouts: Weekly Overview Models are surprisingly bad at reasoning about themselves: training dynamics, evaluation design, data pipelines, and deployment trade... ...ML advice is often subtly wrong. As a Machine Learning Engineer you'll stress-test how models reason...SuggestedWeekly payFull timeContract workFor contractorsRemote workFlexible hours- ...information, visit redditinc. com . At Reddit, machine learning sits at the heart of how millions of... ...and marketplace dynamics, our ML engineers tackle some of the most interesting and... ...systems end-to-end, from research and modeling to production deployment, — and who want...SuggestedLong term contractFull time
- ...AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring machine learning researchers as contractors to author and solve the analysis problems those evaluations run on, drawn from your own research: experiment...Contract workFor contractorsRemote work
- ...pay Required Skills Python Machine Learning MongoDB About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare,...Part timeFor contractorsRemote work
- ...About the Role We are looking for machine learning engineers to help train and evaluate AI models on machine learning and LLM engineering tasks. You will design tasks, review AI-generated ML code and methodology, and write the reference answers that models are measured...Hourly payFor contractorsRemote work
- ...anyone’s life, allowing us all to spend time on valuable and meaningful things As Lead Engineer, Machine Learning, you own the execution layer of our intelligence, turning research and model capabilities into reliable, scalable production systems. You will work across the...Full time
- ...This is a remote, project-based role for machine learning professionals with deep expertise in bioinformatics. You will complete tasks at the intersection of ML and biological data analysis — including model development, pipeline construction, and research tasks applied to...Contract workRemote work10 hours per week
$227.5k - $324.99k per year
...that powers it. By combining cutting-edge machine learning, recommendation systems, and product... ...the world. As a Staff Machine Learning Engineer, you will help shape the future of personalized... ...recommendation systems, large language models, and production-scale machine learning...Long term contractFull timeInternshipImmediate startFlexible hours$70 - $120 per hour
...Analysis The research teams behind the best-known AI models come to Mercor for machine learning judgment they can't generate on their own. Your... ...machine learning practitioners who want AI training and evaluation work, not a specific job opening. It stays open whether...Part timeShift work- ...Role: TELUS Digital is building a high-impact team of Machine Learning Experts working alongside Policy Enforcement specialists to provide... ...in analyzing, fine-tuning, and optimizing machine learning models for content moderation and policy enforcement. You will evaluate...Part time
- ...Own end-to-end development of machine learning solutions for business needs. About Turing:... ...solution development — from data pipelines and model design to deployment and monitoring.... ...Collaborate cross-functionally with Product, Engineering, and Business stakeholders to define...Contract workPart timeFor contractorsFreelanceRemote work
- ...This is a remote, project-based role for data scientists and machine learning professionals with 1–3 years of work experience. You will complete... ...similar to those performed in data science, machine learning engineering, AI research, or analytics roles. Work is over the next 2-3...Contract workRemote work10 hours per week
$35 - $49 per hour
...Put frontier AI models through real process engineering problems and mark where their reasoning breaks. Remote,... ...About the role Sovrano AI builds evaluation and training data for frontier AI labs... ...to a licensed engineer or a site expert. Requirements Bachelor's degree...SeniorHourly payContract workPart timeFor contractorsManual laborRemote workShift work- ...micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise into...Part timeFor contractorsRemote work
- ...shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview As a Senior Machine Learning Engineer on the Ads Response Prediction team, you will own and execute the development of ML...SeniorFull timeWork at officeWork from homeFlexible hours
- ...Our partner is looking for an Applied Machine Learning Scientist based in Canada. The Applied... ...investment. Working within a highly technical engineering and data science environment, you will... ...new approaches and prototyping models to testing them against historical data...Full timeRemote work
$133k - $183k per year
...with no hidden fees, no surprises, and no tradeoffs on what matters most. As a Machine Learning Engineer on our team, you will be at the forefront of developing high-quality, production-ready models that play a central role in our decision-making processes. Your contributions...Full timeWork at officeRemote work- ...Design and build specific scenarios within a remote reinforcement learning platform Configure environmental parameters and define agent... ...platform improvement Who Should Apply Professional experience in machine learning or artificial intelligence research Hands-on background...Contract workFor contractors
$84 per hour
...Commitment: Hourly, ~40 h/week Field: Other Engineering Mercor is recruiting Atomistic Materials Modelling Experts with strong backgrounds in computational... ...modelling to support advanced AI research. Experts will evaluate technically demanding problems involving...Hourly payContract work10 hours per week- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios... ...for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements • Document findings and...Contract work
- ...understand complex medical information, evaluate healthcare scenarios, and deliver... ...to contribute to the development and evaluation of advanced AI models. We’re seeking physicians, nurse... ...AI-generated conclusions, and provide expert feedback grounded in established medical...Hourly payExtra incomeContract workFor contractorsFreelanceRemote workWeekday work
- ...TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for... ...professionals with expertise across Artificial Intelligence, Machine Learning, LLMs, Mathematics, Science, Engineering, Linguistics,...Part time
- ...the Role Abnormal AI is looking for a Senior Software Engineer to join the Detection Team. The Detection... ..., design, build, deploy, and maintain Model Serving infrastructure that supports a... ...functional teams, including data scientists, machine learning engineers, product managers,...SeniorLong term contractFull timeImmediate start
- ...Evaluate and refine AI-generated code for efficiency and reliability... ...Overview As a Software Engineering evaluator, you will create cutting... ...and advancing large language models, collaborating closely with... ...skills for clear, structured evaluation rationales. Offer Details...SeniorFull timePart timeFor contractorsFlexible hours
$80 - $220 per unit
...Shipd is the contributor platform of Datacurve, a YC-backed company that produces expert coding and STEM data for frontier AI labs. The Eris track covers Machine Learning : Build and solve ML competitions that stump agents and humans alike. How it works Sign up...Contract workRemote work$50 - $150 per hour
...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your... ...Crafting and answering questions related to Machine Learning and AI Evaluating and ranking domain-specific...Contract workTemporary workInternshipRemote workFlexible hours$75 - $90 per hour
...Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security experience... ...for evaluation and reinforcement learning. Follow detailed annotation and evaluation...SeniorLong term contractContract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Engineer / Model Evaluations Expert. Be the first to apply!
- junior machine learning developer Remote
- machine learning engineer Remote
- senior financial accountant Remote
- senior delivery manager Remote
- senior project coordinator Remote
- senior commissioning manager Remote
- senior qa analyst Remote
- senior designer Remote
- senior ruby developer Remote
- senior operations manager Remote