Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine learning researcher (PhD): evaluation design and red-teaming

$150 per hour
Temporary

HUMXN

Pay: $150–$250/hr

The work

Design evaluation tasks that distinguish genuine capability from pattern matching; write adversarial and edge-case prompts in your specialism; review model-generated research code, experiments and claimed results; grade reasoning on systems, theory and algorithms problems.

Who it suits

  • PhD in computer science, statistics or a related field with publications in machine learning, NLP, systems or theory.
  • Strong engineering skills; experience training or evaluating large models a plus.

How it works

  • Apply with your CV and the hours you can give. 5 to 20 hours a week suits most people; the work is remote and on your own schedule.
  • We verify your credentials, licence or degree and your identity before any paid work. Every piece of work traces to a named, verified expert.
  • A paid calibration task on the project's own guidelines comes first.
  • You are paid at the rate on this page for every hour of work that passes review. Rates rise with the difficulty of the project and your track record.

HUMXN is a new expert network (launched 2026). Payouts go through Stripe after identity and tax verification. Never pay to apply.

Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Machine learning researcher (PhD): evaluation design and red-teaming in Remote vacancy
  •  ...Required Qualifications A master’s degree or PhD in Computer Science, Machine Learning, Artificial Intelligence, Applied Mathematics, Statistics, Engineering...  ...quantitative discipline. Strong professional or research experience in machine learning. Practical proficiency... 
    For phd
    Part time
    Immediate start

    micro1

    Remote
    7 days ago
  •  ...AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring machine learning researchers as contractors to author and solve the analysis problems those evaluations run on, drawn from your own research: experiment... 
    Suggested
    Contract work
    For contractors
    Remote work

    AfterQuery

    Remote
    24 days ago
  • $30 - $60 per hour

     ...$30 - $60/hour Required Skills Research & source triangulation Attention to...  ...and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities...  ...Title: Research Evaluation Specialist (PhD or Masters / Researcher) Role Type:... 
    For phd
    For contractors
    Remote work
    Worldwide

    micro1

    Remote
    2 days ago
  •  ...information, visit redditinc. com . At Reddit, machine learning sits at the heart of how millions of...  ...to build systems end-to-end, from research and modeling to production deployment, —...  ...Machine Learning Engineer at Reddit, you will design and build production ML systems that... 
    Suggested
    Long term contract
    Full time

    Reddit

    Remote
    15 days ago
  • $184.05k - $262.93k per year

     ...The Personalization team makes deciding what to play next easier and more enjoyable...  ...that powers it. By combining cutting-edge machine learning, recommendation systems, and product thinking...  ...someone who enjoys taking models from research to production, collaborating across... 
    Suggested
    Full time
    Internship
    Flexible hours

    Spotify

    Remote
    6 days ago
  • $125 per hour

     ...proofs. Areas in demand: algebra, analysis, topology, combinatorics, number theory, probability, PDE and optimisation. Who it suits PhD in mathematics or a closely related field; postdoctoral or faculty experience a plus. Competition or olympiad background welcome but... 
    For phd
    Contract work
    Remote work

    HUMXN

    Remote
    25 days ago
  •  ...your location, you’re part of a vibrant team with diverse experiences making a global...  ...Twilio Join the team as Twilio’s next Staff Machine Learning Engineer on Twilio’s AI/ML Platform team....  ...across Twilio. You will influence the design and evolution of our company-wide ML/AI Ops... 
    Full time
    Remote work
    Worldwide

    Twilio

    Remote
    5 days ago
  • $30 - $90 per hour

     ...improve model performance Collaborate with the team in English for project coordination Requirements Master's or PhD in a STEM field (Science, Technology,...  ...detail Nice to Have Experience with AI/ML evaluation or data annotation Background in AI, NLP, or... 
    For phd
    Contract work
    Remote work
    10 hours per week
    Flexible hours

    Braintrust

    Remote
    28 days ago
  • $180k - $210k per year

     ...We’re looking for a Full Stack Data Scientist / Machine Learning Engineer to join our Knowledge Layer team, a group focused on extracting, structuring, and analyzing...  ...and APIs. The impact you will have: Design, build, and productionize machine learning models focused... 
    Worldwide

    TRM Labs

    Remote
    1 day ago
  • $125 per hour

     ...% Within 3 months ~80% Why this role $125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the overhead of running a consulting practice around... 
    Hourly pay
    Contract work
    Remote work

    Ethos

    Remote
    21 days ago
  •  ...from anywhere in the US or Canada. About the Team Reddit's Ads ML Efficiency team is focused on making machine learning workloads faster, more scalable, and more cost-...  ...rigorous benchmarking and measurement. Design and implement performance improvements involving... 
    Remplacement
    Full time
    For contractors
    Internship
    Work at office
    Remote work
    Flexible hours

    Reddit

    Remote
    9 days ago
  • $164.49k - $197.39k per year

     ...are a 100% remote company with 1,600+ team members across 40+ countries, and we’...  ..., CapitalG, and Lead Edge Capital. Learn more at and follow us on and ....  ..., and operate recommendation models, design experiments, establish evaluation methodology, and define the scientific... 
    Long term contract
    Remplacement
    Full time
    Local area
    Remote work
    Flexible hours

    Grafana Labs

    Remote
    7 days ago
  • $80 per hour

     ...Software Engineering Machine Learning Engineer Expert Ethos • Remote Education...  ...engineer, data engineer Direct experience evaluating model outputs or system readiness and...  ...decks across core workflows: technical design documents and architecture decision records... 
    Hourly pay
    Contract work
    Manual labor
    Immediate start
    Remote work
    Flexible hours

    Ethos

    Remote
    21 days ago
  •  ...people, and we’re building the team to help push our shopping cart...  ...through regular in-person events. Learn more about our flexible...  ...grocery industry. Our teams apply machine learning, optimization, and software...  ...Machine Learning Engineer to design, build, and deploy production machine... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Instacart

    Remote
    1 day ago
  • $137.85k - $157.06k per year

     ...providing a unique platform to learn and connect with others. – Poe...  ..., and high-performing global teams. We have a culture rooted in transparency...  ...challenges at scale. As a Machine Learning Engineer (New Grad),...  ...experienced engineers to design, evaluate, and deploy these systems... 
    Full time
    Internship
    Remote work
    Monday to friday
    Flexible hours

    Quora

    Remote
    9 days ago
  • $40 - $150 per hour

     ...surprisingly bad at reasoning about themselves: training dynamics, evaluation design, data pipelines, and deployment trade-offs. Plausible-sounding ML advice is often subtly wrong. As a Machine Learning Engineer you'll stress-test how models reason about ML systems and write... 
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Remote
    23 days ago
  • $50 - $150 per hour

     ...Canada + 6 more We're hiring PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial...  ...clearly Nice to Have Research experience (academic or industry...  ...with data annotation or AI model evaluation Experience reviewing or publishing... 
    For phd
    Contract work
    Temporary work
    Internship
    Remote work
    Flexible hours

    Braintrust

    Remote
    28 days ago
  •  ...About the Role We are looking for machine learning engineers to help train and evaluate AI models on machine learning and LLM engineering tasks. You will design tasks, review AI-generated ML code and methodology, and write the reference answers that models are measured against... 
    Hourly pay
    For contractors
    Remote work

    RemoExperts

    Remote
    28 days ago
  •  ...Own end-to-end development of machine learning solutions for business needs. About Turing:...  ...California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted...  ...for a ML Developer to drive the design, development, and delivery of advanced machine... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    28 days ago
  • $180 per hour

     ...Bring senior ai/ml expertise to AI evaluation projects focused on model evaluation, data leakage, training assumptions, and ML...  ...Requirements ~7+ years of substantive experience in applied machine learning or ML research. ~ Demonstrated senior-level judgment in model... 
    Hourly pay
    Contract work
    Remote work

    Alpheva

    Remote
    a month ago
  •  ...Research and build benchmark tasks to expose AI model weaknesses. About Turing: Based...  ...seeking an analytical researcher and red-teaming specialist to build evidence-based web-research...  .... Your work will directly shape AI evaluation frameworks, ensuring next-generation... 
    Part time
    For contractors
    Local area

    Turing

    Remote
    15 days ago
  •  ...This is a remote, project-based role for machine learning professionals with deep expertise in bioinformatics. You will complete tasks at the...  ...analysis — including model development, pipeline construction, and research tasks applied to real genomic, transcriptomic, or multi-omics... 
    Contract work
    Remote work
    10 hours per week

    AfterQuery

    Remote
    28 days ago
  •  ...with their unique experiences. Join our team! We're building a world where Identity belongs...  ...and authorization platform designed by developers for developers. We make access...  ...so customers can focus on innovation. Machine Learning Engineer The Machine Learning team is... 
    Remote work
    Flexible hours

    Okta

    Remote
    5 days ago
  • $133k - $183k per year

     ...no surprises, and no tradeoffs on what matters most. As a Machine Learning Engineer on our team, you will be at the forefront of developing high-quality,...  ...model training, decisioning, and monitoring systems - Research ground breaking solutions and develop prototypes that drive... 
    For phd
    Full time
    Work at office
    Remote work

    Affirm

    Remote
    15 days ago
  • $45 - $90 per hour

     ...models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...  ...production of high-quality training data. Our research spans high-value, specialized domains...  ...& Translational Research Scientist (PhD) Job Type: Contractor Location:... 
    For phd
    Part time
    For contractors
    Remote work
    Worldwide

    micro1

    Remote
    16 days ago
  •  ...seeking experienced Clinical Research and Survey Methodology Experts...  ...healthcare market research, survey design, and questionnaire development...  ...flow, and data quality. Evaluate surveys for clinical...  ...Collaborate with research teams to incorporate feedback and maintain... 
    For phd
    Hourly pay
    Contract work

    Mercor

    Remote
    12 days ago
  • $50 - $150 per hour

     ...Location: United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract...  ...Crafting and answering questions related to Machine Learning and AI Evaluating and ranking domain-specific responses... 
    For phd
    Contract work
    Temporary work
    Internship
    Remote work
    Flexible hours

    Braintrust

    Remote
    28 days ago
  •  ...About the Role: TELUS Digital is building a high-impact team of Machine Learning Experts working alongside Policy Enforcement specialists to...  ...for content moderation and policy enforcement. You will evaluate complex, nuanced content, provide feedback on AI reasoning processes... 
    Part time

    TELUS International

    Remote
    29 days ago
  •  ...This is a remote, project-based role for data scientists and machine learning professionals with 1–3 years of work experience. You will complete...  ...performed in data science, machine learning engineering, AI research, or analytics roles. Work is over the next 2-3 weeks,... 
    Contract work
    Remote work
    10 hours per week

    AfterQuery

    Remote
    28 days ago
  •  ...assembling a panel of nuclear domain experts to red-team frontier AI models. The goal is to test...  ...: benign, dual-use, and adversarial. Evaluate the responses that come back against a...  ...a model past the boundary; the plausible research framing, the question that looks academic... 
    Contract work

    Mercor

    Remote
    28 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine learning researcher (PhD): evaluation design and red-teaming. Be the first to apply!