Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Program Management Evaluator Expert

$80 - $120 per hour
Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Program management / implementation planning Evaluator

Type: Contract

Compensation: $80$120/hour

Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual aesthetic and presentation errors in AI-generated work products .
  • Provide clear structured written feedback to improve AI model outputs .
  • Collaborate with subject matter experts to ensure consistency and quality.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5 years of relevant professional experience in Program management / implementation planning .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace especially Slides .

Preferred

  • Advanced degree (Masters or higher) from a reputable institution.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Program Management Evaluator Expert in Toronto, ON vacancy
  • $80 - $120 per hour

     ...Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–...  ...and asynchronously to ensure high-quality evaluations. Qualifications Must-Have ~5+ years... 
    Suggested
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    12 days ago
  • $100 - $150 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation: $100–$150/...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a consulting context... 
    Suggested
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    5 days ago
  • $100 - $150 per hour

     ...DAngelo Larry Summers and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation: $100$150/...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a consulting context... 
    Suggested
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    4 days ago
  • $80 - $120 per hour

     ..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Suggested
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $100 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    6 days ago
  • $80 - $120 per hour

     ...Summers and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80$120...  ...Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet deadlines and improve... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$...  ...Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet deadlines and improve... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $50 per hour

     ...Position: English Language and Literature Expert Type: Contract...  ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...  ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    3 hours ago
  • $60 - $80 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:... 
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work
    Flexible hours

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...Dorsey . Position: Sales Engineering Expert Type: Contract...  ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $120 - $170 per hour

     ...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...  ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $120 - $170 per hour

     ...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...  ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $70 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    5 days ago
  • $50 - $70 per hour

     ...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$...  ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    23 days ago
  • $80 - $120 per hour

     ...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    28 days ago
  • $60 - $100 per hour

     ...Jack Dorsey . Position: Marketing Expert — Creator & Influencer (AI Agent Environments...  ...task briefs based on real-world creator programs, focusing on planted issues and decisions...  ...ones. Review AI agent attempts and evaluate them against established standards.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    19 days ago
  • $100 - $150 per hour

     ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation...  ...to meet deadlines while improving evaluation processes. Qualifications Must-...  ...in outbound prospecting, discovery, deal management, and structured sales methodologies.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $80k - $105k per year

     ...an eager and enthusiastic experienced Program Manager to join our successful Toronto team! We...  ...established standards or specifications.  Evaluate program effectiveness by collecting and...  ...and Opportunities: Assist in the evaluation, implementation and the continued... 
    Full time
    Immediate start

    Active Dynamics

    Toronto, ON
    8 days ago
  • $80 - $120 per hour

     ...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $153k - $197k per year

     ...Lead the future of insider risk management by delivering strategic controls that protect our...  ...delivery of a complex Insider Risk Controls Program for a leading financial services client....  .... Partner with industry-leading experts shaping the future of Banking & Payments.... 
    Internship
    Immediate start

    Capco

    Toronto, ON
    12 days ago
  • $84.7k - $134.7k per year

     ...Specialism Conduct and Compliance Management Level Manager Job Description & Summary...  ...in transformation advisory services program and project delivery and risk management...  ...of AI helps ensure we combat bias by evaluating candidates equally and fairly without seeing... 
    Full time
    Contract work
    Visa sponsorship
    Work visa

    PricewaterhouseCoopers

    Toronto, ON
    12 days ago
  • $118k - $172k per year

     ...integrity.  Skills and Competencies ~5+ years of experience in program or project management, PMO operations, or business operations within a technology...  ...software platforms and digital tools, with the ability to evaluate, adopt, and optimize technology to support program delivery... 
    Full time
    For subcontractor
    Internship

    Moody's

    Toronto, ON
    1 day ago
  • $14 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/...  ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    a month ago
  • $122k - $192k per year

     ...Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a...  ...business unit, working on energy efficiency program planning, delivery and evaluation, with...  ...of energy efficiency programs. ~ Expert level understanding of building systems,... 
    Full time
    Work at office
    Local area

    Resource Innovations

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour...  ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $150 per hour

     ..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour...  ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Program Management Evaluator Expert. Be the first to apply!