Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Bilingual Evaluator - LLM Specialist

$15 - $20 per hour

Mercor

Toronto, ON
  • Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Generalist - English & Assamese

Type: Contract

Compensation: $15–$20/hour

Location: Remote

Role Responsibilities

  • Conduct fact-checking using trusted public sources and external tools .
  • Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • Bachelor's degree
  • Native speaker in Assamese
  • Significant experience using large language models (LLMs)
  • Excellent writing skills in English
  • Strong attention to detail
  • Background or experience in domains requiring structured analytical thinking

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Bilingual Evaluator - LLM Specialist in Toronto, ON vacancy
  • Job Responsibility: Job title: HR Administrator Status: Full time, 35 hours per week Start Date: As soon as possible Reports to: Finance Manager Posting Date: April 25 Reference Number: CLNU-2025-06 Deadline to apply: Open till filled CultureLink Settlement...
    Suggested
    Full time
    Immediate start
    Monday to friday
    Shift work

    CultureLink Settlement and Community Services

    Toronto, ON
    5 days ago
  • $50 per hour

     ...Summers , and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation:...  ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define... 
    Bilingual
    Remote job
    Contract work
    Summer work
    10 hours per week

    Mercor

    Toronto, ON
    28 days ago
  • $50k - $55k per year

     ..., but are part of who we are. If such a workplace intrigues you, we hope you’ll join us. About the role: The Bilingual Merchant Onboarding Specialist supports driving Financeit’s growth, ensuring new merchants are successfully onboarded and actively using our platform... 
    Bilingual
    Full time
    Internship
    Work at office
    Flexible hours

    Financeit

    Toronto, ON
    1 day ago
  • $85k - $90k per year

     ...committed to its people, find out more about what Aviso has to offer at . The Opportunity: We’re looking for a Bilingual Learning & Development Specialist to join our Aviso’s learning and development team for 14 months. Reporting to the Leader of L&D, the Bilingual... 
    Bilingual
    Temporary work
    Internship
    Work at office

    Aviso Wealth

    Toronto, ON
    18 hours ago
  •  ...Job Responsibility: Under the supervision of the Program Manager the Bilingual Reimbursement Specialist will provide drug coverage support to physicians and patients, follow up on submissions pertaining to obtaining coverage through private and provincial drug plans, ensure... 
    Bilingual
    Full time
    Immediate start
    Remote work

    Bayshore HealthCare

    Toronto, ON
    19 hours ago
  • Job Responsibility: We're thrilled that you are interested in joining us here at the Amynta Group! Position Summary Reporting to the Manager, Customer Experience , this position provides support to Dealer clients and the National Sales Team. Position Functions Provide best...
    Bilingual
    Full time

    Amynta Group

    Toronto, ON
    5 days ago
  • $27 per hour

    Our client, a top insurance client in Canada is looking to hire Bilingual Plan Design Specialist for their team with a contract for 6 Months with potential extension or conversion to Permanent based on performance. Hybrid - 3 days in Toronto Office. Job Responsibilities:... 
    Bilingual
    Permanent employment
    Contract work
    Work at office
    Toronto, ON
    10 days ago
  • $51.38k - $79.26k per year

     ...HealthPractitioner Network is vibrant and robust. As a Practitioner Network Specialist you will support the team achieve our mission by: Recruiting...  ...practitioners within our network. WHO WERE LOOKING FOR Bilingual (English and French) Completion ofCollege diploma or... 
    Bilingual
    Full time
    Temporary work
    Internship
    Work at office

    GreenShield

    Toronto, ON
    19 hours ago
  • $80 - $120 per hour

     ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  •  ...offerings and value propositions Overcome objections and close enrollments Consistently meet or exceed individual sales targets Bilingual Customer Support Communicate fluently in both English and Spanish Ensure all families feel supported, informed, and... 
    Bilingual
    Full time

    Community Sports Partners

    Toronto, ON
    8 days ago
  • $50k - $60k per year

     ...talked about, but are part of who we are. If such a workplace intrigues you, we hope you’ll join us. About the role: The Bilingual Sales Specialist (commission only) plays a pivotal role in fostering fresh business connections within our established network of merchants.... 
    Bilingual
    Ongoing contract
    Contract work
    Work at office
    Remote work
    Work from home

    Financeit

    Toronto, ON
    8 days ago
  • $52k - $93.5k per year

     ...Responsibilities About the role: The Remarketing Solutions Specialist – Dealer Services is responsible for professionally representing...  ...Environment preferred ~ Previous supervisory experience preferred ~ Bilingual in French and English is required. What We Offer Hybrid... 
    Bilingual
    Full time
    Casual work
    Flexible hours

    GM Financial

    Toronto, ON
    20 days ago
  • $68k per year

     ...Customer Service Manager with daily operations. The Customer Service Specialist will act as a customer advocate while building strong...  ...experience in a strong technical environment French/English bilingualism is required Must demonstrate the ability to manage complex... 
    Bilingual
    Contract work

    Bausch + Lomb

    Toronto, ON
    29 days ago
  •  ...Comprendre et appliquer les politiques, procédures et lignes directrices en vigueur.   Purpose of Job   The Customer Payments Specialist is responsible for the identification and collection of delinquent payments in a portfolio of residential and commercial mortgages.... 
    Bilingual
    Full time

    eqbank

    Toronto, ON
    a month ago
  • $90k per year

     ...Description Bilingual Pursuits Specialist (English/French) Full-Time, Permanent Location: Toronto – Hybrid (2 days in office) Hours: Monday – Friday 9:00 am – 5:00 pm (potential overtime when needed) Salary: up to $90,000 + discretionary bonus Benefits & Perks... 
    Bilingual
    Long term contract
    Permanent employment
    Full time
    Work at office
    Monday to friday

    Beyond Bilingual Inc.

    Toronto, ON
    a month ago
  •  ...Le spécialiste en prêts hypothécaires inversés est responsable d’évaluer les nouvelles demandes de financement, d’émettre les offres de...  ...offert et la rentabilité. The work ! The Reverse Mortgage Specialist is responsible for assessing new mortgage applications, issuing... 
    Bilingual
    Full time
    Internship

    eqbank

    Toronto, ON
    a month ago
  • $23 per hour

    Seeking Bilingual Claims Support Specialists to support a high-profile claim processing initiative, reporting directly to the Senior Manager of Advisory. Independent contractors in this role will work both autonomously and collaboratively within a fast-paced, structured team... 
    Bilingual
    Hourly pay
    Long term contract
    Full time
    Contract work
    Temporary work
    For contractors
    Work at office
    Remote work
    Monday to friday
    Shift work

    Randstad

    Toronto, ON
    a month ago
  • $19.5 - $25.17 per hour

    A results-driven and customer-focused Loyalty Renewal Specialist with expertise in mortgage renewals and retention strategies. Skilled in...  ...ensuring compliance and achieving retention targets. Job title: Bilingual mortgage retention Specialist Duration: 12-month contract... 
    Bilingual
    Contract work
    Remote work

    Randstad

    Toronto, ON
    more than 2 months ago
  • $60k per year

     ...opportunité : Coordinateur.trice bilingue, Programmes en...  ...coordination, la mise en œuvre et l'évaluation de la prestation des programmes...  ...and working with three Program Specialists, this role requires frequent...  ...of relevant measurement and evaluation metrics Document findings... 
    Bilingual
    Permanent employment
    Full time
    Work at office
    Flexible hours

    Futurpreneur

    Toronto, ON
    1 day ago
  •  ...work directly with Canadian customers and internal teams while developing strong technical and client-facing expertise. If you are bilingual, technically sharp, and customer-focused — this is a strong long-term opportunity. * Handle inbound calls and emails in **both... 
    Bilingual
    Long term contract

    L’EVATE Inc

    Toronto, ON
    a month ago
  • $30 - $33 per hour

    About the Opportunity Support sales enablement through the execution of work orders and processing of completed sales transactions. Ensure sales managed account work orders are processed in a timely manner with attention to detail. Including but not limited to: Subscription...
    Hourly pay
    For contractors
    Work at office
    Local area

    Vaco by Highspring

    Toronto, ON
    14 hours ago
  • $122k - $192k per year

     ...Resource Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on energy efficiency program... 
    Full time
    Internship
    Work at office
    Local area

    Resource Innovations

    Toronto, ON
    8 days ago
  • $122k - $159k per year

     ...is a remote position open to candidates located anywhere in Canada. Position Overview Munich Re Canada is seeking a senior, bilingual, client-focused underwriting consultant who will bring strong technical judgment, curiosity and a passion for underwriting to our team... 
    Bilingual
    Long term contract
    Contract work
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work
    Toronto, ON
    a month ago
  • $55k - $65k per year

     ...occasion: Nous sommes à la recherche d’un(e) agent(e) de comptes bilingue pour notre équipe Services de correspondance et Services...  ...des renseignements personnels que vous avez fournis dans le but d’évaluer vos qualifications et votre aptitude à occuper un emploi à Aviso... 
    Bilingual
    Daily paid
    Full time
    Apprenticeship
    Summer work
    Work at office

    Aviso Wealth

    Toronto, ON
    1 day ago
  • $80k - $180k per year

     ...re building the platforms that help regulated organizations adopt AI responsibly and at scale. What’s the Opportunity?  The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable, safe, and production-ready within regulated banking environments. The role... 
    Full time

    Zafin

    Toronto, ON
    5 days ago
  • $80k - $90k per year

     ...Perkopolis and participate in our rewards and recognition programs to celebrate your contributions. The Job: Employee Communications Specialist We’re seeking an Employee Communications Specialist to execute internal communication strategies that keep employees informed,... 
    Bilingual
    Contract work
    Temporary work
    Work at office
    Remote work

    Momentum Financial Services Group

    Toronto, ON
    a month ago
  • $60k per year

     ...cette offre d’emploi : Coordonnateur.trice bilingue des communications et du contenu En...  ...artificielle pour aider à l’évaluation initiale des candidatures, mais toutes les...  ...Work closely with the Social Media Content Specialist to develop/maintain a content calendar and... 
    Bilingual
    Full time
    Contract work
    Temporary work
    Second job
    Work at office
    Flexible hours
    2 days per week

    Futurpreneur

    Toronto, ON
    1 day ago
  • $55k - $60k per year

     ...Influential Companies. Most recently, we won Apple’s coveted Cultural Impact Winner. We are now looking for an exceptional Bilingual Partner Growth Specialist (English/French) to join our team in Toronto, Canada (Hybrid). Your mission The Partner Growth Specialist acts as... 
    Bilingual
    Long term contract
    Temporary work
    Work at office
    Flexible hours

    Too Good To Go

    Toronto, ON
    a month ago
  • $68k - $78k per year

     ...recherche d’un représentant ou d’une représentante en investissements bilingue qui se joindra à notre équipe du Centre de services. Relevant...  ...des actions, le crédit et la négociation, et être en mesure d’évaluer les situations individuelles et d’obtenir les autorisations... 
    Bilingual
    Daily paid
    Full time
    Apprenticeship
    Work at office

    Aviso Wealth

    Toronto, ON
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Bilingual Evaluator - LLM Specialist. Be the first to apply!