Bilingual Evaluator - LLM Specialist
$15 - $20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist - English & Assamese
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Role Responsibilities
- Conduct fact-checking using trusted public sources and external tools .
- Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
- Assess reasoning quality, clarity, tone, and completeness of responses.
- Ensure model responses align with expected conversational behavior and system guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree
- Native speaker in Assamese
- Significant experience using large language models (LLMs)
- Excellent writing skills in English
- Strong attention to detail
- Background or experience in domains requiring structured analytical thinking
Preferred
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience writing or editing high-quality written content
- Experience comparing multiple outputs and making fine-grained qualitative judgments
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Bilingual Evaluator - LLM Specialist in Toronto, ON vacancy
$50 per hour
...Summers , and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation:... ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define...BilingualRemote jobContract workSummer work10 hours per week$60k - $75k per year
...Summary At Colas Canada, we believe talent acquisition is a key driver of business performance. We are looking for a Bilingual Talent Acquisition Specialist to elevate recruitment practices across Canada by strengthening standards, optimizing tools, and supporting our...BilingualRemplacementPermanent employmentContract workWorldwide$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$70k per year
...opportunité : Spécialiste de programme bilingue En tant que spécialiste... ...mesures et des métriques d'évaluation Offrir des programmes de... ...As a Bilingual Program Specialist, you will be at the forefront... ...identification of measurement and evaluation metrics Conduct market...BilingualPermanent employmentFull timeWork at officeFlexible hours$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$53.5k - $80k per year
...use, compostable tableware and foodservice product made from plant fibers, including sugarcane. OVERVIEW The Bilingual Customer Service Specialist is a Supply Chain professional who supports team initiatives through upholding the organization Vision & Strategy...BilingualWork at officeImmediate start$80k - $90k per year
...Opportunity We’re looking to fill an open role for a Bilingual Learning Development Specialist to join our Business Management team for 14 months.... ...videos, practical exercises, quick reference guides and evaluation materials Liaise with subject matter experts, as required...BilingualFull timeInternship- ...Comprendre et appliquer les politiques, procédures et lignes directrices en vigueur. Purpose of Job The Customer Payments Specialist is responsible for the identification and collection of delinquent payments in a portfolio of residential and commercial mortgages....BilingualFull time
$68k per year
...Customer Service Manager with daily operations. The Customer Service Specialist will act as a customer advocate while building strong... ...experience in a strong technical environment French/English bilingualism is required Must demonstrate the ability to manage complex...BilingualContract work$90k per year
...Description Bilingual Pursuits Specialist (English/French) Full-Time, Permanent Location: Toronto – Hybrid (2 days in office) Hours: Monday – Friday 9:00 am – 5:00 pm (potential overtime when needed) Salary: up to $90,000 + discretionary bonus Benefits & Perks...BilingualLong term contractPermanent employmentFull timeWork at officeMonday to fridayusd66.5k - usd96.5k per year
...provided during the accommodation process will be treated as confidential, and will be shared only to the extent required to properly evaluate accommodation requests. Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody’s Policy...BilingualFull timeInternship$75k - $95k per year
...mentoring and the exchange of ideas. Osler is a dynamic and exciting place to begin a career or carve out a new path. The Pursuits Specialist is a member of the Client Development group, and reports to the Manager, Pursuits. As a Pursuits Specialist, you will be responsible...BilingualFull timeWork at officeRemote work2 days per week- ...Le spécialiste en prêts hypothécaires inversés est responsable d’évaluer les nouvelles demandes de financement, d’émettre les offres de... ...offert et la rentabilité. The work ! The Reverse Mortgage Specialist is responsible for assessing new mortgage applications, issuing...BilingualFull timeInternship
$50k - $60k per year
...talked about, but are part of who we are. If such a workplace intrigues you, we hope you’ll join us. About the role: The Bilingual Sales Specialist (commission only) plays a pivotal role in fostering fresh business connections within our established network of merchants....BilingualOngoing contractWork at officeRemote workWork from home- ...work directly with Canadian customers and internal teams while developing strong technical and client-facing expertise. If you are bilingual, technically sharp, and customer-focused — this is a strong long-term opportunity. * Handle inbound calls and emails in **both...BilingualLong term contract
$122k - $159k per year
...is a remote position open to candidates located anywhere in Canada. Position Overview Munich Re Canada is seeking a senior, bilingual, client-focused underwriting consultant who will bring strong technical judgment, curiosity and a passion for underwriting to our team...BilingualLong term contractContract workWork at officeImmediate startRemote workFlexible hoursShift work$55k - $60k per year
...Influential Companies. Most recently, we won Apple’s coveted Cultural Impact Winner. We are now looking for an exceptional Bilingual Partner Growth Specialist (English/French) to join our team in Toronto, Canada (Hybrid). Your mission The Partner Growth Specialist acts as...BilingualLong term contractTemporary workWork at officeFlexible hours$19.5 - $25.17 per hour
A results-driven and customer-focused Loyalty Renewal Specialist with expertise in mortgage renewals and retention strategies. Skilled in... ...ensuring compliance and achieving retention targets. Job title: Bilingual mortgage retention Specialist Duration: 12-month contract...BilingualContract workRemote work$23 per hour
Bilingual Claims Support Specialist (Contract) Language: Fluent French & English (Required) Pay Rate: $23.00 / hour Term: 3-Month Full-Time Assignment Location: Supporting Toronto, ON Office Join a high-profile, mission-driven claims initiative reporting directly...BilingualHourly payFull timeContract workWork at officeRemote work$80k - $90k per year
...Perkopolis and participate in our rewards and recognition programs to celebrate your contributions. The Job: Employee Communications Specialist We’re seeking an Employee Communications Specialist to execute internal communication strategies that keep employees informed,...BilingualContract workTemporary workWork at officeRemote work- ...want to impact the world in a positive way. To learn more visit: We are looking for a hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive and holistic analysis on all aspects of performance of the autonomy...Full time
- ...recognized brands to develop and manufacture innovative products enjoyed by consumers every day. They are seeking a Bilingual Talent Acquisition Specialist (French/English) to support high-volume recruiting efforts across multiple manufacturing facilities in Canada. This...BilingualHourly payContract work
- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
- ...Job Responsibility: We're looking for a bilingual (French/English) Marketing Implementation & Business Development Specialist to join our North America Marketing Hub, with a focus on supporting EF Language Abroad's growth in the Canadian marketespecially within Québec....BilingualFull time
$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$85 per hour
...Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms , Kubernetes ,...Remote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s...Full timeInternship
$45k - $95k per year
...recently, Marketing Measurement & Optimization. In addition, VML’s specialist health network, VML Health, is one of the world’s largest and... ..., Community We are seeking a sharp and culturally-tuned bilingual Community Manager to own the voice of a leading luxury automotive...BilingualWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Bilingual Evaluator - LLM Specialist. Be the first to apply!
Related searches
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- access control specialist Toronto, ON
- international trade specialist Toronto, ON