Bilingual Evaluator - LLM Specialist
$15 - $20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist - English & Assamese
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Role Responsibilities
- Conduct fact-checking using trusted public sources and external tools .
- Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
- Assess reasoning quality, clarity, tone, and completeness of responses.
- Ensure model responses align with expected conversational behavior and system guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree
- Native speaker in Assamese
- Significant experience using large language models (LLMs)
- Excellent writing skills in English
- Strong attention to detail
- Background or experience in domains requiring structured analytical thinking
Preferred
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience writing or editing high-quality written content
- Experience comparing multiple outputs and making fine-grained qualitative judgments
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Bilingual Evaluator - LLM Specialist in Toronto, ON vacancy
$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of two candidate...SuggestedRemote jobContract workSummer workWork at officeImmediate start$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...SuggestedRemote jobContract workSummer work$60k - $75k per year
...Summary At Colas Canada, we believe talent acquisition is a key driver of business performance. We are looking for a Bilingual Talent Acquisition Specialist to elevate recruitment practices across Canada by strengthening standards, optimizing tools, and supporting our...BilingualRemplacementPermanent employmentContract workWorldwide$25 - $37 per hour
..., Larry Summers , and Jack Dorsey . Position: Bilingual French Generalist Evaluator Expert Type: Contract Compensation: $... ...editing, or academic writing. Experience creating evaluation criteria, rubrics, or grading guidelines. Familiarity...BilingualRemote jobContract workSummer work- ...un spécialiste en marketing bilingue (français canadien/anglais) pour... ...'intelligence artificielle n'évalue pas les candidats et ne prend... ...for a bilingual Marketing Specialist (French Canadian/English) to... ...information consistently. AI does not evaluate candidates or make hiring...BilingualLong term contractTemporary workLocal area1 day per week
$23 - $25 per hour
...City Specialist (Field-Based) – Contract Location: Greater Toronto Area Schedule:... ...notamment la recherche, la présélection et l’évaluation des candidatures. L’IA aide à analyser... ...process, including sourcing, screening, and evaluating candidates. AI helps assess applications...BilingualFull timeContract workWork at officeLocal areaMonday to friday$20.35 per hour
...thinking organization, apply now. We are currently seeking a Bilingual Outbound Sales Representative to join our team in Alberta,... ...Position Overview: As a Bilingual Technical Sales Specialist, you will support our client’s suite of products and services where...BilingualContract workApprenticeshipSummer workLocal areaRemote workWork from homeFlexible hoursWeekend workAfternoon shift$19.5 - $25.17 per hour
A results-driven and customer-focused Loyalty Renewal Specialist with expertise in mortgage renewals and retention strategies. Skilled in... ...ensuring compliance and achieving retention targets. Job title: Bilingual mortgage retention Specialist Duration: 12-month contract...BilingualContract workRemote work$50k per year
...Bilingual Client Experience Specialist, Insurance Desjardins Agent Team Member Location: Markham, Ontario Type: Full Time About the Opportunity We are a growing Desjardins Insurance Agency in Markham looking for motivated, customer focused individuals to...BilingualFull timeFor contractorsWork at officeTrial period$66.5k - $96.5k per year
...provided during the accommodation process will be treated as confidential, and will be shared only to the extent required to properly evaluate accommodation requests. Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody’s Policy...BilingualFull timeInternship$65k - $75k per year
Currently, Teltonika Canada is looking for an ambitious Sales Representative to join our office in Toronto, Canada . In this position, you will belong to Telematics Sales team . Teltonika’s telematics business unit develops and produces easy-to-use GPS tracking devices...BilingualLong term contractFull timeInternshipWork at officeLocal areaWorldwide- ...Job Title: GenAI / LLM Architect Position Overview: The GenAI Architect will lead the design and implementation of enterprise Generative... ...Develop conversational AI and virtual assistant solutions. Evaluate emerging AI technologies and frameworks. Required Skills:...
- ...Description Bilingual Estates Specialist Full-time Permanent Location: Toronto, ON Environment: Hybrid - Currently 1 day/week in the office, soon to be 2 days/week, typically Mon & Tues. Hours: Monday to Friday | Flexible start between 7:00 AM – 9:00 AM | Shifts...BilingualPermanent employmentFull timeWork at officeImmediate startMonday to fridayFlexible hoursShift work2 days per week1 day per week
$70k per year
...accountable & transparent. Here’s the opportunity: Reporting to the Communications and Content Manager, the Bilingual Social Media Content Specialist is a content creator and social media pro who knows how to build and engage an audience across Futurpreneur’s social...BilingualPermanent employmentFull timeWork at officeFlexible hours2 days per week- ...Program; and Corporate Discount Card. Overview Reporting to the Senior Manager of Call Centre Operations , the Bilingual Quality Assurance Specialist (Call Centre) is responsible for ensuring that the highest standard of customer service is provided to both current...BilingualFull timeSummer holidayFlexible hours
$23 per hour
Seeking Bilingual Claims Support Specialists to support a high-profile claim processing initiative, reporting directly to the Senior Manager of Advisory. Independent contractors in this role will work both autonomously and collaboratively within a fast-paced, structured team...BilingualHourly payFull timeContract workFor contractorsWork at officeRemote work$25 per hour
...Bilingual Mortgage Renewal & Retention Specialist — Remote Looking for an opportunity to make a direct impact on the customer experience? In this fully remote position within the insurance sector, you will support mortgage renewal discussions, provide personalized solutions...BilingualHourly payPermanent employmentFull timeContract workRemote workFlexible hours$27 per hour
Our client, a top insurance client in Canada is looking to hire Bilingual Plan Design Specialist for their team with a contract for 6 Months with potential extension or conversion to Permanent based on performance. Hybrid - 3 days in Toronto Office. Job Responsibilities:...BilingualPermanent employmentContract workWork at office$23 per hour
Seeking Bilingual Claims Support Specialists to support a high-profile claim processing initiative, reporting directly to the Senior Manager of Advisory. Independent contractors in this role will work both autonomously and collaboratively within a fast-paced, structured team...BilingualHourly payFull timeContract workFor contractorsWork at officeRemote work- Our downtown based client is looking to hire a BILINGUAL (FRENCH/ENGLISH) Quality Specialist for a 6 month engagement Are you a detail-driven problem solver... ..., document, and track defects through to resolution Evaluate risk and support the change management process...BilingualRemote workFlexible hours
- ...alongside iconic brand names. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- Job Title : GenAI / LLM Architect (Energy) Industry Energy & Utilities Position Overview The GenAI Architect will lead the design and implementation of Generative AI solutions that improve operational efficiency, knowledge management, field service operations, asset...
- ...Python Developer - Gen AI, LLM Toronto, ON - Hybrid (4 Days WFO) Role Descriptions: 5+ years building production applications (Python and Node.js/ TypeScript) 2+ years with cloud platforms (AWS| Azure| or OpenShift) Strong experience with CI/CD pipelines and Git...Contract work
$100 per hour
...hour Location: Remote Role Responsibilities Evaluate AI-generated responses to enhance reasoning and rigor in... ...Strict attention to detail and accurate application of structured evaluation guidelines. Ability to work entirely without AI writing...Remote jobContract workSummer work- ...AI/ML Engineer (GenAI, LLM, Java) Location: Toronto, ON Experience Required: 5+ Role Overview We are seeking a highly skilled Senior AI Developer to join the technology team and drive the acceleration of AI-driven solutions. The ideal candidate should have expertise...Contract work
- ...offerings and value propositions Overcome objections and close enrollments Consistently meet or exceed individual sales targets Bilingual Customer Support Communicate fluently in both English and Spanish Ensure all families feel supported, informed, and...BilingualFull time
$50k - $60k per year
...talked about, but are part of who we are. If such a workplace intrigues you, we hope you’ll join us. About the role: The Bilingual Sales Specialist (commission only) plays a pivotal role in fostering fresh business connections within our established network of merchants....BilingualOngoing contractContract workWork at officeRemote workWork from home- ...Summary: The Requirements Management Specialist is responsible for coordinating all elements... ...in selecting methods, techniques and evaluation criteria for obtaining results Career-... ...PowerPoint). Familiar with writing prompts to LLM AI models, using different roles...Full timeFor contractorsInterim roleInternshipWork at officeLocal areaRemote workRelocation
- ...Join us on our mission and shape the future! Why this role? Evaluation is critical to making progress in scaling intelligence. As models... ...generation evaluation methods and scalable infrastructure to measure LLM progress. As a Senior Research Engineer, Model Evaluation, you...Full timeWork at officeRemote workFlexible hours
$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager - EM&V with Resource Innovations, you will be responsible for technical support and project management services for the Advisory Services Group...Full timeWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Bilingual Evaluator - LLM Specialist. Be the first to apply!
Related searches
- remote social media evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- admissions evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- chargé de projet estimateur Toronto, ON
- web search evaluator Toronto, ON
- deployment specialist Toronto, ON