Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Gujarati Language Evaluation Specialist

$15 - $20 per hour

Mercor

Toronto, ON
  • Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Generalist - English & Gujarati

Type: Contract

Compensation: $15–$20/hour

Location: Remote

Role Responsibilities

  • Conduct fact-checking using trusted public sources and external tools .
  • Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.

Qualifications

Must-Have

  • Bachelor's degree
  • Native speaker in Gujarati
  • Significant experience using large language models (LLMs)
  • Excellent writing skills in English
  • Strong attention to detail
  • Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Gujarati Language Evaluation Specialist in Toronto, ON vacancy
  • $25 - $37 per hour

     ...Position: Bilingual French Generalist Evaluator Expert Type: Contract Compensation...  ...rigor and consistency across French-language benchmarks. Qualifications...  ...academic writing. Experience creating evaluation criteria, rubrics, or grading guidelines... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    19 hours ago
  • $80 - $150 per hour

     ..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...  ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    3 days ago
  •  ...alongside iconic brand names. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess...  ...in the luxury market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations... 
    Suggested
    Contract work
    Worldwide
    Flexible hours

    CXG

    Toronto, ON
    14 days ago
  • $100 per hour

     ...hour Location: Remote Role Responsibilities Evaluate AI-generated responses to enhance reasoning and rigor in...  ...Strict attention to detail and accurate application of structured evaluation guidelines. Ability to work entirely without AI writing... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    17 days ago
  •  ...future! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs). Your primary focus will be on designing and conducting data collection... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    Toronto, ON
    14 days ago
  • $122k - $192k per year

     ...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager - EM&V with Resource Innovations, you will be responsible for technical support and project management services for the Advisory Services Group... 
    Full time
    Work at office
    Local area

    Resource Innovations

    Toronto, ON
    21 days ago
  •  ...About Us Language Trainers is an international language training company working with freelance teachers of 99+ languages in hundreds of cities worldwide. Founded in 2004, our motto is Any Language, Anytime, Anywhere. We provide customized language training to professionals... 
    Hourly pay
    Contract work
    Part time
    Freelance
    Immediate start
    Worldwide
    Flexible hours
    1 day per week

    Language Trainers

    Toronto, ON
    11 days ago
  •  ...Summary: The Requirements Management Specialist is responsible for coordinating all elements...  ...in selecting methods, techniques and evaluation criteria for obtaining results Career...  ...at least one programming or scripting language (Python, Visual Basic, C) Total Rewards... 
    Full time
    For contractors
    Interim role
    Internship
    Work at office
    Local area
    Remote work
    Relocation

    Bechtel

    Toronto, ON
    12 hours ago
  • $105k - $130k per year

     ...Description: The Department of Germanic Languages and Literatures in the Faculty of Arts and Science at the University of...  ...research interests, sample syllabi, course materials, teaching evaluations, and evidence of a commitment to collaboration or engagement with... 
    Long term contract
    Permanent employment
    Full time

    University of Toronto

    Toronto, ON
    11 days ago
  • $64.55k - $81k per year

     ...Contract  Vacancy Type:  Replacement The Plant Training Specialist is responsible for the design, development, and execution of a...  ...Instructor-Led Training Classes, Virtual Training, Observations, Evaluations, Knowledge Tests, etc.) that is Learner-Focused, engaging, highly... 
    Remplacement
    Contract work
    For contractors
    Shift work
    Weekend work

    Ventura Foods

    Toronto, ON
    12 hours ago
  •  ...range of perspectives is a requirement for building great products. Join us on our mission and shape the future! Why this role? Evaluation is critical to making progress in scaling intelligence. As models continue to become superhuman in many real-world use cases, we... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    Toronto, ON
    more than 2 months ago
  • $57k - $65k per year

     ...community organizers. The Community Organizing Specialist will join a small national staff team...  ...or community groups ~Excellent English-language writing and public speaking skills ~...  ..., reporting systems, or program evaluation   Compensation Salary range is $57,... 
    Full time
    Contract work
    Local area
    Immediate start
    Flexible hours

    Reports To:

    Toronto, ON
    2 days ago
  •  ...'intelligence artificielle n'évalue pas les candidats et ne prend...  ...looking for a bilingual Marketing Specialist (French Canadian/English) to...  ...Marketing: Manage French-language social media and email...  ...information consistently. AI does not evaluate candidates or make hiring... 
    Long term contract
    Temporary work
    Local area
    1 day per week

    GoEngineer

    Toronto, ON
    18 days ago
  • $37 per hour

    Overview Languages English Education ~ No degree, certificate or diploma Experience 5 years or more On site...  ...and new equipment to cooking staff Supervise activities of specialist chefs, chefs, cooks and other kitchen workers Create new recipes... 
    Full time
    Contract work
    Remote work

    Alpha's Shawarma

    Toronto, ON
    4 days ago
  • $72k - $125k per year

     ...is seeking an experienced GenAI & Python Specialist to join our dynamic Operate team on a 1-...  ...using Python-based frameworks, Large Language Models (LLMs), and advanced retrieval-augmented...  ..., feedback loops ML Flow for model evaluation and drift detection Sourcing test... 
    Long term contract
    Temporary work
    Fixed term contract
    Flexible hours
    Toronto, ON
    1 day ago
  • $61.9k - $114.5k per year

     ...We are looking for a Senior Engineering Specialist - Secure Network. We are maturing our...  ...innovative, and tech-savvy engineers that evaluate, design, and deploy Secure Network...  ...components, using standard tools (batch languages, programming languages, etc.) Unit and... 
    Permanent employment
    Full time

    The Canada Life Assurance Company

    Toronto, ON
    1 day ago
  • $50 - $70 per hour

     .../hour Location: Remote Role Responsibilities Develop and complete coding tasks in various enterprise languages . Evaluate and improve systems and build toolchains using C and Rust . Enhance enterprise JVM and build ecosystems with... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    6 days ago
  •  ...looking for an Intermediate System Design Specialist to join our team in Toronto. The...  ...requirements. Additionally you will Analyze and evaluate designs to verify compliance with System...  ...and standards Good technical English language writing skills; good communication and analytical... 
    Full time
    Contract work
    Work at office
    Worldwide

    Thales

    Toronto, ON
    5 days ago
  • $87.76k - $105.32k per year

     ...Job Details Specialist, Staffing Exempt Level 3: $87,762 - $105,316 Vision The Toronto Catholic District School Board (TCDSB...  ...professional development Administer and apply collective agreement(s) language within assigned portfolio Support the management team with... 
    Contract work
    Temporary work
    Internship

    Toronto Catholic District School Board

    Toronto, ON
    8 days ago
  • $60 - $70 per hour

     ...hour Location: Remote Role Responsibilities Evaluate the accuracy of AI performance on complex insurance documents,...  ...underwriter experience. Strong domain knowledge in policy language interpretation. Expertise in risk assessment documentation... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    6 days ago
  • $85k - $100k per year

     ...manufacturer is seeking an experienced (Hybrid) Senior Procurement Specialist to join its organization in a key operational and strategic...  ...implement cost-saving opportunities and procurement efficiencies Evaluate supplier performance related to quality, delivery, service, and... 
    Long term contract
    Permanent employment
    Full time
    Overseas
    Relocation package

    Stoakley-Stewart Consultants

    Toronto, ON
    19 days ago
  • $60.88k - $91.32k per year

     ...businesses trust with their most complex legal matters. Billing Specialist The Role The Billing Specialist supports the successful...  ...billing/e-billing process guidance to internal staff Continually evaluate process and procedures for efficiencies; coupled with... 
    Work at office

    Bennett Jones

    Toronto, ON
    12 days ago
  • $58k - $96k per year

     ...practical benefits that foster a culture of well-being and connectedness. -- What will your typical day look like? As a Project Specialist, you will play a hands-on role in delivering operational and strategic initiatives by combining project coordination, advanced... 
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    12 hours ago
  •  ...Document Licensing Type: Contract Compensation: $1/hour Location: Remote Role Responsibilities Evaluate the structural richness and visual polish of submitted .DOCX files . Review documents for charts , detailed methodology,... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    16 days ago
  •  ...optimal efficiency. The Training and Quality Specialist will also develop and support a quality...  ...modify and improve existing programs Evaluate the effectiveness of training programs...  ...other team members, for consistency and language-level Work with the project delivery team... 
    Work at office
    Remote work
    Flexible hours

    Legal Aid Ontario

    Toronto, ON
    27 days ago
  •  ...A day in the life of a Data Specialist at Esri Canada: * Design, develop...  ...improvement. * Develop, evaluate, and refine descriptive, predictive...  ...models using programming languages such as Python or R, and querying...  ..., feature engineering, model evaluation, and performance monitoring... 
    Full time
    Summer work
    Work at office
    Work from home

    Esri Canada Limited

    Toronto, ON
    28 days ago
  •  ...are consistently treated with dignity while respecting individual religion, nationality, gender, race, age, perceived ability, spoken language, sexual orientation, and identification. We are united in our purpose of being here to help make life in Canada better.... 
    Full time
    Work at office

    Canadian Tire Corporation

    Toronto, ON
    1 day ago
  • $46 per hour

    Overview Languages English Education ~ College, CEGEP or other non-university certificate or diploma from a program of 1 year to 2 years Experience 5 years or more Remote Work must be done remotely. There’s no office space provided. Responsibilities... 
    Permanent employment
    Full time
    Work at office
    Remote work

    IBENTOS INC.

    Toronto, ON
    1 day ago
  •  ...What you'll do Detail-oriented and proactive Product Content Specialist who will be responsible for onboarding product content to the...  ...religion, nationality, gender, race, age, perceived ability, spoken language, sexual orientation, and identification. We are united in our... 
    Full time
    Work at office

    Canadian Tire Corporation

    Toronto, ON
    1 day ago
  • $91.2k - $136.8k per year

     ...practices. As a key member of Salesforce COE, the SF Campaign Specialist will work closely with key partners across Marketing & Business...  ...participate throughout the interview process. We look forward to hearing from you! Language Requirement (Quebec only): Sans Objet... 
    Full time
    Work from home

    TD Bank

    Toronto, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Gujarati Language Evaluation Specialist. Be the first to apply!