Gujarati Language Evaluation Specialist
$15 - $20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist - English & Gujarati
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Role Responsibilities
- Conduct fact-checking using trusted public sources and external tools .
- Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
- Assess reasoning quality, clarity, tone, and completeness of responses.
- Ensure model responses align with expected conversational behavior and system guidelines.
Qualifications
Must-Have
- Bachelor's degree
- Native speaker in Gujarati
- Significant experience using large language models (LLMs)
- Excellent writing skills in English
- Strong attention to detail
- Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
Preferred
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience writing or editing high-quality written content
- Experience comparing multiple outputs and making fine-grained qualitative judgments
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Gujarati Language Evaluation Specialist in Toronto, ON vacancy
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating... ...objective judgment based on provided evaluation guidelines. • Maintain high quality... ...Requirements • Native level fluency in target language with an in depth understanding of its...SuggestedRemote jobContract workFreelance
- ...want to impact the world in a positive way. To learn more visit: We are looking for a hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive and holistic analysis on all aspects of performance of the autonomy...SuggestedFull time
- ...Make an Impact on People’s Lives; Join SE Health as Speech Language Pathologist SE Health Speech Language Pathologist are the best of the best. We provide person centered care, an ability to build rapport and trust with your clients while positively seeing them progress...SuggestedFor contractorsCasual workFlexible hours
usd29 per hour
...What if your knowledge of Ukrainian language could help improve the AI. WHAT YOU'LL DO Evaluate AI-generated responses for accuracy, grammar, and cultural relevance. Identify issues and provide refined, high-quality rewritten responses. Create natural prompts...Remote jobHourly pay- ...About Us Language Trainers is an international language training company working with freelance teachers of 99+ languages in hundreds of cities worldwide. Founded in 2004, our motto is Any Language, Anytime, Anywhere. We provide customized language training to professionals...Hourly payContract workPart timeFreelanceImmediate startWorldwideFlexible hours1 day per week
$50 per hour
...Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract... ...sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication... ...culturally appropriate and platform-native language. Test language models using real-...Remote jobContract workSummer work10 hours per week$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...the Collective Agreement shall prevail. Minimum Qualifications: include at least a Master’s degree in Applied Linguistics or Second Language Education with strong written and oral communication skills, and a demonstrated commitment to content-based instruction to advanced...Long term contractPermanent employment
- ...looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s...Full timeInternship
$85 per hour
...Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms , Kubernetes ,...Remote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$85 per hour
...Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile application code for correctness, quality, maintainability, and...Remote jobContract workSummer work$70 per hour
...Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning. Provide structured written feedback to improve AI model...Remote jobContract workSummer work$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$45k - $60k per year
...Proficient written and verbal English/Mandarin and other Chinese language skills. ~ Strong commitment to continuous improvement and... ...intelligence tools may be used to support candidate screening and evaluation; the expected base salary range for this position is 45,000 –...Long term contract$10k per year
...Description: PLIC24H3 - First Language Acquisition - Fall 2026 Course description : Descriptions of children's pronunciation, vocabulary and grammar at various stages of learning their first language. Theories of the linguistic knowledge and cognitive processes...Long term contractInternshipWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$25 per hour
Overview Languages English Education ~ Bachelor's degree Experience 3 years to less than 5 years Remote Work must be done remotely. There’s no office space provided.Part timeSeasonal workWork at officeRemote work$4102 per week
...Perform tactical activities including designing, inspecting, and implementing code for relevant applications using various programming languages in an agile environment. Guard the quality of the code for business technology solutions and prevent the accumulation of technical...$72k - $125k per year
...is seeking an experienced GenAI & Python Specialist to join our dynamic Operate team on a 1‑... ...using Python‑based frameworks, Large Language Models (LLMs), and advanced retrieval‑augmented... ..., feedback loops ML Flow for model evaluation and drift detection Sourcing test...Long term contractTemporary workFixed term contractFlexible hours$40.87 per hour
Overview Languages English Education ~ Bachelor's degree Experience 1 year to less than 2 years On site Work... ...and grievance procedures Plan, develop, implement and evaluate human resources policies and programs Review HR projects to assure...Remote work$89.25k - $115.5k per year
...join the team at Hydro One! Job Function: Hydro One is seeking an experienced Compensation Specialist with proven contributions in compensation management, job evaluation, and compliance and reporting. We’re looking for a strong collaborator with effective...InternshipLocal area- ...A day in the life of a Data Specialist at Esri Canada: * Design, develop... ...improvement. * Develop, evaluate, and refine descriptive, predictive... ...models using programming languages such as Python or R, and querying... ..., feature engineering, model evaluation, and performance monitoring...Full timeSummer workWork at officeWork from home
- ...range of perspectives is a requirement for building great products. Join us on our mission and shape the future! Why this role? Evaluation is critical to making progress in scaling intelligence. As models continue to become superhuman in many real-world use cases, we...Full timeWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gujarati Language Evaluation Specialist. Be the first to apply!
Related searches
- language specialist Toronto, ON
- language translator Toronto, ON
- online translator Toronto, ON
- french language assistant Toronto, ON
- internship translator Toronto, ON
- freelance translator Toronto, ON
- spanish language assistant Toronto, ON
- translator interpreter Toronto, ON
- translation project manager Toronto, ON
- remote translator Toronto, ON