English Linguistic Expert - Evaluator
$50 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: English Language and Literature Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Role Responsibilities
- Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
- Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
- Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
- Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance .
- Provide detailed linguistic feedback and analysis to guide ongoing model training efforts .
Qualifications
Must-Have
- Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
- Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
- Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
- Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
- Strong attention to detail, analytical judgment, and written communication skills.
- Ability to work independently in a distributed, remote environment .
Preferred
- Interest in AI and LLM-driven language technologies .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the English Linguistic Expert - Evaluator in Toronto, ON vacancy
$100 - $150 per hour
...Dorsey . Position: Software Engineer Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... ...~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office...SuggestedContract workSummer workWork at officeRemote workMercor
Toronto, ON26 days ago$80 - $120 per hour
...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour... ...procurement / RFI response. ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hoursMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour... ...procurement / RFI response . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...Legal / compliance . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...in Legal / compliance. ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Full timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote workMercor
Toronto, ONa month agousd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs... ...-level speaker of Marathi with strong English skills and a keen eye for language quality... .... - Providing structured evaluations and feedback following the project instructions...English language skillsHourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours$50 per hour
..., Larry Summers , and Jack Dorsey . Position: French Linguistic Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated French text across various...Full timeContract workSummer workRemote workMercor
Toronto, ONa month ago$50 per hour
...German Language and Literature Expert (German) Type:... ...Role Responsibilities Evaluate the quality and accuracy of... ...content to ensure it meets linguistic, cultural, and literary standards... ...guide ongoing model training and evaluation efforts. Qualifications...Remote jobContract workSummer work$100 - $150 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... ...~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office...Remote jobContract workSummer workWork at office$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours$14 - $42 per hour
...Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation... .../week Role Responsibilities Evaluate AI-generated music across various genres.... ...and asynchronously in Hindi and English . Qualifications Must-Have...English language skillsFull timeContract workSummer workImmediate startRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... ...quantitative readouts . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Remote jobContract workSummer workWork at office$18 - $18.5 per hour
.... Through its AI-driven platform, Propel evaluates customers in a more comprehensive way than... ...offered by Propel as a subject matter expert Work as a team to obtain individual and... ...verbal and written communication skills in English; Spanish is an asset Exceptional...English language skillsFull timeInternshipWork at officeMonday to fridayPropel Holdings Career
Toronto, ON15 days ago$80 - $120 per hour
...Position: Humanities / arts / culture Evaluator Type: Contract Compensation... .... Collaborate with subject matter experts to ensure consistency and quality.... ...~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office...Remote jobContract workSummer workWork at office$90 per hour
...read a page's scripts and understand their DOM impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience....English language skillsFull timeContract workSummer workLocal areaRemote workMercor
Toronto, ONa month ago$80 - $120 per hour
...Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour... ...General Sales / GTM . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Full timeContract workSummer workWork at officeRemote workFlexible hoursMercor
Toronto, ONmore than 2 months ago$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and...Full timeContract workSummer workWork at officeImmediate startRemote workMercor
Toronto, ONmore than 2 months ago$18 - $18.5 per hour
.... Through its AI-driven platform, Propel evaluates customers in a more comprehensive way than... ...offered by Propel as a subject matter expert Work as a team to obtain individual and... ...verbal and written communication skills in English; Spanish is an asset Good knowledge of...English language skillsInternshipWork at officeMonday to fridayPropel Holdings Career
Toronto, ON21 days ago$60k per year
...accordance with project specifications ~ Competence in manually testing software to evaluate functionality ~1–2 years of customer service experience, with bilingual French and English proficiency(must have) ~ Skill in documenting and communicating defects effectively,...English language skillsInternshipManual laborWork at officeImmediate startRemote workWorldwideMonday to fridayFlexible hoursShift workNight shiftDay shiftAfternoon shiftYuJa
Toronto, ON4 days ago$25 - $45 per hour
...Remote Role Responsibilities Evaluate AI-generated written conversations... ...enhance performance. Draft and refine evaluation rubrics for generalist writing tasks.... .... Preferred ~ Background in English , journalism, communications, or a related...English language skillsFull timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$38 per hour
...Job title: Japanese Linguistic Consultant Contract type: Independent contractor Compensation: $38 CAD/hour Work Location : Remote... ...Summary: We are seeking a Linguistic Consultant to provide expert guidance and support to our engineering team in the implementation...Contract workFor contractorsRemote workWork from homeWorldwide$15 - $20 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist - English & Assamese Type: Contract Compensation: $15–$... ...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement,...English language skillsFull timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour... ...hospitality / events . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Remote jobContract workSummer workWork at office$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... ...comprehension and written communication in English Strong attention to detail and sound...English language skillsRemote jobContract workSummer workFlexible hours$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...environmental science . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Remote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour... .../ clinical . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Remote jobContract workSummer workWork at office$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...native proficiency in both Telugu and English . Preferred Evidence of understanding...English language skillsRemote jobContract workSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to English Linguistic Expert - Evaluator. Be the first to apply!
Related searches
- expert automobile Toronto, ON
- expert batiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur industriel Toronto, ON
- estimateur structure Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- admissions evaluator Toronto, ON