Language Model Analyst - Fully Remote | Upto $20/hr Part-time
$20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist - English & Marathi
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Role Responsibilities
- Conduct fact-checking using trusted public sources and external tools .
- Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
- Assess reasoning quality, clarity, tone, and completeness of responses.
- Ensure model responses align with expected conversational behavior and system guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree .
- Native speaker in Marathi .
- Significant experience using large language models (LLMs).
- Excellent writing skills in English .
- Strong attention to detail .
- Background or experience in domains requiring structured analytical thinking .
Preferred
- Prior experience with RLHF, model evaluation, or data annotation work .
- Experience writing or editing high-quality written content .
- Experience comparing multiple outputs and making fine-grained qualitative judgments .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Language Model Analyst - Fully Remote | Upto $20/hr Part-time in Toronto, ON vacancy
$90 per hour
...–$90/hour Location: Remote Duration: ~2 months... ...security concepts to enhance AI model threat detection and... ...in programming with low-level languages such as C , C++ , or Java... ...for up to 1 hour of onboarding time, including screening and onboarding...Remote jobLanguageContract workSummer work$100 per hour
...Compensation: $85–$100/hour Location: Remote Role Responsibilities Review... ...of financial documents, including pricing models, investment memoranda, and earnings reports... ...analysis. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$70 per hour
...60–$70/hour Location: Remote Role Responsibilities... ...structured feedback to improve AI model outputs and enhance training... ...Strong domain knowledge in policy language interpretation. Expertise... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobLanguageContract workSummer work$90 per hour
...Position: Sales & Marketing Experts Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct enterprise sales scenarios spanning $1M+ ACV deals , multi-stakeholder...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work$95 per hour
...Dorsey . Position: Accounting Experts Type: Contract Compensation: $70–$95/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct scenarios across F500 corporate accounting and controllership,...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work$120 per hour
...Legal Expert — Transactional / Corporate (Remote, Hourly) Type: Contract Compensation... ...Location: Remote Commitment: 20–40 hours/week Role Responsibilities... .... Provide written feedback to improve model behavior. Participate in onboarding...Remote jobHourly payContract workSummer workWork at officeImmediate start$120 per hour
...Contract Compensation: $85–$120/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design... ...rubrics. Provide written feedback to improve model behavior. Participate in onboarding office hours and specialty...Remote jobHourly payContract workFor contractorsSummer workWork at officeImmediate start$80 per hour
...Compensation: $55–$80/hour Location: Remote Role Responsibilities... ...project involving state-of-the-art large language models. Create high-quality data to inform... ...Complete a short interview and task (20–30 mins ). Paid onboarding time includes...Remote jobLanguageContract workSummer work$37 per hour
...25–$37/hour Location: Remote Duration: 2–4 months Commitment: 20+ hours/week Role Responsibilities... .... Run prompts through models. Assess outputs for accuracy, fluency... ...and consistency across French-language benchmarks. Qualifications...Remote jobContract workSummer work$130 per hour
...Dorsey . Position: Law Experts Type: Contract Compensation: $100–$130/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct enterprise legal scenarios across in-house counsel, regulatory, transactional...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work$110 per hour
...Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks... ...asynchronously to meet deadlines and improve AI model performance . Contribute expertise to... ...Immediately Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workImmediate startFlexible hours$150 per hour
...Compensation: $100–$150/hour Location: Remote Duration: 2–3 week engagement Commitment: 20+ hours/week Role Responsibilities... ...asynchronously to meet deadlines while improving AI model performance . Collaborate with security experts...Remote jobHourly payWeekly payContract workFor contractorsSummer work$130 per hour
...Compensation: $130–$300/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment: 20+ hours/week Role Responsibilities... ...written feedback to the research team to improve model behavior . Participate in onboarding office...Remote jobWeekly payContract workSummer workWork at office$120 per hour
...Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...information from public SEC filings to support AI model training . Evaluate the accuracy of... ...February Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$90 per hour
...Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Convert legacy decks into modern... ...reliable on a flexible schedule. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer workFlexible hours$60 per hour
...Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Design and refine professional... ...technical, or data-heavy content . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer work$53 per hour
...$38–$53/hour Location: Remote Duration: 3–6 months Commitment: 20+ hours/week Role Responsibilities... ...linguistic clarity. Conduct model testing and grading, assessing... ...consistency and reliability across French-language benchmarks. Collaborate in...Remote jobContract workSummer work$90 per hour
...Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop... .... Evaluate the impact of AI models on future innovations in the field. Collaborate... ...basis. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$80 per hour
...Contract Compensation: $30–$80/hour Location: Remote Role Responsibilities Build richly detailed personas and... ..., or exposure to SQL/Python . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer work$130 per hour
...Compensation: $130/hour Location: Remote Duration: Minimum four weeks... ...Responsibilities Evaluate financial models and provide insights to strengthen AI model... ...weekly Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobHourly payWeekly payContract workFor contractorsSummer work$65 per hour
...Compensation: $50–$65/hour Location: Remote Role Responsibilities Build... ...comparison, quote gathering, and TCO modeling . ~ Proficient in reading and producing... ...Application Process (Takes 20–30 mins to complete) Upload resume...Part timeRemote jobHourly payContract workFor contractorsSummer work$105 per hour
.... Position: Junior Investment Analyst (Buy-Side) Type: Contract... ...Compensation: $105/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities... ...across sectors to support AI model training . Build and interpret...Remote jobContract workSummer work- ...Compensation: $200/hour Location: Remote Duration: Minimum four weeks... ...related to long/short equity to enhance AI model training . Develop and review financial... ...weekly Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobHourly payWeekly payContract workFor contractorsSummer work
$135 per hour
...Compensation: $55–$135/hour Location: Remote Commitment: 15 hours/week... ...trained on legal reasoning and judicial language. Complete structured tasks with consistency... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobLanguageContract workSummer work- ...$1,450 per completed task Location: Remote Role Responsibilities Review and evaluate... ...to transition to an hourly compensation model based on sustained quality and throughput. Application Process (Takes 20–30 mins to complete) Upload resume...Part timeRemote jobHourly payContract workSummer work
- ...$850–$1,000 per completed task Location: Remote Role Responsibilities Review and evaluate... ...: Potential transition to an hourly compensation model for top performers. Application Process (Takes 20–30 mins to complete) Upload resume AI...Part timeRemote jobHourly payContract workSummer work
- ...Compensation: $1500–$1700 Location: Remote Duration: ~2 weeks (with the... ...for project expansion) Commitment: ~20 hours/week required Role Responsibilities... ...quiz enter a work trial period with a one-time $1,500 payment upon successful task...Part timeRemote jobHourly payContract workSummer workImmediate startTrial periodFlexible hoursShift work
- ...Compensation: $850–$1,000 per completed task Location: Remote Role Responsibilities Review and evaluate AI-... ...sustained quality and throughput. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Part timeRemote jobHourly payContract workSummer work
$100 per hour
...Compensation: $100/hour Location: Remote Duration: Minimum four weeks... ...to ensure compliance and precision in AI model outputs . Analyze complex financial... ...Paid weekly Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobHourly payWeekly payContract workFor contractorsSummer work$160 per hour
...Dorsey . Position: Financial Analyst Type: Contract... ...–$160/hour Location: Remote Role Responsibilities... ...with teams to enhance financial model accuracy and business data insights... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Language Model Analyst - Fully Remote | Upto $20/hr Part-time. Be the first to apply!
