Language Model Analyst - Fully Remote | Upto $20/hr Part-time
$20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist - English & Odia
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Role Responsibilities
- Conduct fact-checking using trusted public sources and external tools .
- Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
- Assess reasoning quality, clarity, tone, and completeness of responses.
- Ensure model responses align with expected conversational behavior and system guidelines.
Qualifications
Must-Have
- Bachelor's degree .
- Native speaker in Odia .
- Significant experience using large language models (LLMs).
- Excellent writing skills in English .
- Strong attention to detail .
- Background or experience in domains requiring structured analytical thinking .
Preferred
- Prior experience with RLHF, model evaluation, or data annotation work .
- Experience writing or editing high-quality written content .
- Experience comparing multiple outputs and making fine-grained qualitative judgments .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Language Model Analyst - Fully Remote | Upto $20/hr Part-time in Toronto, ON vacancy
$90 per hour
...–$90/hour Location: Remote Duration: ~2 months... ...security concepts to enhance AI model threat detection and... ...in programming with low-level languages such as C , C++ , or Java... ...for up to 1 hour of onboarding time, including screening and onboarding...Remote jobLanguageContract workSummer work$100 per hour
...Compensation: $85–$100/hour Location: Remote Role Responsibilities Review... ...of financial documents, including pricing models, investment memoranda, and earnings reports... ...analysis. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$90 per hour
...Position: Sales & Marketing Experts Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct enterprise sales scenarios spanning $1M+ ACV deals , multi-stakeholder...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work$80 per hour
...React engineers with 2 years experience Type: Contract Compensation: $50–$80/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Develop and maintain React applications to enhance user experience. Collaborate...Part timeRemote jobContract workSummer work$70 per hour
...60–$70/hour Location: Remote Role Responsibilities... ...structured feedback to improve AI model outputs and enhance training... ...Strong domain knowledge in policy language interpretation. Expertise... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobLanguageContract workSummer work$95 per hour
...Dorsey . Position: Accounting Experts Type: Contract Compensation: $70–$95/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct scenarios across F500 corporate accounting and controllership,...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work$80 per hour
...Compensation: $68–$80/hour Location: Remote Role Responsibilities... ...Provide structured feedback to enhance AI model training and output quality. Collaborate... ...specifications . Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$42 per hour
...Compensation: $42/hour Location: Remote Role Responsibilities Evaluate... ...to strengthen reasoning and rigor in model outputs . Review complex content for... ...credibility. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$150 per hour
...Contract Compensation: $50–$150/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities... ..., corporate, energetic, and calm. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer work10 hours per week$100 per hour
...Compensation: $100/hour Location: Remote Commitment: 10+ hours/week... ...actionable insights using presentations, memos, and models. Collaborate with stakeholders to... ...industries. Application Process (Takes 20–30 mins to complete) Submit your...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $85–$120/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct FP&... ..., and earnings preparation. Build three-statement models , driver-based forecasts, and variance analyses at a $1B+...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work$120 per hour
...Legal Expert — Transactional / Corporate (Remote, Hourly) Type: Contract Compensation... ...Location: Remote Commitment: 20–40 hours/week Role Responsibilities... .... Provide written feedback to improve model behavior. Participate in onboarding...Remote jobHourly payContract workSummer workWork at officeImmediate start$130 per hour
...Dorsey . Position: Law Experts Type: Contract Compensation: $100–$130/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct enterprise legal scenarios across in-house counsel, regulatory, transactional...Part timeRemote jobHourly payWeekly payContract workFor contractorsSummer work- ...1000 per completed task Location: Remote Duration: ~2 weeks... ...asynchronously to meet deadlines and enhance AI model performance . Contribute expertise to... ...task rate. Application Process (Takes 20–30 mins to complete) Upload resume...Part timeRemote jobContract workSummer workImmediate start
$80 per hour
...Compensation: $55–$80/hour Location: Remote Role Responsibilities... ...project involving state-of-the-art large language models. Create high-quality data to inform... ...Complete a short interview and task (20–30 mins ). Paid onboarding time includes...Remote jobLanguageContract workSummer work$120 per hour
...Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...information from public SEC filings to support AI model training . Evaluate the accuracy of... ...February Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks Commitment: 30–40 hours/week... ...Start Date ~ Immediately Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer workImmediate start$120 per hour
...Contract Compensation: $85–$120/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design... ...rubrics. Provide written feedback to improve model behavior. Participate in onboarding office hours and specialty...Remote jobHourly payContract workFor contractorsSummer workWork at officeImmediate start$37 per hour
...25–$37/hour Location: Remote Duration: 2–4 months Commitment: 20+ hours/week Role Responsibilities... .... Run prompts through models. Assess outputs for accuracy, fluency... ...and consistency across French-language benchmarks. Qualifications...Remote jobContract workSummer work$175 per hour
...Compensation: $100–$175/hour Location: Remote Duration: 3+ months... ...digital chip design workflows to enhance AI model training and evaluation . Design and... ...weekly . Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobHourly payWeekly payContract workFor contractorsSummer work$110 per hour
...Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks... ...asynchronously to meet deadlines and improve AI model performance . Contribute expertise to... ...Immediately Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workImmediate startFlexible hours$150 per hour
...Compensation: $100–$150/hour Location: Remote Duration: 2–3 week engagement Commitment: 20+ hours/week Role Responsibilities... ...asynchronously to meet deadlines while improving AI model performance . Collaborate with security experts...Remote jobHourly payWeekly payContract workFor contractorsSummer work$40 per hour
.... Position: Microsoft Word Expert – Artifact Docs Conversion Type: Contract Compensation: $20–$40/hour Location: Remote Role Responsibilities Convert legacy documents into modern, polished Word files. Faithfully reproduce...Remote jobContract workSummer workFlexible hours$130 per hour
...Compensation: $130–$300/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment: 20+ hours/week Role Responsibilities... ...written feedback to the research team to improve model behavior . Participate in onboarding office...Remote jobWeekly payContract workSummer workWork at office$60 per hour
...Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Design and refine professional... ...technical, or data-heavy content . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer work$80 per hour
...Contract Compensation: $30–$80/hour Location: Remote Role Responsibilities Build richly detailed personas and... ..., or exposure to SQL/Python . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer work- ...$850–$1,000 per completed task Location: Remote Role Responsibilities Review and evaluate... ...: Potential transition to an hourly compensation model for top performers. Application Process (Takes 20–30 mins to complete) Upload resume AI...Part timeRemote jobHourly payContract workSummer work
$53 per hour
...$38–$53/hour Location: Remote Duration: 3–6 months Commitment: 20+ hours/week Role Responsibilities... ...linguistic clarity. Conduct model testing and grading, assessing... ...consistency and reliability across French-language benchmarks. Collaborate in...Remote jobContract workSummer work- ...$1,450 per completed task Location: Remote Role Responsibilities Review and evaluate... ...to transition to an hourly compensation model based on sustained quality and throughput. Application Process (Takes 20–30 mins to complete) Upload resume...Part timeRemote jobHourly payContract workSummer work
- ...Compensation: $1500–$1700 Location: Remote Duration: ~2 weeks (with the... ...for project expansion) Commitment: ~20 hours/week required Role Responsibilities... ...quiz enter a work trial period with a one-time $1,500 payment upon successful task...Part timeRemote jobHourly payContract workSummer workImmediate startTrial periodFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Language Model Analyst - Fully Remote | Upto $20/hr Part-time. Be the first to apply!
