Real Estate Expert - Evaluation Specialist
$25 - $35 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Model Evaluation Contractor
Type: Contract
Compensation: $25–$35/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts reflecting professional and consumer domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy and practical usefulness.
- Identify fabricated claims and misleading reasoning in model outputs .
- Score and rank model responses using structured rubrics.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Real Estate Expert - Evaluation Specialist in Toronto, ON vacancy
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$50 per hour
...Summers , and Jack Dorsey . Position: Real Estate Appraisal — Visual Document Understanding... .../week Role Responsibilities Evaluate the accuracy and depth of AI-generated... .... Collaborate with subject matter experts to ensure consistency, relevance, and...SuggestedFull timeContract workSummer workRemote work- ...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate Sales Agents Type: Contract Compensation: $500–$1000 per completed task Location: Remote Duration...SuggestedFull timeContract workSummer workImmediate startRemote work
$85 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Specialist (Real Estate, Tax, Bankruptcy, Estates) Type: Contract Compensation: $85–$120/hour Location: Remote...Hourly payFull timeContract workFor contractorsSummer workWork at officeImmediate startRemote work$80 - $160 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate / Property Professionals Type: Contract... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Work independently and follow structured guidelines...Remote jobContract workSummer work$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...precise, task-specific grading criteria for real-world data science deliverables, including... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$90 - $110 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate Brokers Type: Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks...Full timeContract workSummer workImmediate startRemote workFlexible hours- ...Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate Brokers Type: Contract Compensation: $1500/... ...Legal Task-based payment upon first task approval. Experts qualify for hourly payment after first task completion....Remote jobHourly payContract workSummer workImmediate startFlexible hours
$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...specific grading criteria for real-world pre-sales and solutions-... ...supporting proofs of concept, and evaluating product fit and technical risk... ...experience with AI training , evaluation, or human-data projects....Full timeContract workSummer workRemote work$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$150k - $180k per year
...Forum Asset Management – Director, Real Estate Development Location: In-Office, 181 Bay Street, Toronto Work Schedule: Full-time... ...growing development pipeline, ensuring projects are appropriately evaluated, budgets are adhered to, and target returns are achieved....Long term contractFull timeWork at officeLocal area$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Design precise grading criteria for real-world sales deliverables like prospecting... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobContract workSummer work$60k - $70k per year
...company committed to its people, find out more about what Aviso has to offer at . The Opportunity: We’re looking for an Estates Specialist to join our Operations team. Reporting to the Supervisor Operations, Estates, the Estates Specialist is responsible for the review...Full timeInternshipImmediate start$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and...Full timeContract workSummer workWork at officeImmediate startRemote work$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...Full timeContract workSummer workImmediate startRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...practical, business-minded, and highly organized Legal Counsel, Real Estate and Project Development to support the Company’s U.S.... ...related due diligence materials, working with the Real Estate Specialist to identify key legal and commercial risks, and advise on appropriate...Full timeInternshipWork at officeLocal areaRemote work3 days per week
$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$80 - $150 per hour
...and Jack Dorsey . Position: Design Expert Type: Contract... ...precise, task-specific grading criteria for real-world design deliverables such as brand identity... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...Full timeContract workSummer workRemote work$70k - $73.85k per year
...Posting will be closed on July 29, 2026 at 5:00 pm and this posting is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will enhance Friendship...Full timeInternship$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$73 per hour
...Jack Dorsey . Position: Chemistry AI Evaluator Type: Contract... ...different audiences. Apply consistent evaluation standards by following clear taxonomies,... ...or explaining chemistry concepts to non-expert audiences Familiarity with evaluation...Full timeContract workSummer workRemote work$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Full timeContract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real Estate Expert - Evaluation Specialist. Be the first to apply!
Related searches
- expert batiment Toronto, ON
- expert automobile Toronto, ON
- real estate agent Toronto, ON
- remote title examiner Toronto, ON
- apartment locator Toronto, ON
- property management associate Toronto, ON
- real estate agent no experience Toronto, ON
- associate commercial real estate Toronto, ON
- legal assistant real estate Toronto, ON
- real estate paralegal Toronto, ON