Real Estate Expert - Evaluation Specialist
$25 - $35 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Model Evaluation Contractor
Type: Contract
Compensation: $25–$35/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts reflecting professional and consumer domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy and practical usefulness.
- Identify fabricated claims and misleading reasoning in model outputs .
- Score and rank model responses using structured rubrics.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Real Estate Expert - Evaluation Specialist in Toronto, ON vacancy
- ...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate Sales Agents Type: Contract Compensation: $500–$1000 per completed task Location: Remote Duration...SuggestedFull timeContract workSummer workImmediate startRemote work
$85 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Specialist (Real Estate, Tax, Bankruptcy, Estates) Type: Contract Compensation: $85–$120/hour Location: Remote...SuggestedHourly payFull timeContract workFor contractorsSummer workWork at officeImmediate startRemote work$90 - $110 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate Brokers Type: Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks...SuggestedFull timeContract workSummer workImmediate startRemote workFlexible hours$50 per hour
...Summers , and Jack Dorsey . Position: Real Estate Appraisal — Visual Document Understanding... .../week Role Responsibilities Evaluate the accuracy and depth of AI-generated... .... Collaborate with subject matter experts to ensure consistency, relevance, and...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour... ...asynchronously to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently and asynchronously to ensure high-quality evaluations. Utilize Microsoft Office and Google Workspace ,...Remote jobContract workSummer workWork at office$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...precise, task-specific grading criteria for real-world data science deliverables such as analyses... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $150 per hour
...Position: UI / UX Design Expert Type: Contract... ...specific grading criteria for real-world digital product and UX... ...independently and asynchronously to evaluate and improve AI model performance... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work- ...OPPORTUNITY The Analyst, Real Estate Development will be responsible for providing financial and other support on a wide range of development... ..., interpretation, and implementation of financial models to evaluate and propose recommendations on investment, development, and...Full timeWork at office
$85k - $100k per year
...successful candidate will fill the full time position of Analyst, Real Estate Investments in Toronto. The primary responsibility of this role... ...tools and templates to streamline and standardize the project evaluation process. Present findings in clear, compelling, and...Full timeWork at office- ...result, LEAP helps law firms help people and make a real difference. We are seeking an Estates Content Specialist for a highly motivated, high-velocity, and growing... .... The Estates Content Specialist will be a legal expert who is excited about working in a technology...Full timeWork at officeLocal areaWork from homeShift work
$73 per hour
...Jack Dorsey . Position: Chemistry AI Evaluator Type: Contract... ...different audiences. Apply consistent evaluation standards by following clear taxonomies,... ...or explaining chemistry concepts to non-expert audiences Familiarity with evaluation...Full timeContract workSummer workRemote work$60k - $70k per year
...company committed to its people, find out more about what Aviso has to offer at . The Opportunity: We’re looking for an Estates Specialist to join our Operations team. Reporting to the Supervisor Operations, Estates, the Estates Specialist is responsible for the review...Full timeInternshipImmediate start$25 - $45 per hour
...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring...Full timeContract workSummer workRemote work$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Contract workSummer workRemote work- ...practical, business-minded, and highly organized Legal Counsel, Real Estate and Project Development to support the Company’s U.S.... ...related due diligence materials, working with the Real Estate Specialist to identify key legal and commercial risks, and advise on appropriate...Full timeInternshipWork at officeLocal areaRemote work3 days per week
$104.5k - $325k per year
...Join Our Team as a Real Estate Lawyer at Axiom Location: Toronto We are currently seeking Commercial Real Estate Lawyers to work with municipalities on matters related to commercial real estate management and funding of real estate ventures. This is an existing...Full timeFlexible hours- ...time | Commission-based Experience Level: New Agents, Experienced Agents, or Those Planning to Become Licensed Grow your real estate career with powerful tools, proven support, and a trusted brand recognized nationwide. Whether you're newly licensed, an experienced...Full timePart timeLocal areaShift work
$55k - $65k per year
...leading and most innovative law firms. We offer market leading expertise in M&A, corporate, securities and finance, private equity, real estate, tax, restructuring, litigation and other business-related specialties. What makes Goodmans a great place to work? Knowing you...Full time$87k - $100k per year
...Opal Corporate Connections is partnering with one of Canada's Top 100 Employers to recruit a Finance Consulting Analyst (Real Estate) to join their Commercial Banking team in Ontario. This is an excellent opportunity for experienced commercial credit professionals...Full time$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$120k - $160k per year
...Finance Manager – Real Estate Development Location: Toronto, Ontario Industry: Real Estate Development Search Managed By: Canterra Group Compensation: $120,000 to $160,000 plus bonus, rrsp matching and benifits The Opportunity...Long term contractFull timeWork at office- ...Ensure all content is non-AI generated and timestamped. Provide real, complete presentations with extensive slides and content.... ...Compensation up to $100 per file . Submissions will be evaluated, and a team member will contact you if they meet requirements....Full timeSummer work
$110 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real Estate Brokers Type: Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks...Remote jobContract workSummer workImmediate start$100k per year
...Job Responsibility: We are in need of a real estate inside sales agent to join our growing team. You'll be responsible for prospecting new leads, making cold calls, building relationships with potential clients, and improving our lead conversion rate. If you're driven to achieve...Full timeStart today$55k - $63k per year
...a Legal Administrative Assistant in our Toronto Commercial Real Estate Group. As a member of the team, you will play a key role in managing... ...team, and hiring decisions are made through collaborative evaluation and interviews. McMillan is committed to providing accommodation...Full timeContract workWork at officeWork from home$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$60k - $72k per year
.... Serving clients since 1922, we are proud to be the firm that businesses trust with their most complex legal matters. Assistant, Real Estate Law Clerks Essential Functions Provide support to team of clerks in completing off-title due diligence for acquisitions and sales...Full timeWork at office$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...Remote jobContract workSummer workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real Estate Expert - Evaluation Specialist. Be the first to apply!
Related searches
- expert automobile Toronto, ON
- expert batiment Toronto, ON
- real estate agent Toronto, ON
- property management associate Toronto, ON
- real estate agent no experience Toronto, ON
- apartment locator Toronto, ON
- remote title examiner Toronto, ON
- law clerk real estate Toronto, ON
- real estate transaction coordinator Toronto, ON
- real estate intern Toronto, ON