Data Engineer - AI Model Evaluation
$80 per hourFull-time
Mercor
This position requires local presence. Please view similar jobs below.
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Engineer (Coding Agent Experience)
Type: Contract
Compensation: $80/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
- Review model-generated implementations involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems .
- Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic data engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional data engineering experience.
- Experience building ETL pipelines , data warehouses , analytics platforms , or distributed data systems .
- Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
- Ability to evaluate model-generated data infrastructure and pipeline implementations.
Preferred
- Experience operating large-scale data platforms .
Compensation & Legal
- $400 per accepted task .
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer - AI Model Evaluation in Toronto, ON vacancy
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type:... ...frontier AI coding agents to complete and evaluate complex data engineering tasks....SuggestedRemote jobContract workSummer work$85 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SuggestedRemote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...data analyses , statistical modeling work , machine learning pipelines... ...and A/B test write-ups . Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$85 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: iOS Engineer (Coding Agent Experience) Type... ...AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile application code...SuggestedRemote jobContract workSummer work$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...deliverables such as analyses, models, dashboards, and experiment readouts... ...experience with AI training , evaluation, or human-data projects....SuggestedRemote jobContract workSummer work$80k - $180k per year
...Zafin is an AI platform company helping regulated institutions modernize how critical... ..., an integration platform that connects data, systems, and workflows across complex enterprise... .... What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate,...Full time- ...Reference no. R2862231 Position title: Data and AI Engineer Department: Data Engineering I. Location: Toronto, ON About the job... ...(peer validation) Propose and implement relevant data models for each business case Create data models and optimize queries...Full timeWork from homeFlexible hours
$95k - $145k per year
Data Modeller Position Description This role is hybrid and requires you to be at a Client... ...modelling and data product design and 25% data engineering enablement. Your future duties and... .... To support our recruitment team, AI tools may be used to help assess applications...Work at office$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other... ...Score the quality of musical training data to enhance model performance. Write...Remote jobContract workSummer workImmediate start$110k - $160k per year
...a better working world for all. As AI Engineer, you will design and build production-grade... ...workflows, multi-agent coordination, evaluation frameworks, observability and governance... ...AI Architect, AI Platform Engineers, and Data Scientists to translate complex business...Long term contract$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Software / AI / IT / data Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs . Apply deep subject-matter...Remote jobContract workSummer workWork at office- ...· Python · PySpark · SQL · Data Modeling Techniques · ETL/ELT Development... ...data modeling, advanced analytics, data engineering, and product delivery to transform complex... ...platforms to support analytics, reporting, and AI-driven business solutions. · This role...Contract work
- ...Senior AI Data Engineer – Enterprise Data Build It. Scale It. Own It. Sangoma is a global leader in business communications, delivering... ...environment Building data pipelines using Python and SQL Data modeling, transformation, and orchestration tools Modern data...Long term contractFull timeWork from homeWorldwideFlexible hours
$101k - $169k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 131871 Primary Location... ...complex, high-impact engagements in the AI Model Risk Space, ensuring alignment with... ...Generative AI offerings, including testing, evaluating and benchmarking different LLMs and toolchains...Permanent employmentContract workFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs. Apply deep subject-matter...Remote jobContract workSummer workWork at office- ...commercial insurance organization, is seeking an experienced Senior Data Modeler to join their enterprise data team. In this role, you will be... .... You will collaborate closely with Data Architects, Data Engineers, BI teams, and key business stakeholders across domains such as...Immediate start
$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub... ...scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration...Full timeWorldwide$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or...Remote jobContract workSummer work$85k - $156k per year
...Job Type: Permanent Work Model: Remote Reference code: 134003... ...Deloitte Global is the engine of the Deloitte network. Our professionals... ...We are seeking a Data Domain Modeler to define, standardize... ...human screening combined with AI technology to help identify the...Permanent employmentRemote workFlexible hours- ...Data Architect / Data Modeler – Azure, AWS, Data Warehousing & Informatica CDI Location: Toronto, ON Work Model: Hybrid (... ...Bachelor's Degree in Computer Science, Information Systems, Engineering, or a related discipline. • Azure, AWS, TOGAF, DAMA,...Permanent employmentWork at office2 days per week
$72k - $138k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 130069 Primary... ...-- We are looking for a passionate AI Research Engineer to join our team. You will work at the... ...research and product engineering—designing, evaluating, and deploying generative AI (GenAI) systems...Permanent employmentFlexible hours$135k - $170k per year
...General Information: Job Title: AI Engineer Location: Toronto, ON (Onsite/Hybrid)... ...critical AI features Define and implement evaluation frameworks Optimize systems for... ...Thrive We support remote and hybrid work models by offering multiple office locations to...Long term contractFull timeInternshipWork at officeImmediate startRemote workFlexible hours$75k - $95k per year
...range of functions to implement and solve data engineering challenges? Are you equally skilled at... ...building and maintaining the data pipelines, models, and infrastructure that deliver reliable... ..., you are welcome here. We may use AI to support our hiring process. While these...Full timeInternshipWork at officeFlexible hours$101k - $169k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133157 Primary Location: Toronto, ON All Available Locations... ...degree is required. Hands-on experience in utilizing data analytics and AI-ML (artificial intelligence-machine learning) methodologies to...Permanent employmentManual laborFlexible hours- ...Sensor Modeling & Simulation Engineer (M&S) Preferred Location: Ottawa or Toronto Reports to: Head of... ..., TDOA/FDOA geolocation). Synthetic-data or RL training pipelines; integrating models... ...granted based on impact We use AI tools to support parts of the hiring...Full time
$72k - $138k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 131564 Primary Location... ...like? As a Senior Consultant on the AI & Data Transformation team, you will operate at... ...cross-functional teams of data scientists, engineers, designers, and consultants to deliver...Permanent employmentFlexible hours$84k - $175k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133810... ...design and implementation of AI-powered applications and agents... ...including: o Prompt engineering o Retrieval-Augmented Generation... ...deployment o Integration with data platforms (Fabric, Databricks,...Permanent employmentFlexible hours$68k - $72k per year
...fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35... ..., including workflow development, data tracking, analysis, and reporting. ~... ...As part of our recruitment process, we use AI-enabled tools to assist with summarizing applicant...Full timeInternshipWork at officeFlexible hoursWeekend work- ...intelligence. Leading infrastructure vendors, engineering firms, and construction companies use... .... Citylitics combines a network of AI agents, fine-tuned models, a proprietary infrastructure signals... ...seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly...Full timeWork at officeImmediate start3 days per week
- ...Req ID: 353881 NTT DATA strives to hire exceptional, innovative and passionate individuals... .... We are currently seeking a Agentic AI Engineer to join our team in toronto, Ontario (CA-... ...orchestration) Develop classical ML models (risk scoring, prediction, clustering,...Work at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - AI Model Evaluation. Be the first to apply!
Related searches
- data centre engineer Toronto, ON
- data engineering intern summer Toronto, ON
- data integration developer Toronto, ON
- remote data engineer Toronto, ON
- junior data engineer Toronto, ON
- information engineer Toronto, ON
- data cabling engineer Toronto, ON
- gcp data engineer Toronto, ON
- big data engineer Toronto, ON
- data engineer Toronto, ON