Data Engineer - AI Model Evaluation
$80 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Engineer (Coding Agent Experience)
Type: Contract
Compensation: $80/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
- Review model-generated implementations involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems .
- Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic data engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional data engineering experience.
- Experience building ETL pipelines , data warehouses , analytics platforms , or distributed data systems .
- Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
- Ability to evaluate model-generated data infrastructure and pipeline implementations.
Preferred
- Experience operating large-scale data platforms .
Compensation & Legal
- $400 per accepted task .
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer - AI Model Evaluation in Toronto, ON vacancy
$85 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SuggestedRemote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...data analyses , statistical modeling work , machine learning pipelines... ...and A/B test write-ups . Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$85 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: iOS Engineer (Coding Agent Experience) Type... ...AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile application code...SuggestedRemote jobContract workSummer work$80k - $180k per year
...Zafin is an AI platform company helping regulated institutions modernize how critical... ..., an integration platform that connects data, systems, and workflows across complex enterprise... .... What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate,...SuggestedFull time$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...deliverables such as analyses, models, dashboards, and experiment readouts... ...experience with AI training , evaluation, or human-data projects....SuggestedRemote jobContract workSummer work- ...Reference no. R2862231 Position title: Data and AI Engineer Department: Data Engineering I. Location: Toronto, ON About the job... ...(peer validation) Propose and implement relevant data models for each business case Create data models and optimize queries...Full timeWork from homeFlexible hours
$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other... ...Score the quality of musical training data to enhance model performance. Write...Remote jobContract workSummer workImmediate start$95k - $145k per year
Data Modeller Position Description This role is hybrid and requires you to be at a Client... ...modelling and data product design and 25% data engineering enablement. Your future duties and... .... To support our recruitment team, AI tools may be used to help assess applications...Work at office$110k - $160k per year
...a better working world for all. As AI Engineer, you will design and build production-grade... ...workflows, multi-agent coordination, evaluation frameworks, observability and governance... ...AI Architect, AI Platform Engineers, and Data Scientists to translate complex business...Long term contract$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Software / AI / IT / data Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs . Apply deep subject-matter...Remote jobContract workSummer workWork at office- ...· Python · PySpark · SQL · Data Modeling Techniques · ETL/ELT Development... ...data modeling, advanced analytics, data engineering, and product delivery to transform complex... ...platforms to support analytics, reporting, and AI-driven business solutions. · This role...Contract work
- ...Senior AI Data Engineer – Enterprise Data Build It. Scale It. Own It. Sangoma is a global leader in business communications, delivering... ...environment Building data pipelines using Python and SQL Data modeling, transformation, and orchestration tools Modern data...Long term contractFull timeWork from homeWorldwideFlexible hours
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs. Apply deep subject-matter...Remote jobContract workSummer workWork at office$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub... ...scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration...Full timeWorldwide$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or...Remote jobContract workSummer work$85k - $156k per year
...Job Type: Permanent Work Model: Remote Reference code: 134003... ...Deloitte Global is the engine of the Deloitte network. Our professionals... ...We are seeking a Data Domain Modeler to define, standardize... ...human screening combined with AI technology to help identify the...Permanent employmentRemote workFlexible hours- ...Data Architect / Data Modeler – Azure, AWS, Data Warehousing & Informatica CDI Location: Toronto, ON Work Model: Hybrid (... ...Bachelor's Degree in Computer Science, Information Systems, Engineering, or a related discipline. • Azure, AWS, TOGAF, DAMA,...Permanent employmentWork at office2 days per week
$135k - $170k per year
...General Information: Job Title: AI Engineer Location: Toronto, ON (Onsite/Hybrid)... ...critical AI features Define and implement evaluation frameworks Optimize systems for... ...Thrive We support remote and hybrid work models by offering multiple office locations to...Long term contractFull timeInternshipWork at officeImmediate startRemote workFlexible hours$75k - $95k per year
...range of functions to implement and solve data engineering challenges? Are you equally skilled at... ...building and maintaining the data pipelines, models, and infrastructure that deliver reliable... ..., you are welcome here. We may use AI to support our hiring process. While these...Full timeInternshipWork at officeFlexible hours$101k - $169k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133157 Primary Location: Toronto, ON All Available Locations... ...degree is required. Hands-on experience in utilizing data analytics and AI-ML (artificial intelligence-machine learning) methodologies to...Permanent employmentManual laborFlexible hours- ...Sensor Modeling & Simulation Engineer (M&S) Preferred Location: Ottawa or Toronto Reports to: Head of... ..., TDOA/FDOA geolocation). Synthetic-data or RL training pipelines; integrating models... ...granted based on impact We use AI tools to support parts of the hiring...Full time
- ...intelligence. Leading infrastructure vendors, engineering firms, and construction companies use... .... Citylitics combines a network of AI agents, fine-tuned models, a proprietary infrastructure signals... ...seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly...Full timeWork at officeImmediate start3 days per week
$84k - $175k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133810... ...design and implementation of AI-powered applications and agents... ...including: o Prompt engineering o Retrieval-Augmented Generation... ...deployment o Integration with data platforms (Fabric, Databricks,...Permanent employmentFlexible hours$120k - $160k per year
...trusted platforms for financial data access, enrichment, and money... ...data and ML platform that turns models into reliable production services... ...pipelines (Kubeflow on Vertex AI), model serving (FastAPI behind... ..., vérifier les revenus, évaluer le risque de crédit et offrir des...Full timeContract workRemote workFlexible hours$95.3 - $114.37 per hour
...RQ11266 - Data Architect/Modeller - Senior 9 months (176 business days) + Possible extension... ...and related business architecture. AI Disclaimer: Source Code may use artificial... ...to-have qualifications. The client will evaluate candidates based on both rate expectations...Work at officeRemote workHome office- ...that makes this real: a unified AI agent that sells, supports,... ...capabilities, we need to improve how we evaluate, iterate, and operate these... ...and tooling used by AI and engineering teams Reduce manual... ...and Evaluation loops around models to make them safe for production...Long term contractRemplacementFull timeInternshipWork at officeWork from homeShift work
$68k - $72k per year
...fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35... ..., including workflow development, data tracking, analysis, and reporting. ~... ...As part of our recruitment process, we use AI-enabled tools to assist with summarizing applicant...Full timeInternshipWork at officeFlexible hoursWeekend work- ...Analytics is a global leader in AI and analytics, helping Fortune... ...for a highly skilled AI Engineer with 7+ years of experience in... ...APIs, AWS Bedrock, and other model providers. Infrastructure &... ...external API interfacing. 3. Evaluation and Optimization Familiarity...Long term contractLocal area
- ...Analytics is looking for experienced Data Scientists GenAI to join our... ...Science, Machine Learning and AI. We are the trusted analytics... ...strong expertise in GenAI modelling. The ideal candidate will have... ...concepts including LLMs, prompt engineering, retrieval-augmented...Full timeLocal area
$110k - $150k per year
...capital markets with innovative, AI-driven technology and expert... ...are looking for an Applied AI Engineer to join the AI Lab team within... ...Generative AI, Agentic Workflows, and Data Engineering: building LLM-... .... You will prototype quickly, evaluate honestly, and know when something...Full timeInternshipLocal areaRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - AI Model Evaluation. Be the first to apply!
Related searches
- big data engineer Toronto, ON
- data engineer Toronto, ON
- python data engineer Toronto, ON
- information engineer Toronto, ON
- data integration developer Toronto, ON
- gcp data engineer Toronto, ON
- data engineering intern summer Toronto, ON
- junior data engineer Toronto, ON
- data centre engineer Toronto, ON
- data cabling engineer Toronto, ON