Data Engineer - AI Model Evaluation

$80 per hour

Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Data Engineer (Coding Agent Experience)

Type: Contract

Compensation: $80/hour

Location: Remote

Role Responsibilities

Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
Review model-generated implementations involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems .
Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
Compare outputs from multiple frontier models and assess their strengths and weaknesses.
Apply professional engineering judgment to realistic data engineering scenarios.

Qualifications

Must-Have

2+ years of professional data engineering experience.
Experience building ETL pipelines , data warehouses , analytics platforms , or distributed data systems .
Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
Ability to evaluate model-generated data infrastructure and pipeline implementations.

Preferred

Experience operating large-scale data platforms .

Compensation & Legal

$400 per accepted task .
Compensation is tied to accepted work.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on jobs.jobcopilot.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 15 hours ago

Similar jobs that could be interesting for youBased on the Data Engineer - AI Model Evaluation in Toronto, ON vacancy

Data Engineer - AI Model Evaluator
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type:... ...frontier AI coding agents to complete and evaluate complex data engineering tasks....
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
15 hours ago
DevOps Engineer - AI Model Evaluator
$85 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
15 hours ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...data analyses , statistical modeling work , machine learning pipelines... ...and A/B test write-ups . Evaluate AI-generated or human-created...
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
15 hours ago
AI Evaluation Engineer (QA)
...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly... ...QA / test engineering, with exposure to data/ML systems. ~ Strong Python and data-science...
Suggested
Full time
Immediate start
Appnovation Technologies
Toronto, ON
15 hours ago
Data Science Expert - AI Evaluation
$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...deliverables such as analyses, models, dashboards, and experiment readouts... ...experience with AI training , evaluation, or human-data projects....
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
15 hours ago
AI Data Engineer
...Description Senior AI Data Engineer – Enterprise Data Build It. Scale It. Own It. Sangoma is a global leader in business communications... ...Building data pipelines using Python and SQL Data modeling, transformation, and orchestration tools Modern data warehouses...
Long term contract
Full time
Work from home
Worldwide
Flexible hours
Sangoma
Toronto, ON
15 hours ago
Senior Data/AI Engineer
$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub... ...scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration...
Full time
Worldwide
Guidepoint
Toronto, ON
15 hours ago
Senior Data Engineer, AI Systems
$144k - $188k per year
...personalization for marketers through data-activated content generation and AI decisioning. The world’s most... ...team owns the core recommendations engine and ML platform that powers billions... ...layer that feeds our production ML models. You will work alongside ML engineers...
Full time
Movable Ink
Toronto, ON
15 hours ago
Senior Data Engineer, AI & Agents
...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital... ...Endless possibilities. As a Senior Data Engineer, AI & Agents, you will prepare enterprise domain... ..., Genie); AWS and S3. Pipelines and modelling: SQL, PySpark, dbt, Airflow /...
Full time
Contract work
Appnovation Technologies
Toronto, ON
15 hours ago
Manager, Risk Data & Model Implementation
...you! The Work The Manager, Risk Data & Model Implementation (“MDMI”) reports to the Director... ..., Mathematical Finance, Statistics, Engineering, Finance, Economics, or equivalent quantitative... ...part of our recruitment process, EQ uses AI to help screen, assess, and/or select...
Hourly pay
Permanent employment
Full time
Internship
Work at office
Eq Bank
Toronto, ON
15 hours ago
Data Evaluator - Fully Remote
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour...
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
15 hours ago
Data Quality Expert - Evaluator
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract... ...structured written feedback to improve AI model outputs . Apply deep subject-matter...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
15 hours ago
Compliance AI Evaluator - Finance
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs. Apply deep subject-matter...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
15 hours ago
Forward Deployed Engineer (Data, ML & AI)
$160k - $180k per year
...Forward Deployed Engineer (Data, ML & AI) Location: Remote Timezone: NA/Eastern Type: Full-time Experience: 10+ Years Role Overview... ...data discovery and schema design to pipeline deployment and model integration—building trust as the customer's lead technical partner...
Remote job
Full time
Immediate start
Flexible hours
Carbon 60
Toronto, ON
15 hours ago
Senior Software Engineer, AI-Native Data Warehouse
$165k - $190k per year
...300+ GPs, unifying technology, data, and fund administration... ...with JunieAI, our purpose-built AI platform, we’re reimagining how... ...role As a Senior Software Engineer at Juniper Square, you're a hands... ...design for complex projects, evaluating tradeoffs and proposing pragmatic...
Remote job
Full time
Internship
Work at office
Local area
Work from home
Juniper Square
Toronto, ON
15 hours ago
Senior Backend Engineer (SaaS, Data & AI)
...Kaseya Kaseya is the leading provider of AI-powered IT management and cybersecurity... .... Job Title: Senior Backend Engineer (SaaS, Data & AI) Why Kaseya? Join a fast-... ...backend features end-to-end, including data modeling, business logic, and system integration...
Long term contract
Full time
Worldwide
Kaseya Careers
Toronto, ON
15 hours ago
Financial Compliance AI Evaluator
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... ...to meet deadlines while improving AI model performance . Qualifications Must...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
15 hours ago
Senior Modeling & Simulation (S&M) Engineer
$150.66k - $175.66k per year
...space-based assets, enabling a new era of data-driven exploration and innovation.... ...five years in a row! As a Senior Modeling & Simulation (M&S) Engineer , you will develop models, tools, and... ...new tools and technology (including AI) to learn, grow, and improve. Success...
Full time
Internship
Work at office
Remote work
Relocation package
Kepler Communications Inc.
Toronto, ON
15 hours ago
Data Science Expert - Evaluation Specialist
$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...deliverables, including analyses, models, dashboards, and experiment readouts... ...with AI training , evaluation, or human-data projects....
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
15 hours ago
Director, Data & AI (Hybrid)
...Your Impact Starts Here We’re looking for a Director, Data & AI to lead our Data Engineering, Data & ML Platform, Data Science, and Applied AI teams.... ...platform and analytics infrastructure to production ML models and AI-powered product experiences. This is a high-impact...
Hourly pay
Long term contract
Full time
Temporary work
Internship
Work at office
Local area
Work from home
Relocation
Flexible hours
Homebase
Toronto, ON
15 hours ago
Sales Engineering Expert - Evaluator
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
15 hours ago
Data Engineer
$75k - $95k per year
...range of functions to implement and solve data engineering challenges? Are you equally skilled at... ...building and maintaining the data pipelines, models, and infrastructure that deliver reliable... ..., you are welcome here. We may use AI to support our hiring process. While these...
Full time
Internship
Work at office
Flexible hours
Financeit
Toronto, ON
15 hours ago
Senior Data Engineer
$120k - $160k per year
...trusted platforms for financial data access, enrichment, and money... ...data and ML platform that turns models into reliable production services... ...pipelines (Kubeflow on Vertex AI), model serving (FastAPI behind... ..., vérifier les revenus, évaluer le risque de crédit et offrir des...
Full time
Contract work
Remote work
Flexible hours
Flinks
Toronto, ON
15 hours ago
AI Engineer
$150k - $160k per year
...Requisition Number: 105712 AI Engineer Location You will have the flexibility to work... ...Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge,... ...Implement prompt strategies, guardrails, and evaluation loops to improve reliability, safety, and...
Full time
Local area
Remote work
Insight
Toronto, ON
15 hours ago
AI Engineer
.... A key part of that vision is Reflow AI, agentic, automation-focused intelligence... .... Experiment with prompt engineering, context tuning, and model orchestration to improve performance and... ...improve models through experimentation, data feedback, and iterative development....
Full time
Part time
Flexible hours
Reflow
Toronto, ON
15 hours ago
Senior AI Engineer
...with the teams and customers who depend on AI — risk, fraud, collections, payments,... ...prove agents are safe and keep them safe as models and data drift. Own the multi-model inference... ...and standards for agentic systems; mentor engineers and partner with ML, product, and security...
Full time
Paytm
Toronto, ON
15 hours ago
AI Engineer
...your career. About the Role The AI Engineer reports to the VP of Engineering and... ...partnership with the VP of Engineering and CTO, evaluating new tools and frameworks as they emerge... ...Enablement Partner with the Data Engineer to ensure agents have reliable,...
Full time
Work at office
FacilityOS
Toronto, ON
15 hours ago
Staff AI Engineer
$170k - $180k per year
...your own. The role We're looking for a Staff AI Engineer to help our engineering teams build, evaluate, and scale AI features across the product — and set... ...technical health high across the product Shape the model and provider strategy, usage patterns, and cost...
Full time
Second job
Maple
Toronto, ON
15 hours ago
Software Engineer, AI
$90k per year
...cloud platform, coupled with AI-driven analytics tools, unlocks... ...of customer sentiment, turning data into actionable insights with... ...skilled and experienced Software Engineer, AI to perform a key role in... ...engineering, data pipelines, evaluation, and production operations. You...
Full time
Flexible hours
Calabrio, Inc.
Toronto, ON
15 hours ago
Backend AI Engineer
...Nexxa is building the best AI systems for heavy industries — enabling... ...We're looking for Backend AI Engineers to design, build, and own the core... ...solutions possible at scale: model-serving pipelines, inference and orchestration layers, data pipelines, and the APIs and microservices...
Long term contract
Full time
Nexxa.ai
Toronto, ON
15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - AI Model Evaluation. Be the first to apply!