Data Engineer - AI Model Evaluation
$80 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Engineer (Coding Agent Experience)
Type: Contract
Compensation: $80/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
- Review model-generated implementations involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems .
- Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic data engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional data engineering experience.
- Experience building ETL pipelines , data warehouses , analytics platforms , or distributed data systems .
- Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
- Ability to evaluate model-generated data infrastructure and pipeline implementations.
Preferred
- Experience operating large-scale data platforms .
Compensation & Legal
- $400 per accepted task .
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Data Engineer - AI Model Evaluation in Toronto, ON vacancy
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type:... ...frontier AI coding agents to complete and evaluate complex data engineering tasks....SuggestedFull timeContract workSummer workRemote work$85 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SuggestedFull timeContract workSummer workRemote work- ...Palona’s AI agents operate in real restaurant environments: noisy phone lines, varied accents, complex menus... ...systems requires more than selecting the newest model. It requires disciplined evaluation, high-quality data, modeling judgment, experimentation, and production...SuggestedLong term contractFull timeTemporary workInternshipImmediate start
- ...inclusive and high-performing culture. The Role: The Data and AI Engineer provides hands on technical expertise across software engineering... ...search, memory, orchestration, guardrails, policy controls, evaluation, and human-in-the-loop patterns. ~ Lead integration...SuggestedPermanent employmentFull timeFlexible hours
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...data analyses , statistical modeling work , machine learning pipelines... ...and A/B test write-ups . Evaluate AI-generated or human-created...SuggestedFull timeContract workSummer workRemote work- ...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly... ...QA / test engineering, with exposure to data/ML systems. ~ Strong Python and data-science...Full timeImmediate start
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...data analyses , statistical modeling work , machine learning pipelines... ..., and technical reports. Evaluate AI-generated or human-created...Remote jobContract workSummer work- ...leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are... ...Cohere is a team of researchers, engineers, designers, and more, who are all... ...Seoul. Join us! Role Overview: Evaluation is critical to making progress in...Full timeWork at officeLocal areaRemote workHome office
- ...Reference no. R2867104 Position title: Lead Data and AI Engineer Department: US Commercial Data Engineering Location: Toronto, ON About the... ...Informatica/IICS experience preferred Advanced SQL and data modeling skills, with working knowledge of Python and scripting...Long term contractWork from home
$102.7k - $137k per year
...Position Title: Engineering Manager, Data AI & Analytics Position Type: Regular - Full-Time Requisition ID: 42289 In every role, McCainers... ...Partner with Data Architects to define and optimize data models, schemas, and database designs Collaborate with data scientists...Full timeWork from home- ...certifications and experience with Azure AI, Power Platform and Microsoft Business Applications... ...We are seeking an experienced Senior Data Engineer to lead the design and delivery of end-to... ...role: you will own architecture and data modeling decisions, build production-grade...
- ...is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation... ...AI prototypes and evaluations • Proficiency in data review for quality assurance • Commitment to...Remote work
$75k - $100k per year
...role: Do you love diving into data, solving complex problems with... ...Scientist, Risk Analytics & Modeling, to work under the direction... ...pipelines, machine learning, and AI to your work Participate in... ...Who you are You bring an engineering mindset and look at risk modeling...Full timeInternshipWork at officeFlexible hours$130k - $180k per year
...they are not able to resolve with the bank or firm, OBSI will investigate at no cost to the consumer. Job Title: Director, Data Engineering and AI Vacancy: New vacancy Salary Range: $130,000 – $180,000 with the placement and offered salary being based on knowledge,...InternshipWork at office- Transform enterprise data solutions as an AI-Aware Data Engineer with Cognizant. Collaborate to design, develop, and optimize data systems for analytics and AI with a hybrid work model. This hybrid role requires expertise in Oracle, PostgreSQL, Azure Data Factory, and C#....
$75k - $100k per year
...role: Do you love diving into data, solving complex problems with... ...Scientist, Risk Analytics & Modeling, to work under the direction... ...pipelines, machine learning, and AI to your work Participate in... ...Who you are You bring an engineering mindset and look at risk modeling...Full timeInternshipWork at officeFlexible hours- ...Description Senior AI Data Engineer – Enterprise Data Build It. Scale It. Own It. Sangoma is a global leader in business communications... ...Building data pipelines using Python and SQL Data modeling, transformation, and orchestration tools Modern data warehouses...Long term contractFull timeWork from homeWorldwideFlexible hours
$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub... ...scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration...Full timeInternship$120k - $130k per year
...our culture. About this Role As a Data Engineer on the Data Science team at OpenTable, you... ...features, partner integrations, and advanced AI initiatives. You will work closely with... ...best practices and data-driven product evaluation. Benefits and Perks Generous paid vacation...Work at officeLocal areaFlexible hours2 days per week$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...deliverables such as analyses, models, dashboards, and experiment readouts... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...Role Responsibilities Evaluate AI-generated artifacts for usability... ...feedback to improve AI model outputs . Collaborate with...Remote jobContract workSummer workWork at office- ...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital... ...Endless possibilities. As a Senior Data Engineer, AI & Agents, you will prepare enterprise domain... ..., Genie); AWS and S3. Pipelines and modelling: SQL, PySpark, dbt, Airflow /...Full timeContract work
- Leverage your expertise as an AI-Aware Data Engineer at Cognizant, focusing on Oracle, PostgreSQL, and Azure solutions in a hybrid work model. Drive impactful data initiatives that support analytics and reporting while collaborating with cross-functional teams. Cognizant is...
$58k - $102k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 135227 Primary... ...typical day look like? As a Consultant in Data Governance – AI and Data, you will support clients in... .... Work with data architects, data engineers, business stakeholders, and other team...Permanent employmentFlexible hours- ...intelligence. Leading infrastructure vendors, engineering firms, and construction companies use... .... Citylitics combines a network of AI agents, fine-tuned models, a proprietary infrastructure signals... ...seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly...Full timeWork at officeImmediate start3 days per week
$72k - $138k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 130069 Primary... ...-- We are looking for a passionate AI Research Engineer to join our team. You will work at the... ...research and product engineering—designing, evaluating, and deploying generative AI (GenAI) systems...Permanent employmentFlexible hours$144k - $188k per year
...personalization for marketers through data-activated content generation and AI decisioning. The world’s most... ...team owns the core recommendations engine and ML platform that powers billions... ...layer that feeds our production ML models. You will work alongside ML engineers...Full time$150k - $190k per year
...next home. ROLE OVERVIEW The engineering team is looking for an AI Engineer who can build the LLM and... ...role is less about traditional ML modelling and more about the hands-on software... ...to LLM-based features — including evaluating and regression-testing prompt and agent...Long term contractFull timeFor contractorsInternshipWork at officeLocal areaSleeping nights$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: Software Engineer Expert Type: Contract... ...Role Responsibilities Evaluate AI-generated artifacts for... ...written feedback to improve AI model outputs . Apply deep subject...Contract workSummer workWork at officeRemote work$140k - $160k per year
...you to join us! About the job - Applied AI Engineer Join the Engineering Team, where you'... ...on. If you like being close to both the model and the metal, this is that job. Our stack... ...made things better. Raise the bar for evaluation across the team - judge design, offline and...Full timeManual laborWork at officeWorldwide1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - AI Model Evaluation. Be the first to apply!
Related searches
- big data engineer Toronto, ON
- remote data engineer Toronto, ON
- data engineering intern summer Toronto, ON
- data engineer Toronto, ON
- gcp data engineer Toronto, ON
- junior data engineer Toronto, ON
- data centre engineer Toronto, ON
- data integration developer Toronto, ON
- data cabling engineer Toronto, ON
- python data engineer Toronto, ON