iOS Engineer - AI Model Evaluator
$85 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: iOS Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex engineering tasks.
- Review model-generated mobile application code for correctness, quality, maintainability, and performance.
- Identify bugs, edge cases, and failure modes in model outputs.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic mobile engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional iOS engineering experience.
- Experience building and maintaining production iOS applications using Swift and modern iOS frameworks .
- Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
- Ability to evaluate model-generated mobile implementations and architectural decisions.
Preferred
- Experience shipping production mobile applications.
Compensation & Legal
- $400 per accepted task
- Typical tasks take approximately 2–3 hours after ramp-up.
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the iOS Engineer - AI Model Evaluator in Toronto, ON vacancy
- ...training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences... ...is a team of researchers, engineers, designers, and more, who are passionate... ...the future! Why this role? Evaluation is critical to making progress...SuggestedFull timeWork at officeRemote workFlexible hours
- ...Senior AI Application Engineer Location: Woodbridge, ON (Hybrid - 3 days onsite per week) Physical... ...with expertise in Large Language Models (LLMs), multi-agent systems, full stack... ...deterministic AI behavior. • Develop evaluation frameworks and testing strategies for...SuggestedContract workWork at office3 days per week
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs . Apply deep subject-matter...SuggestedRemote jobContract workSummer workWork at office- ...We are hiring a Product Engineer to help build the next generation of an AI-native Cloud Security and Compliance platform. This is a high-impact role for someone... ...and governance fundamentals Security threat modeling and adversarial thinking Compliance and audit workflows...Suggested
$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy... ...structured written feedback to improve AI model outputs . Identify nuances, implicit...SuggestedRemote jobContract workSummer work$80k - $90k per year
...Senior Manager, Impact and Evaluation Existing vacancy. No AI used in screening or selection. Founded in 2011 by His Majesty King Charles III, The King’s Trust Canada (TKTC) is a national charity that helps young people build the skills, networks, and experiences they...Full timeFor contractorsCasual workWork at officeAfternoon shift3 days per week$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... ...to meet deadlines while improving AI model performance . Qualifications Must...Remote jobContract workSummer workWork at office$120k - $130k per year
...& DevOps, Data, and Software Engineering, servicing an array of noteworthy... ...Blockchain to Data Science models, Digital Underwriting, mobile-... ...Markets is seeking a highly skilled AI Engineer with deep expertise... ...strategies. Experiment & Evaluate: Oversee end-to-end AI...Long term contractFlexible hours$56k - $84k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133514 Primary Location... ...someone with: Relevant experience in AI/ML domain Knowledge of NLP, LLMs (extractive... ...AI offerings, including testing, evaluating and benchmarking different LLMs and toolchains...Permanent employmentContract workFlexible hours- ...medical system could directly improve how AI advises the next generation of healthcare... ...Medical Doctors and Physicians in Toronto to evaluate and improve AI-generated career guidance —... ...the medical field Create objective evaluation rubrics used to assess AI-generated career...Hourly payOngoing contractLong term contractContract workFreelanceInternshipRemote workFlexible hours
$140k - $192.5k per year
...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential... ...'s talk. The Okta Verify Team The Okta iOS platform team is responsible for building Okta... ...application access.c) The Staff Software Engineer in Test Opportunity We are looking for...Local areaWorldwide- ...Senior Conversation Designer – AI Experiences Location:... ...Partner closely with Product, Engineering, Data, Legal, and Compliance teams... ...Participate in usability testing and evaluate AI response quality to... ...defining content quality metrics or evaluation frameworks Knowledge of...Hourly payContract work
$70 - $80 per hour
...Our company is AI and Data is at the forefront of AI innovation,... ...typical day look like?: As an AI Engineer, you will focus on building,... ...on Kubernetes (EKS). Evaluate and optimize application performance... ...ownership CodePipeline/CI-CD for model deployment REST API...Contract workWork at office$20 per hour
...technical talent with leading AI research labs. Headquartered in... ...Generate high-quality human evaluation data by identifying response strengths... ...of responses. Ensure model responses align with expected... ..., analytics, linguistics, engineering) Preferred Prior experience...Remote jobContract workPart timeSummer work$110k - $150k per year
...capital markets with innovative, AI-driven technology and expert... ...are looking for an Applied AI Engineer to join the AI Lab team within... ...production. You will prototype quickly, evaluate honestly, and know when... ...you, work may also touch NLP, model fine-tuning, synthetic data, or...Full timeInternshipLocal areaRemote workFlexible hours$90k per year
...cloud platform, coupled with AI-driven analytics tools, unlocks... ...skilled and experienced Software Engineer, AI to perform a key role in... ...engineering, data pipelines, evaluation, and production operations. You... ...applications using foundation models, prompt engineering, retrieval...Flexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation... ...asynchronously to meet deadlines and improve AI model performance . Qualifications...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Incident management / reliability / SRE Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs. Apply deep subject-matter expertise...Remote jobContract workSummer workWork at office$82.8k - $154.8k per year
...Group: Data Analytics & Reporting AI Engineer - Decision Science We are seeking an... ...agentic AI solutions powered by large language models (LLMs). The ideal candidate combines... ...post-implementation model analysis to evaluate performance, stability, and business impact...Contract workPart timeWork at office$186k - $266k per year
...a division of Fox Corporation. About the Role As a Senior iOS Engineer at Tubi, you’ll play a critical role on our mobile engineering team... ...regarding audio/video streaming and ad integration. Leverage AI-powered tools and automation solutions to enhance development...Long term contractRemplacementFull timeTemporary workLocal areaFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: IP / trademark / copyright law Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs. Collaborate asynchronously with...Remote jobContract workSummer workWork at office- ...meaningful work-life balance. Being a Senior AI Software Engineer at iManage Means… You are passionate... .... You bring hands-on depth in both model development and the infrastructure... ...AI systems from model development and evaluation through to scalable production serving,...Full timeWork at officeLocal areaWorldwideFlexible hours
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Biology / environmental science Evaluator Type: Contract Compensation... ...structured written feedback to improve AI model outputs. Collaborate with AI research...Remote jobContract workSummer workWork at office$170k - $200k per year
...Position:  AI Platform Engineer (Full Stack) Location: Hybrid, 3x per week in office (Oakville) Structure : FTE, Permanent Pay:... ...containerized execution systems React Native Experience with LLM evaluation frameworks Tech Stack: Python, FastAPI, React,...Long term contractPermanent employmentWork at office$171k - $225k per year
...generation of learning products with AI at the core. Foundation models and agentic systems are central to... ...company. We are looking for a Staff ML Engineer to join our AI engineering team and... ...latency, cost, and safety. Build evaluation and observability frameworks that...Local areaRemote workFlexible hours$100 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Python . Collaborate with leading foundational model AI labs to improve AI model training and evaluation. Work independently and asynchronously to meet...Remote jobHourly payContract workFor contractorsSummer work- ...Position Overview The Director, Data Strategy & AI Enablement is a senior leadership role... ...and decision-making processes. Evaluate and implement emerging technologies, including... ...multidisciplinary team of data analysts, engineers, systems specialists, and IT professionals...
- ...meaningful work-life balance. Being a Staff AI Software Engineer at iManage Means… You are passionate... ...systems, from training and fine-tuning models to deploying and scaling them in... ...production, from model development and evaluation to scalable application design and...Full timeWork at officeLocal areaWorldwideFlexible hours
$190k - $220k per year
...embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code faster... ...tracking KPIs, managing evals after model changes, and continuously improving.... ...do, and you don't build brittle rule engines when the task needs reasoning....Hourly payFlexible hoursShift work- ...worldwide. And we’d love for you to join us! About the job - AI Engineer Join the Engineering Team, where you’ll help shape and build... ...approaches and experimentation frameworks to benchmark model value, measure success, and systematically iterate on prompts and...Work at officeWorldwide1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to iOS Engineer - AI Model Evaluator. Be the first to apply!
