Senior Software Engineer, Ai Training - Canada
$100 per hourg2i
Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/weekCheck out this Loom video for more details: 're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.This is not a traditional engineering role. You won't be writing production code. You'll be evaluating something harder: whether the model thinks like a great engineer.What this role actually is
Whether the response makes senseWhether the preamble and reasoning are usefulWhether the output reflects strong engineering judgmentWhether the interaction feels right to an experienced developerWhat you'll be doing
Evaluate AI-generated coding interactions end to endJudge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would thinkAssess the quality of explanations and reasoning, not just the codeDistinguish between levels of response quality (what makes something a 2 vs a 4)Give clear, opinionated feedback in writing on what worked, what didn't, and what felt off or misleadingHelp define what great looks like when working with tools like Cursor, Codex and Claude CodeWhat we mean by taste
Does this feel like something a strong engineer would actually say?Is this explanation helpful, or just technically correct?Is the model guiding the user well, or just dumping output?Would this interaction build or erode trust?Who you are
Senior, Staff or Principal-level engineer (or equivalent experience)Strong background in TypeScript/JavaScript or PythonHands-on experience with at least one of OpenAI Codex, Claude Code or CursorDeep familiarity with modern AI-assisted dev workflowsAble to evaluate code without executing it or reviewing every lineStrong written and spoken English (B2 or above). You'll be writing detailed feedback and recording short video explanations, so this is a hard requirementComfortable giving direct, opinionated feedbackHigh bar for what good engineering looks likeNice to have
Prior exposure to prompt design or evaluation workflowsExperience mentoring senior engineers or defining engineering standardsEngagement details
Rate: $100-$200/hour depending on experience and locationHours: 10-20 hours/week, flexibleDuration: ongoing. Projects run from about two weeks to a few months each, and we offer new ones to evaluators who do wellStart: as soon as you clear the take-home and a project has an open seatProcess: one take-home evaluation exercise with a recorded Loom walkthrough. No interview
#J-18808-Ljbffr
Whether the response makes senseWhether the preamble and reasoning are usefulWhether the output reflects strong engineering judgmentWhether the interaction feels right to an experienced developerWhat you'll be doing
Evaluate AI-generated coding interactions end to endJudge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would thinkAssess the quality of explanations and reasoning, not just the codeDistinguish between levels of response quality (what makes something a 2 vs a 4)Give clear, opinionated feedback in writing on what worked, what didn't, and what felt off or misleadingHelp define what great looks like when working with tools like Cursor, Codex and Claude CodeWhat we mean by taste
Does this feel like something a strong engineer would actually say?Is this explanation helpful, or just technically correct?Is the model guiding the user well, or just dumping output?Would this interaction build or erode trust?Who you are
Senior, Staff or Principal-level engineer (or equivalent experience)Strong background in TypeScript/JavaScript or PythonHands-on experience with at least one of OpenAI Codex, Claude Code or CursorDeep familiarity with modern AI-assisted dev workflowsAble to evaluate code without executing it or reviewing every lineStrong written and spoken English (B2 or above). You'll be writing detailed feedback and recording short video explanations, so this is a hard requirementComfortable giving direct, opinionated feedbackHigh bar for what good engineering looks likeNice to have
Prior exposure to prompt design or evaluation workflowsExperience mentoring senior engineers or defining engineering standardsEngagement details
Rate: $100-$200/hour depending on experience and locationHours: 10-20 hours/week, flexibleDuration: ongoing. Projects run from about two weeks to a few months each, and we offer new ones to evaluators who do wellStart: as soon as you clear the take-home and a project has an open seatProcess: one take-home evaluation exercise with a recorded Loom walkthrough. No interview
#J-18808-Ljbffr
Vacancy posted 40 minutes ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Ai Training - Canada in Winnipeg, MB vacancy
- Engage in cutting-edge AI language model development as a Senior Software Engineer. With Ethos, work remotely and leverage your expertise for impactful software engineering tasks. This role with a leading AI lab seeks a Senior Software Engineer with over 5 years of experience...SeniorTrainingRemote workFlexible hours
- ...code you write could directly shape how the next generation of AI understands and generates software? We're looking for Software Engineers in Calgary to build, evaluate, and improve AI-generated code — helping train AI systems to think like real developers. About The...TrainingHourly payOngoing contractContract workFreelanceManual laborRemote workFlexible hours
- ...experience, many have been successful at Vanta without it. As a Senior Applied AI Engineer at Vanta, you will play a crucial role in shaping Vanta’s... ...This Role At least 7 years of industry experience as a software engineer You’ve shipped LLM-backed products and have...SeniorInternshipRemote workFlexible hours
- ...data to ensure effective delivery across care teams and health systems bringing #BetterGlobalHealth to patients everyday!The Senior Software Developer ( AI/ML) is part of the Smile Labs team in the Product Department and will be responsible for developing the Artificial...SeniorRemplacementRemote work
- ...About Canals Canals builds software for wholesale distributors, helping them operate more efficiently through automation and AI. Our customers are the companies responsible... ...at pace. To keep up, we need senior-level engineers who can move quickly while maintaining...SeniorRemote workFlexible hours
- ...wildfire and extreme weather risk mitigation software. The Company's market-leading solutions, enhanced by AI and machine learning capabilities, provide real... ...Role OverviewWe are hiring a backend-focused Senior Software Engineer to build and optimize the high-performance services...Senior
- Senior Software Engineer Remote role based in Canada. Must work at least 6 hours of overlap with US Eastern Time.What We Do Wagmo is a modern pet healthcare company built around how pet parents actually care for their pets. We partner with employers to provide a complete...SeniorRemote work
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Senior
$127k - $225k per year
Huawei Canada has an immediate permanent opening for a Senior Engineer. About the team: The Computing Data Application Acceleration Lab aims to create a leading... ...team focuses on full-stack innovations, including software-hardware co-design and optimizing data efficiency...SeniorTrainingLong term contractPermanent employmentInternshipLocal areaImmediate start- ...An opportunity exists for a Bridge Engineer-in-Training to become part of our dynamic Transportation... .... Support intermediate and senior team members on transportation projects... ...knowledge of AutoCAD Civil 3D and other design software, including understanding of calculations...SeniorTrainingFull timeContract workFor contractorsSummer workWork at officeLocal area
- Klue Engineering is hiring! We're looking for a Senior Machine Learning Engineer to join our team in Toronto, focusing... ...elevate every day. We’re one of Canada’s Most Admired Corporate Cultures by... ...BlogIgnition Acquisition (2025)Goldpan.Ai Acquisition (2025)Win-Loss...SeniorWork at officeRemote work2 days per week
- ...venture-backed B2B SaaS company building an AI-powered competitive intelligence platform... ...AI-first internally, and its product is trained in part on proprietary data unavailable... ...Toronto.About the role: We're hiring a Senior Software Engineer to build and optimize state-of-...SeniorWork at office
- ...a passionate and driven young engineer looking to make a real impact... ...the guidance and mentorship of senior engineers. Hands-On Experience... ...) as an Engineering-In-Training with EGM. Valid Canadian driver... ...Ability to live and work in Canada. Residing in Winnipeg What...SeniorTrainingFor contractorsLocal areaFlexible hours
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer - AI based in Canada. The Senior Software Engineer will join a small AI Platform team responsible for building production-...SeniorLong term contractRemote work
- ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... ...telemetry, and evaluation platforms. ~ Strong knowledge of software engineering best practices, testing, debugging, and performance...SeniorFull timeInternshipRemote workRelocation
$145k - $183k per year
Job DescriptionToast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful...SeniorFull timeManual laborWork at officeFlexible hours$132.6k - $174k per year
...performance apparel company for yoga, running, training, and other athletic pursuits. Setting the... ...automation, agentic automation, and AI. We partner with business and technology... ...enterprise scale.Core Responsibilities As a Senior Software Engineer – AI Agents, you will lead the...SeniorTrainingLong term contractPermanent employmentPart timeManual labor$190k - $220k per year
Senior Software Engineer, Mobile Platform, Guest App The Senior Software Engineer, Mobile Platform, Guest App role at Owner is a full-time software engineering position open to people based anywhere in Canada. The work is 100% remote in a remote-first company. The role carries...SeniorFull timeLocal areaRemote work- ...leadership. Fleetworthy is shaping the future of fleet readiness with AI-enabled, connected fleet technology that keeps drivers safe,... ...Learn more at fleetworthy.Com .About the role:We're hiring a Senior Software Engineer for the AI Platform team. The team builds AI agents and...SeniorLong term contract
- ...intersection of our people, our customers, and our brands. Senior Applied AI EngineerWho We Are.Newfold Digital is a leading web... ...mark.We are looking for a hand on Senior Applied AI Engineer who combines strong software engineering with practical AI problem solving. You...Senior
- ...of talent at your fingertips. With our AI-powered Global Work Platform™,... ...- we're rethinking what it means for software to work with you, not just for you. Our... ...AI assistant, and we're looking for a Senior Full-Stack AI Engineer who wants to help define what AI-native...SeniorContract workLocal area
- ...shaping the future of fleet readiness with AI-enabled, connected fleet technology that... ...guidance to junior developers Requirements Senior-level full stack developer with Dev Lead... ..., Azure DevOps Familiarity with software ticketing systems or processes, e.g., Jira...SeniorRemote work
$149.6k - $199.6k per year
Job Details Company: Coalition, Inc. Position: Senior Software Engineer, AI Automation Location: Any location, Canada About usCoalition is the world's first Active Insurance provider designed to help prevent digital risk before it strikes. Founded in 2017...SeniorTrainingFixed term contractWork at officeRemote workHome officeFlexible hours$176k - $200k per year
We’re looking for a Senior Software Engineer to join our growing AI organization in Vancouver. Asana is pioneering a new category of technology as the human-agent operating system, doubling down on our AI Suite to move our customers toward expansive, end-to-end intelligent...SeniorLong term contractWork at officeLocal areaWork from homeWorldwide- Drive tech innovation as a Senior Software Engineer with Trader Corporation in Toronto, ON. Influence architectural designs that modernize key automotive... ...fraud resistance. As part of AutoScout24’s Dealertrack Canada, you’ll be pivotal in transforming how we develop and...Senior
$140k - $170k per year
...processes evidence, there's a good chance our software is working behind the scenes. That's been true for over four decades. AI is central to where we're going. Not as a... ...something real. The RoleThe AI Native Senior Software Engineer is a change agent and a driver of value...SeniorTrainingInternshipRemote workWork from home$120 per hour
Review AI-generated code and source materials for coding agent evaluation projects. This Canada-based role offers flexible 20+ hour weeks and up... ...evaluate AI coding agents using software codebases, tickets, and AI-... ...skills. Prior AI training experience is not required.Pay...SeniorTrainingHourly payContract workFor contractorsRemote workFlexible hours$90.49k - $132.71k per year
...empowering better decisions for individuals and those managing money for millions. The RoleWe are seeking a Senior Software Engineer to build the applied systems that bring AI capabilities into production: the data pipelines, LLM integrations, agentic workflows, tool interfaces,...SeniorTrainingInternshipWork at officeWorldwide- Build AI-powered legal solutions as a Senior Software Engineer with Python expertise at Thomson Reuters. Work directly with legal customers and cross-functional teams.On CoCounsel Forward Deployed Engineering, you will design, build, and improve software for legal workflows....SeniorTraining
- Build backend services and AI-powered workflows at Samsara, working flexibly from the United States or Canada on Connected Operations software.As a senior software engineer, you will create agentic solutions for custom detections and workflows. You will work across APIs, backend...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Ai Training - Canada. Be the first to apply!
Related searches
- software developer internship no experience Winnipeg, MB
- software engineer intern Winnipeg, MB
- software developer Winnipeg, MB
- software developer remote Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB
- part time software developer Winnipeg, MB
- junior software engineer Winnipeg, MB
- software engineer part time Winnipeg, MB
- software developer intern Winnipeg, MB
- senior software developer Winnipeg, MB

