Senior Software Engineer: AI Code Evaluation (US/Canada)
$90 per hourrustLabs
Pay: Up to $90+/hr
Experienced software engineers review and score AI-written code for frontier AI research teams.
Remote and flexible, up to 40 hours a week. Pay is up to $90+ per hour for the most experienced engineers.
Requirements: several years of professional software engineering experience; you live in the US or Canada and can work as an independent contractor without visa sponsorship.
Process: a two-minute application on rustLabs, then the hiring partner's (Turing) short interest form, a 20 to 25 minute AI interview and a coding challenge. Finish each step within 48 hours.
rustLabs is a talent-sourcing partner: it screens applicants and puts matching profiles forward to its hiring partner. Applying is free.
- ...Evaluate and refine AI-generated code for efficiency and reliability. About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing...SeniorPart timeFor contractorsFlexible hours
$100 per hour
.... Check out this Loom video for more details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role....SeniorContract workRemote workWorldwideFlexible hours- ...programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing complex code structures...SuggestedContract workFor contractorsRemote work
- ...GitLab to ship better, more secure software faster. The same principles... ...how our team works: we embrace AI as a core productivity multiplier... .... Co-create the future with us as we build technology that transforms... ...An overview of this role As a Senior Backend Engineer on GitLab's...SeniorFull timeLive In
- ...What You'll Do Review proposed coding tasks and programming environments for realism... ...on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying... ...robust Who Should Apply Professional software engineer based in South Asia...SuggestedContract workFor contractorsRemote work
$100 - $150 per hour
...Evaluate and improve AI coding models by reviewing generated code. Freelance · Remote · North America (only) About Turing Turing is one of... ...development through high-quality training data, evaluations, and engineering talent. Engagement Details Compensation: $100-$...SeniorHourly payFor contractorsFreelanceImmediate startRemote work$80 per hour
...Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code. Domain: Software Engineering Research (test generation, program repair,...Contract workRemote work- ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer (OpenAI Codex, Claude Code or Cursor) based in Canada. We are seeking a highly experienced software engineer to evaluate the quality of...SeniorHourly payFull timeRemote workFlexible hours
- ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Software Engineer, AI/ML based in Canada. Join a product-focused engineering team developing advanced AI and machine learning capabilities for a...SeniorFull time
$125k - $135k per year
...! Apply today and find plenty of reasons to SMILE! The Senior Software Developer ( AI/ML) is part of the Smile Labs team in the Product Department... ...Implement AI/ML solutions with the development team; write code, configure external components and prototype new technology...SeniorRemplacementFull timeRemote workFlexible hours$120 per hour
...Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up SOFTWARE ENGINEER (CANADA) Sign up now Up to $120/hr Depending on the project Bachelor's , Master's , Ph.D's , Postdocs Remote Part-time Flexible hours Opportunity Overview Handshake is...Contract workPart timeManual laborRemote workFlexible hours- ...enabling retailers, brands, and shoppers to thrive. The Enterprise AI team develops intelligent systems and capabilities that... ...Instacart’s business and teams across the company. We are seeking a Senior Software Engineer to join the Enterprise AI team and help build reliable,...SeniorLong term contractFull timeWork at officeWork from homeFlexible hours
$40 - $90 per hour
...Pay: $40–$90/hr The work Read code produced by AI systems and judge whether it is correct, safe and idiomatic. Write short, precise explanations... ...paid qualification task shows you the guidelines and shows us you understand them. You work remotely, on your own schedule...Contract workRemote work- ...on what matters most. Affirm's engineering team is building a large-scale... ...large changes to systems. The AI Platform team owns Affirm's... ...paved path for building, running, evaluating, and governing AI systems. Our... ...live, and the next year takes us from developer productivity to...SeniorFull time
- ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Python Senior Software Engineer, AI Training based in Canada. We are seeking an experienced Python Senior Software Engineer to contribute to the evaluation and...SeniorHourly payFull timeContract workRemote workWorldwide10 hours per weekFlexible hours
$90 - $100 per hour
...Experience: 5 - 10 years Location: United States | Canada + 6 more Open to candidates based in the US, Canada, and LATAM. Role Overview We are hiring a senior independent contractor to design and ship production-grade AI agents that automate real business processes....SeniorFull timeContract workFor contractorsImmediate startRemote work- ...million employees across the world. Join us in our mission to help companies make smarter... ...trust! About the Role: We are seeking a Software Engineer to build, maintain, and manage our... ...Temporal workflows, a Python transformation engine, and a customer-facing frontend, following...Full timeInternship
$104k - $139k per year
...work focuses on diverse areas including AI, social media, security and more. And... ...design, build and distribute open-source software that enables people to enjoy the... .... About this team and role: As a Senior Software Engineer on the Ecosystem Services Team, you’ll...SeniorFull timeImmediate startRemote workWorldwideHome office- ...infrastructure, and developer workflows that make AI-powered engineering more useful, reliable, and easy for Vanta... ...the foundations for a more autonomous software development experience at Vanta, including background agents, agent evaluation systems, and tooling that helps engineers...SeniorFull time
- ...What You'll Do You'll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work. Develop... ...completeness, and professional quality. Develop clear evaluation rubrics and scoring criteria, identifying meaningful...Contract work
$199.8k - $244.2k per year
...experienced, product-minded, and resourceful senior backend engineer to own the design, development, and... ...they drive. At EarnIn, working with AI is expected, not optional. This is a backend... ...high-quality, maintainable, well-tested code. Design and build highly reliable...SeniorFull timeWork at officeLocal area2 days per week- ...Responsibilities Build and ship AI agent features, including... ...turn telemetry findings into code fixes across customer repositories... ...across runs. Create evaluations to measure prompt and model quality... .... Partner with customer engineers on deliveries alongside the Customer...Full timeRemote work
- ...Who We Are: Alpaca is a US-headquartered, global leader in agent... ...a diverse group of experienced engineers, traders, and brokerage professionals... ...teammates spanning the USA, Canada, Japan, Hungary, Nigeria,... ...Your Role: We’re looking for a Senior Software Engineer to build the...SeniorFull timeRemote workHome office
- ...and comparing agent and model evaluation trials. Improve benchmark... ...and help maintain consistent engineering standards, tests, and error handling... ...’s degree or higher in Software Engineering, Computer Science... ...or rubric-based grading, coding agents, MCP, distributed scheduling...SeniorFull time
$50 - $100 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...(legal, medical, finance, coding, etc.), where expert-level... ...velocity. Role Title: Research Engineer - Code Generation & Model...Part timeFor contractorsRemote work- ...leading security-first enterprise AI company. We build cutting-edge... ...what we build. Each one of us is responsible for contributing... ...Cohere is a team of researchers, engineers, designers, and more, who are all... ...patterns, including secure code execution, agent state management...SeniorFull timeManual laborWork at officeLocal areaRemote workHome office
$164.49k - $197.39k per year
...Grafana Cloud's actually useful AI, organizations can see,... ...Capital. Learn more at and follow us on and . We’re scaling fast... ...are looking for candidates from Canada. Residents of Quebec are not eligible... ...Grafana Labs is seeking a Senior Engineer (AI & Automation) to own...SeniorFull timeLocal areaRemote workFlexible hours- ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering...SeniorContract workPart timeFor contractorsFreelanceManual laborRemote work
- ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer based in Canada. Join a newly established engineering team focused on expanding Unity platform support across Android-powered mobile...SeniorFull timeWorldwide
$168k - $177.5k per year
...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Fulfillment based in Canada. Join a backend engineering team building the critical infrastructure behind large-scale, real-time...SeniorPermanent employmentFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer: AI Code Evaluation (US/Canada). Be the first to apply!
- software developer remote Remote
- software design engineer Remote
- software engineer devops Remote
- ingénieur logiciel Remote
- part time software developer Remote
- director software engineering Remote
- software engineer - ai machine learning Remote
- software engineer salary in canada Remote
- software engineer - computer Remote
- software developer internship Remote
