Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer: AI Code Evaluation (US/Canada)

$90 per hour
Temporary

rustLabs

Pay: Up to $90+/hr

Experienced software engineers review and score AI-written code for frontier AI research teams.

Remote and flexible, up to 40 hours a week. Pay is up to $90+ per hour for the most experienced engineers.

Requirements: several years of professional software engineering experience; you live in the US or Canada and can work as an independent contractor without visa sponsorship.

Process: a two-minute application on rustLabs, then the hiring partner's (Turing) short interest form, a 20 to 25 minute AI interview and a coding challenge. Finish each step within 48 hours.

rustLabs is a talent-sourcing partner: it screens applicants and puts matching profiles forward to its hiring partner. Applying is free.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer: AI Code Evaluation (US/Canada) in Remote vacancy
  •  ...Evaluate and refine AI-generated code for efficiency and reliability. About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing... 
    Senior
    Part time
    For contractors
    Flexible hours

    Turing

    Remote
    29 days ago
  • $100 per hour

     .... Check out this Loom video for more details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role.... 
    Senior
    Contract work
    Remote work
    Worldwide
    Flexible hours

    G2i

    Remote
    10 days ago
  •  ...programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing complex code structures... 
    Suggested
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    29 days ago
  •  ...GitLab to ship better, more secure software faster. The same principles...  ...how our team works: we embrace AI as a core productivity multiplier...  .... Co-create the future with us as we build technology that transforms...  ...An overview of this role As a Senior Backend Engineer on GitLab's... 
    Senior
    Full time
    Live In

    Gitlab

    Remote
    23 days ago
  •  ...What You'll Do Review proposed coding tasks and programming environments for realism...  ...on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying...  ...robust Who Should Apply Professional software engineer based in South Asia... 
    Suggested
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    29 days ago
  • $100 - $150 per hour

     ...Evaluate and improve AI coding models by reviewing generated code. Freelance · Remote · North America (only) About Turing Turing is one of...  ...development through high-quality training data, evaluations, and engineering talent. Engagement Details Compensation: $100-$... 
    Senior
    Hourly pay
    For contractors
    Freelance
    Immediate start
    Remote work

    Turing

    Remote
    29 days ago
  • $80 per hour

     ...Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code. Domain: Software Engineering Research (test generation, program repair,... 
    Contract work
    Remote work

    AfterQuery

    Remote
    3 days ago
  •  ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer (OpenAI Codex, Claude Code or Cursor) based in Canada. We are seeking a highly experienced software engineer to evaluate the quality of... 
    Senior
    Hourly pay
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    1 day ago
  •  ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Software Engineer, AI/ML based in Canada. Join a product-focused engineering team developing advanced AI and machine learning capabilities for a... 
    Senior
    Full time

    Jobgether

    Remote
    2 days ago
  • $125k - $135k per year

     ...! Apply today and find plenty of reasons to SMILE! The Senior Software Developer ( AI/ML) is part of the Smile Labs team in the Product Department...  ...Implement AI/ML solutions with the development team; write code, configure external components and prototype new technology... 
    Senior
    Remplacement
    Full time
    Remote work
    Flexible hours

    Smile Digital Health

    Remote
    1 day ago
  • $120 per hour

     ...Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up SOFTWARE ENGINEER (CANADA) Sign up now Up to $120/hr Depending on the project Bachelor's , Master's , Ph.D's , Postdocs Remote Part-time Flexible hours Opportunity Overview Handshake is... 
    Contract work
    Part time
    Manual labor
    Remote work
    Flexible hours

    Handshake

    Remote
    5 days ago
  •  ...enabling retailers, brands, and shoppers to thrive. The Enterprise AI team develops intelligent systems and capabilities that...  ...Instacart’s business and teams across the company. We are seeking a Senior Software Engineer to join the Enterprise AI team and help build reliable,... 
    Senior
    Long term contract
    Full time
    Work at office
    Work from home
    Flexible hours

    Instacart

    Remote
    2 days ago
  • $40 - $90 per hour

     ...Pay: $40–$90/hr The work Read code produced by AI systems and judge whether it is correct, safe and idiomatic. Write short, precise explanations...  ...paid qualification task shows you the guidelines and shows us you understand them. You work remotely, on your own schedule... 
    Contract work
    Remote work

    HUMXN

    Remote
    27 days ago
  •  ...on what matters most. Affirm's engineering team is building a large-scale...  ...large changes to systems. The AI Platform team owns Affirm's...  ...paved path for building, running, evaluating, and governing AI systems. Our...  ...live, and the next year takes us from developer productivity to... 
    Senior
    Full time

    Affirm

    Remote
    2 days ago
  •  ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Python Senior Software Engineer, AI Training based in Canada. We are seeking an experienced Python Senior Software Engineer to contribute to the evaluation and... 
    Senior
    Hourly pay
    Full time
    Contract work
    Remote work
    Worldwide
    10 hours per week
    Flexible hours

    Jobgether

    Remote
    1 day ago
  • $90 - $100 per hour

     ...Experience: 5 - 10 years Location: United States | Canada + 6 more Open to candidates based in the US, Canada, and LATAM. Role Overview We are hiring a senior independent contractor to design and ship production-grade AI agents that automate real business processes.... 
    Senior
    Full time
    Contract work
    For contractors
    Immediate start
    Remote work

    Braintrust

    Remote
    29 days ago
  •  ...million employees across the world. Join us in our mission to help companies make smarter...  ...trust! About the Role: We are seeking a Software Engineer to build, maintain, and manage our...  ...Temporal workflows, a Python transformation engine, and a customer-facing frontend, following... 
    Full time
    Internship

    Syndio

    Remote
    11 days ago
  • $104k - $139k per year

     ...work focuses on diverse areas including AI, social media, security and more. And...  ...design, build and distribute open-source software that enables people to enjoy the...  ....  About this team and role: As a Senior Software Engineer on the Ecosystem Services Team, you’ll... 
    Senior
    Full time
    Immediate start
    Remote work
    Worldwide
    Home office

    Mozilla

    Remote
    2 days ago
  •  ...infrastructure, and developer workflows that make AI-powered engineering more useful, reliable, and easy for Vanta...  ...the foundations for a more autonomous software development experience at Vanta, including background agents, agent evaluation systems, and tooling that helps engineers... 
    Senior
    Full time

    Vanta

    Remote
    6 days ago
  •  ...What You'll Do You'll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work. Develop...  ...completeness, and professional quality. Develop clear evaluation rubrics and scoring criteria, identifying meaningful... 
    Contract work

    Rise Data Labs

    Remote
    29 days ago
  • $199.8k - $244.2k per year

     ...experienced, product-minded, and resourceful senior backend engineer to own the design, development, and...  ...they drive. At EarnIn, working with AI is expected, not optional. This is a backend...  ...high-quality, maintainable, well-tested code. Design and build highly reliable... 
    Senior
    Full time
    Work at office
    Local area
    2 days per week

    EarnIn

    Remote
    1 day ago
  •  ...Responsibilities Build and ship AI agent features, including...  ...turn telemetry findings into code fixes across customer repositories...  ...across runs. Create evaluations to measure prompt and model quality...  .... Partner with customer engineers on deliveries alongside the Customer... 
    Full time
    Remote work

    Clera

    Remote
    3 days ago
  •  ...Who We Are: Alpaca is a US-headquartered, global leader in agent...  ...a diverse group of experienced engineers, traders, and brokerage professionals...  ...teammates spanning the USA, Canada, Japan, Hungary, Nigeria,...  ...Your Role: We’re looking for a Senior Software Engineer to build the... 
    Senior
    Full time
    Remote work
    Home office

    Alpaca

    Remote
    1 day ago
  •  ...and comparing agent and model evaluation trials. Improve benchmark...  ...and help maintain consistent engineering standards, tests, and error handling...  ...’s degree or higher in Software Engineering, Computer Science...  ...or rubric-based grading, coding agents, MCP, distributed scheduling... 
    Senior
    Full time

    Turing

    Remote
    3 days ago
  • $50 - $100 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...(legal, medical, finance, coding, etc.), where expert-level...  ...velocity. Role Title: Research Engineer - Code Generation & Model... 
    Part time
    For contractors
    Remote work

    micro1

    Remote
    29 days ago
  •  ...leading security-first enterprise AI company. We build cutting-edge...  ...what we build. Each one of us is responsible for contributing...  ...Cohere is a team of researchers, engineers, designers, and more, who are all...  ...patterns, including secure code execution, agent state management... 
    Senior
    Full time
    Manual labor
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Remote
    4 days ago
  • $164.49k - $197.39k per year

     ...Grafana Cloud's actually useful AI, organizations can see,...  ...Capital. Learn more at and follow us on and . We’re scaling fast...  ...are looking for candidates from Canada. Residents of Quebec are not eligible...  ...Grafana Labs is seeking a Senior Engineer (AI & Automation) to own... 
    Senior
    Full time
    Local area
    Remote work
    Flexible hours

    Grafana Labs

    Remote
    10 days ago
  •  ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering... 
    Senior
    Contract work
    Part time
    For contractors
    Freelance
    Manual labor
    Remote work

    Turing

    Remote
    29 days ago
  •  ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer based in Canada. Join a newly established engineering team focused on expanding Unity platform support across Android-powered mobile... 
    Senior
    Full time
    Worldwide

    Jobgether

    Remote
    3 days ago
  • $168k - $177.5k per year

     ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Fulfillment based in Canada. Join a backend engineering team building the critical infrastructure behind large-scale, real-time... 
    Senior
    Permanent employment
    Full time
    Remote work

    Jobgether

    Remote
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer: AI Code Evaluation (US/Canada). Be the first to apply!