Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Harness Engineer

Full-time

Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Harness Engineer based in Canada. As an AI Harness Engineer, you will build the systems and integrations that connect people with powerful local AI capabilities. You’ll work at the intersection of AI tooling, agent infrastructure, and peer-to-peer technology, helping create scalable experiences for the next generation of AI assistants. Your work will include developing reusable tools and modules, supporting diverse AI model types and sizes, and building reliable systems for non-deterministic environments. You’ll contribute to the evolution of P2P technology designed to enable local AI at scale. The role combines deep software engineering with experimentation and rapid technical exploration. You’ll join a remote, globally distributed environment where autonomy, technical curiosity, and continuous innovation are highly valued. \n Accountabilities - Build and deliver new features and bug fixes with a strong focus on reliability, performance, and user satisfaction. - Design and develop reusable tools, modules, and integrations that enable new AI capabilities across different model types and sizes. - Build and maintain AI agent harnesses, including tool calling, agent loops, context management, and structured outputs. - Develop evaluation frameworks and testing infrastructure for AI systems with non-deterministic behavior. - Implement and evolve peer-to-peer technology to support local AI and distributed use cases. - Maintain a high-quality codebase through consistent coding standards, code reviews, modular architecture, and automated testing. - Design systems that can reliably handle failures such as network partitions, model errors, timeouts, and retries. - Develop and maintain reusable npm modules and shared software components. - Experiment with new technologies and approaches to continuously expand AI and P2P capabilities. - Collaborate effectively with a globally distributed engineering team while communicating technical ideas clearly.

Requirements - 5+ years of experience building and maintaining production software. - Strong proficiency in JavaScript and TypeScript, including experience modeling complex state across synchronization protocols, agent loops, or similar systems. - Strong ability to write modular, maintainable, and reusable code. - Hands-on experience building AI agent harnesses, including tool calling, context management, agent loops, and structured outputs. - Experience developing evaluation systems and test infrastructure for non-deterministic AI or other complex systems. - Experience creating and managing reusable npm modules. - Strong testing and debugging skills, with a focus on reliability and production quality. - Strong understanding of and practical experience developing and using AI tools. - Deep interest or professional experience with peer-to-peer technologies, networking, or distributed systems. - Experience designing resilient systems that account for network failures, model errors, timeouts, retries, and other failure scenarios. - Contributions to open-source projects related to P2P, networking, AI tooling, or adjacent technologies are valued. - Strong communication skills and the ability to work effectively in a remote, globally distributed environment. - A highly experimental, hands-on mindset with a willingness to continuously test ideas, explore emerging technologies, and solve challenging technical problems. Benefits - Fully remote work environment. - Opportunity to work on emerging AI, agent infrastructure, and peer-to-peer technologies. - Exposure to complex distributed systems and non-deterministic AI applications. - Opportunity to contribute to open-source P2P, networking, and AI tooling ecosystems. - International and globally distributed engineering environment.

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the AI Harness Engineer in Remote vacancy
  •  ...all applications and next steps. Our partner is looking for an AI Engineer based in Canada. This is a full-stack AI engineering role focused...  ..., including tool integrations, API connectors, evaluation harnesses, and observability instrumentation. - Develop baseline evaluations... 
    Suggested
    Full time

    Jobgether

    Remote
    8 days ago
  • $155k - $185k per year

     ...Thunderbolt is an open-source, cross-platform AI product initiative from the team behind...  .... We’re looking for a Staff Product Engineer to help build Thunderbolt as it moves from...  ...tools, models, frameworks, or development harnesses, with the ability to explain tradeoffs, limitations... 
    Suggested
    Remote job
    Long term contract
    Permanent employment
    Full time
    For contractors
    Local area
    Flexible hours

    Mozilla

    Remote
    24 days ago
  •  ...innovative and strategic solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. Our Co-Innovation...  .... ~ Strong LLMOps expertise, including evaluation harnesses, prompt and version management, regression testing, observability... 
    Suggested
    Full time
    Internship
    Local area
    Worldwide
    Work visa

    Bounteous

    Remote
    more than 2 months ago
  •  ...Company Description Blend is a premier AI services provider, committed to co-...  ...fostering innovation for its clients by harnessing world-class people and data-driven strategy...  ...Description We are building a team of engineers in Edmonton, AB, Canada to develop a first... 
    Suggested
    Full time
    Internship
    Work at office
    Weekend work

    Blend360

    Remote
    more than 2 months ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager AI based in Canada. This is a hands-on engineering leadership opportunity focused on building intelligent systems that optimize payment... 
    Suggested
    Full time

    Jobgether

    Remote
    4 days ago
  •  ...Our core stack is ASP.NET MVC + MS SQL — battle-tested and ready to evolve. We're looking for true builders: engineers who orchestrate systems, ship production-grade AI, and modernize massive legacy codebases at speed.  The Role  You'll embed directly in our engineering... 
    Full time
    Internship
    Shift work

    Valsoft

    Remote
    a month ago
  •  ...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions...  ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a...  ...Ability to build automated, large-scale eval harnesses plus lighter human-in-the-loop A/B tests.... 
    Full time
    Apprenticeship
    Immediate start

    Appnovation Technologies

    Remote
    a month ago
  •  ...commercial real estate owners bring their portfolios to net-zero with an AI-driven sustainability, asset, and investment management platform....  ...in our category. The role We're looking for an AI Engineer to build AI-powered features, help teammates do their best work,... 
    Full time
    Flexible hours

    Cambio Ai Inc.

    Remote
    a month ago
  •  ...optimized hardware, software, and increasingly AI, coupled with the patient-centric...  ...looking for a Senior Forward Deployed AI Engineer to embed with our clinical, product, and operations...  ...-model contracts (AWS Bedrock), eval harness, monitoring, tool registry, prompt guardrails... 
    Full time
    Work at office

    Prenuvo

    Remote
    12 days ago
  •  ...Question: Great Question is the all-in-one AI customer research platform for...  ...in redefining user research Product Engineer (Full-Stack) — Canada, Remote   I’m PJ...  ...what doesn’t!) Live in an agentic coding harness daily (Claude Code, Codex, Cursor - we don... 
    Full time
    Live In
    Remote work
    Flexible hours
    Shift work
    Day shift

    Great Question

    Remote
    a month ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a AI Architect / AI Engineering Lead based in Canada. This is a senior technical leadership role focused on designing and building production-grade... 
    Full time
    Contract work
    Manual labor
    Remote work

    Jobgether

    Remote
    8 hours ago
  •  ...team working towards this goal, we would love to hear from you!  Role Summary Reporting to the VP, Business Systems, the AI & Automation Engineer is the primary technical person for applying AI and automation to processes performed across Business Systems which includes... 
    Full time
    Work at office
    Local area
    Work from home
    Home office
    Flexible hours

    Magnet Forensics

    Remote
    a month ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Engineering Manager, Applied AI based in Canada. This role combines hands-on engineering leadership, people management, and applied AI delivery across... 
    Full time
    Internship
    Manual labor
    Remote work

    Jobgether

    Remote
    4 days ago
  •  ...ABOUT YOU We are looking for a Principal Engineer to take architectural ownership of the...  ...individual contributor role on the DevX and AI team, and the decisions you make here — which...  ..., AI context). Lead the eval harness architecture: how the team measures whether... 
    Full time
    Local area
    Worldwide

    Xsolla

    Remote
    more than 2 months ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer, AI Systems based in Canada. This is a hands-on AI engineering role focused on building and operating production-grade LLM systems for... 
    Full time

    Jobgether

    Remote
    6 days ago
  •  ...enterprise merchants, enabling businesses to ship direct-from-factory from manufacturing hubs like China to destinations worldwide. As an AI Engineer, you will own the design, development, and deployment of AI-powered systems that make our operations faster, our team smarter, and... 
    Full time
    Remote work
    Worldwide

    Portless

    Remote
    more than 2 months ago
  • $180k - $225k per year

     ...This role sits at the intersection of AI engineering and application development. You’ll build customer-facing features from scratch, while also helping us integrate and scale the AI infrastructure that power them. You're deeply fluent in TypeScript and React, strong enough... 
    Full time
    Work at office
    Remote work

    Durable

    Remote
    more than 2 months ago
  •  ...moment, every day. We collaborate and co-create to build intelligent, AI-driven solutions that protect financial payment systems from...  ...About the Role We are looking for a Senior Machine Learning / AI Engineer to help design, build, test and deploy machine learning and AI-... 
    Long term contract
    Full time

    INETCO Systems Limited

    Remote
    21 days ago
  •  ...organizations that depend on physical operations to harness Internet of Things (IoT) data to develop...  ...data! The team will be composed of data engineers, analytics managers and data scientists....  ...and implement data infrastructure for AI/ML initiatives, including building pipelines... 
    Long term contract
    Full time
    Manual labor

    Samsara

    Remote
    more than 2 months ago
  •  ...organizations that depend on physical operations to harness Internet of Things (IoT) data to develop...  ...what that future looks like. As Lead AI Architect, GTM Systems, you will set the...  ...the patterns that the entire GTM engineering team builds against. You'll be the person... 
    Long term contract
    Full time
    Remote work

    Samsara

    Remote
    more than 2 months ago
  • $118k - $168k per year

     ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of...  ...modeling basics. - Strong communication skills - you work with engineers as a partner.   Bonus: - Experience with MCP (Model Context... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    Remote
    a month ago
  • $150k - $195k per year

     ...split between data platform architecture and AI infrastructure. Half your time will go...  ...technical standard for the team and mentor the engineers and analysts already here. You will report...  ...pipelines, prompt evaluation harnesses, and cost-tracking tooling for our LLM stack... 
    Full time
    Local area
    Flexible hours

    Online Veterinarians

    Remote
    more than 2 months ago
  •  ...nous connectons les meilleurs talents tech avec des entreprises qui construisent l'avenir. Aujourd'hui, nous recrutons un·e Software Engineer AI pour l'un de nos clients : une scale-up montréalaise à la pointe de l'IA appliquée pour les opérations financières. Qui est... 
    Daily paid
    Permanent employment
    Full time
    Part time
    Remote work

    Maplr

    Remote
    more than 2 months ago
  •  ...business systems, Fabric/Copilot Data Agents, and other agentic AI interfaces securely query and exchange data with the platform. -...  ...Client Engagement - Mentor and provide technical direction to Data Engineers, reviewing code, data models, and designs to raise delivery quality... 
    Full time

    Ttecdigital

    Remote
    4 days ago
  •  ...MaintainX is the world's leading AI-powered maintenance and asset management platform, serving 14,000+ customers including Duracell, Shell...  ...at the point of work. Document Intelligence is the horizontal engine that turns that raw material — any file a customer hands us — into... 
    Full time
    Immediate start

    Maintainx

    Remote
    a month ago
  • $95k per year

     ...interaction to new heights. Our cutting-edge cloud platform, coupled with AI-driven analytics tools, unlocks the true essence of customer...  ...is looking for a highly skilled and experienced Senior Software Engineer, AI to perform a key role in our digital transformation program,... 
    Full time
    Flexible hours

    Calabrio, Inc.

    Remote
    a month ago
  •  ...quality checks — none of it automated, most of it repeated daily. EviSmart's platform exists to replace that. The AI and automation infrastructure is the engine underneath everything: routing decisions, predictive analytics, intelligent process orchestration. The obstacle isn... 
    Full time
    Work at office
    Immediate start
    Work from home

    Evismart

    Remote
    more than 2 months ago
  •  ...Description Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges...  ...Everest, ISG, and others.We are looking for a highly skilled  AI Engineer with 7+ years of experience in software engineering, with a heavy... 
    Long term contract
    Full time
    Local area

    Tiger Analytics

    Remote
    more than 2 months ago
  • $130k - $220k per year

     ...for the 21st century and the age of 5G and IoT, with world class engineering, best-in-class user experience, and features that will define the...  ...for someone exceptional to join our team. We’re looking for an AI/ML Engineer who will develop, optimize, and scale machine... 
    Full time
    Work from home
    Flexible hours

    Us Mobile

    Remote
    more than 2 months ago
  • $146.25k - $195k per year

     ...only able to hire employees residing in these provinces. This is Engineering at Lattice Lattice's Engineering team is dedicated to...  ...edge solutions that empower people and organizations to thrive. As AI becomes fundamental to every product experience, ensuring those systems... 
    Long term contract
    Full time
    Work at office
    Remote work
    Work from home

    Lattice

    Remote
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Harness Engineer. Be the first to apply!

Related searches