AI Harness Engineer
Jobgether
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Harness Engineer based in Canada. As an AI Harness Engineer, you will build the systems and integrations that connect people with powerful local AI capabilities. You’ll work at the intersection of AI tooling, agent infrastructure, and peer-to-peer technology, helping create scalable experiences for the next generation of AI assistants. Your work will include developing reusable tools and modules, supporting diverse AI model types and sizes, and building reliable systems for non-deterministic environments. You’ll contribute to the evolution of P2P technology designed to enable local AI at scale. The role combines deep software engineering with experimentation and rapid technical exploration. You’ll join a remote, globally distributed environment where autonomy, technical curiosity, and continuous innovation are highly valued. \n Accountabilities - Build and deliver new features and bug fixes with a strong focus on reliability, performance, and user satisfaction. - Design and develop reusable tools, modules, and integrations that enable new AI capabilities across different model types and sizes. - Build and maintain AI agent harnesses, including tool calling, agent loops, context management, and structured outputs. - Develop evaluation frameworks and testing infrastructure for AI systems with non-deterministic behavior. - Implement and evolve peer-to-peer technology to support local AI and distributed use cases. - Maintain a high-quality codebase through consistent coding standards, code reviews, modular architecture, and automated testing. - Design systems that can reliably handle failures such as network partitions, model errors, timeouts, and retries. - Develop and maintain reusable npm modules and shared software components. - Experiment with new technologies and approaches to continuously expand AI and P2P capabilities. - Collaborate effectively with a globally distributed engineering team while communicating technical ideas clearly.
Requirements - 5+ years of experience building and maintaining production software. - Strong proficiency in JavaScript and TypeScript, including experience modeling complex state across synchronization protocols, agent loops, or similar systems. - Strong ability to write modular, maintainable, and reusable code. - Hands-on experience building AI agent harnesses, including tool calling, context management, agent loops, and structured outputs. - Experience developing evaluation systems and test infrastructure for non-deterministic AI or other complex systems. - Experience creating and managing reusable npm modules. - Strong testing and debugging skills, with a focus on reliability and production quality. - Strong understanding of and practical experience developing and using AI tools. - Deep interest or professional experience with peer-to-peer technologies, networking, or distributed systems. - Experience designing resilient systems that account for network failures, model errors, timeouts, retries, and other failure scenarios. - Contributions to open-source projects related to P2P, networking, AI tooling, or adjacent technologies are valued. - Strong communication skills and the ability to work effectively in a remote, globally distributed environment. - A highly experimental, hands-on mindset with a willingness to continuously test ideas, explore emerging technologies, and solve challenging technical problems. Benefits - Fully remote work environment. - Opportunity to work on emerging AI, agent infrastructure, and peer-to-peer technologies. - Exposure to complex distributed systems and non-deterministic AI applications. - Opportunity to contribute to open-source P2P, networking, and AI tooling ecosystems. - International and globally distributed engineering environment.
- ...all applications and next steps. Our partner is looking for an AI Engineer based in Canada. This is a full-stack AI engineering role focused... ..., including tool integrations, API connectors, evaluation harnesses, and observability instrumentation. - Develop baseline evaluations...SuggestedFull time
$155k - $185k per year
...Thunderbolt is an open-source, cross-platform AI product initiative from the team behind... .... We’re looking for a Staff Product Engineer to help build Thunderbolt as it moves from... ...tools, models, frameworks, or development harnesses, with the ability to explain tradeoffs, limitations...SuggestedRemote jobLong term contractPermanent employmentFull timeFor contractorsLocal areaFlexible hours- ...innovative and strategic solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. Our Co-Innovation... .... ~ Strong LLMOps expertise, including evaluation harnesses, prompt and version management, regression testing, observability...SuggestedFull timeInternshipLocal areaWorldwideWork visa
- ...Company Description Blend is a premier AI services provider, committed to co-... ...fostering innovation for its clients by harnessing world-class people and data-driven strategy... ...Description We are building a team of engineers in Edmonton, AB, Canada to develop a first...SuggestedFull timeInternshipWork at officeWeekend work
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager AI based in Canada. This is a hands-on engineering leadership opportunity focused on building intelligent systems that optimize payment...SuggestedFull time
- ...Our core stack is ASP.NET MVC + MS SQL — battle-tested and ready to evolve. We're looking for true builders: engineers who orchestrate systems, ship production-grade AI, and modernize massive legacy codebases at speed. The Role You'll embed directly in our engineering...Full timeInternshipShift work
- ...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a... ...Ability to build automated, large-scale eval harnesses plus lighter human-in-the-loop A/B tests....Full timeApprenticeshipImmediate start
- ...commercial real estate owners bring their portfolios to net-zero with an AI-driven sustainability, asset, and investment management platform.... ...in our category. The role We're looking for an AI Engineer to build AI-powered features, help teammates do their best work,...Full timeFlexible hours
- ...optimized hardware, software, and increasingly AI, coupled with the patient-centric... ...looking for a Senior Forward Deployed AI Engineer to embed with our clinical, product, and operations... ...-model contracts (AWS Bedrock), eval harness, monitoring, tool registry, prompt guardrails...Full timeWork at office
- ...Question: Great Question is the all-in-one AI customer research platform for... ...in redefining user research Product Engineer (Full-Stack) — Canada, Remote I’m PJ... ...what doesn’t!) Live in an agentic coding harness daily (Claude Code, Codex, Cursor - we don...Full timeLive InRemote workFlexible hoursShift workDay shift
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a AI Architect / AI Engineering Lead based in Canada. This is a senior technical leadership role focused on designing and building production-grade...Full timeContract workManual laborRemote work
- ...team working towards this goal, we would love to hear from you! Role Summary Reporting to the VP, Business Systems, the AI & Automation Engineer is the primary technical person for applying AI and automation to processes performed across Business Systems which includes...Full timeWork at officeLocal areaWork from homeHome officeFlexible hours
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Engineering Manager, Applied AI based in Canada. This role combines hands-on engineering leadership, people management, and applied AI delivery across...Full timeInternshipManual laborRemote work
- ...ABOUT YOU We are looking for a Principal Engineer to take architectural ownership of the... ...individual contributor role on the DevX and AI team, and the decisions you make here — which... ..., AI context). Lead the eval harness architecture: how the team measures whether...Full timeLocal areaWorldwide
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer, AI Systems based in Canada. This is a hands-on AI engineering role focused on building and operating production-grade LLM systems for...Full time
- ...enterprise merchants, enabling businesses to ship direct-from-factory from manufacturing hubs like China to destinations worldwide. As an AI Engineer, you will own the design, development, and deployment of AI-powered systems that make our operations faster, our team smarter, and...Full timeRemote workWorldwide
$180k - $225k per year
...This role sits at the intersection of AI engineering and application development. You’ll build customer-facing features from scratch, while also helping us integrate and scale the AI infrastructure that power them. You're deeply fluent in TypeScript and React, strong enough...Full timeWork at officeRemote work- ...moment, every day. We collaborate and co-create to build intelligent, AI-driven solutions that protect financial payment systems from... ...About the Role We are looking for a Senior Machine Learning / AI Engineer to help design, build, test and deploy machine learning and AI-...Long term contractFull time
- ...organizations that depend on physical operations to harness Internet of Things (IoT) data to develop... ...data! The team will be composed of data engineers, analytics managers and data scientists.... ...and implement data infrastructure for AI/ML initiatives, including building pipelines...Long term contractFull timeManual labor
- ...organizations that depend on physical operations to harness Internet of Things (IoT) data to develop... ...what that future looks like. As Lead AI Architect, GTM Systems, you will set the... ...the patterns that the entire GTM engineering team builds against. You'll be the person...Long term contractFull timeRemote work
$118k - $168k per year
...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of... ...modeling basics. - Strong communication skills - you work with engineers as a partner. Bonus: - Experience with MCP (Model Context...Full timeWork at officeWork from homeFlexible hours$150k - $195k per year
...split between data platform architecture and AI infrastructure. Half your time will go... ...technical standard for the team and mentor the engineers and analysts already here. You will report... ...pipelines, prompt evaluation harnesses, and cost-tracking tooling for our LLM stack...Full timeLocal areaFlexible hours- ...nous connectons les meilleurs talents tech avec des entreprises qui construisent l'avenir. Aujourd'hui, nous recrutons un·e Software Engineer AI pour l'un de nos clients : une scale-up montréalaise à la pointe de l'IA appliquée pour les opérations financières. Qui est...Daily paidPermanent employmentFull timePart timeRemote work
- ...business systems, Fabric/Copilot Data Agents, and other agentic AI interfaces securely query and exchange data with the platform. -... ...Client Engagement - Mentor and provide technical direction to Data Engineers, reviewing code, data models, and designs to raise delivery quality...Full time
- ...MaintainX is the world's leading AI-powered maintenance and asset management platform, serving 14,000+ customers including Duracell, Shell... ...at the point of work. Document Intelligence is the horizontal engine that turns that raw material — any file a customer hands us — into...Full timeImmediate start
$95k per year
...interaction to new heights. Our cutting-edge cloud platform, coupled with AI-driven analytics tools, unlocks the true essence of customer... ...is looking for a highly skilled and experienced Senior Software Engineer, AI to perform a key role in our digital transformation program,...Full timeFlexible hours- ...quality checks — none of it automated, most of it repeated daily. EviSmart's platform exists to replace that. The AI and automation infrastructure is the engine underneath everything: routing decisions, predictive analytics, intelligent process orchestration. The obstacle isn...Full timeWork at officeImmediate startWork from home
- ...Description Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges... ...Everest, ISG, and others.We are looking for a highly skilled AI Engineer with 7+ years of experience in software engineering, with a heavy...Long term contractFull timeLocal area
$130k - $220k per year
...for the 21st century and the age of 5G and IoT, with world class engineering, best-in-class user experience, and features that will define the... ...for someone exceptional to join our team. We’re looking for an AI/ML Engineer who will develop, optimize, and scale machine...Full timeWork from homeFlexible hours$146.25k - $195k per year
...only able to hire employees residing in these provinces. This is Engineering at Lattice Lattice's Engineering team is dedicated to... ...edge solutions that empower people and organizations to thrive. As AI becomes fundamental to every product experience, ensuring those systems...Long term contractFull timeWork at officeRemote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Harness Engineer. Be the first to apply!
