Agentic Ai Optimization Developer
Equifax Canada
API Design Auditing LLMs Microservices Observability PythonResponsibilities
Golden Dataset Curation & Automated EvaluationBuild the "Golden Set": Curate, maintain, and augment high-quality reference datasets (Golden Sets) of documents, user queries, and expected agent trajectories to serve as the ultimate source of truth for testing.Automate Eval Cycles: Design and implement automated, continuous evaluation pipelines to measure agent accuracy, latency, token spend, and fallback reliability before code hits production.Trajectory & Reasoning Auditing: Trace and dissect complex, multi-step agent "thought" processes (e.G., ReAct, Reflection loops) to pinpoint exactly where an agent deviates from its intended logic path.Behavioral Optimization: Refine system prompts, context windows, and few-shot examples to optimize how agents execute complex, multi-step workflows.Tool & Function-Calling Optimization: Fine-tune how agents interact with external APIs, databases, and UiPath RPA workflows-minimizing execution errors, redundant calls, and token overhead.Augment Development: Partner closely with AI Solution Leads and AI Agent Developers to feed evaluation insights back into the development lifecycle, helping them build robust, reusable, and self-correcting agent components.Production Guardrails & Lifecycle Management (LLMOps)Defeat Drift & Hallucinations: Actively monitor deployed agents to identify, troubleshoot, and mitigate semantic drift, prompt injections, infinite execution loops, and hallucinations.Maintain Autonomous Integrity: Implement robust guardrail frameworks to ensure agents maintain reliable, fact-based autonomous decision-making post-deployment in production.RAG & Knowledge Integration: Optimize Domain-Specific Knowledge Bases and Retrieval-Augmented Generation (RAG) pipelines to ensure agents pull from accurate data rather than assumptions.What Experience You NeedExperience: 3+ years of professional experience in software quality engineering, test automation, or data/ML engineering, with a dedicated focus on LLM testing, prompt tuning, or orchestration patterns over the last 1-2 years.Agentic & LLM Frameworks: Proven hands-on experience working with LLM orchestration frameworks (e.G., LangGraph, ADKs or specialized internal SDKs).Function Calling Mastery: Deep understanding of JSON schema design for LLM tool-calling, function-calling, and structured outputs.Advanced Debugging & Automation: Strong background in writing automated test scripts (Python-heavy) and using tracing/observability concepts to debug cascading errors in asynchronous, non-deterministic systems.What Could Set You ApartExperience with AI evaluation and observability platformsLive production experience testing Agentic workflows and GenAI solutionsFamiliarity with Google Cloud AI suite (Vertex & Gemini Enterprise Agent Platform) and UiPath ecosystem (Maestro).Experience utilizing LLMs to securely generate high-quality synthetic data for edge-case testing.Proficiency in Python or TypeScript, with a deep understanding of asynchronous programming, API design, and microservices architecture.Demonstrated learning agility and a proactive approach to mastering new technologies.This is a newly created position.Primary Location:CAN-Toronto-5700 YongeFunction:Function - Tech Dev and Client ServicesSchedule:Full timeAdditional Information
Synopsis of the roleAt Equifax, we are moving past passive AI chat interfaces to build the future of autonomous workflows. We are creating intelligent, self-correcting multi-agent systems that can navigate complex software environments, utilize external tools, and solve open-ended business problems with minimal human intervention. To ensure these systems are safe, reliable, and enterprise-grade, we are seeking an analytical Agentic AI Evaluation & Tuning Engineer .In this role, you will be the guardian of our production AI reliability. You will bridge the gap between raw Large Language Model (LLM) capabilities and flawless autonomous execution. Unlike traditional software testers or prompt engineers, you will focus on the behavior, decision-making logic, tool-use efficiency, and long-term stability of multi-agent architectures. Your mission is to build the automated evaluation frameworks that keep our agents accurate, cost-effective, and hallucination-free.Your Match
How well this role fits your profile.Confirmed H-1B sponsor. The Department of Labor record shows filings under EQUIFAX INC. .Filings 651Approved 94.8%Avg wage $116KFrom public Department of Labor LCA disclosures. Sponsorship history is a signal about the employer, not a commitment on this role.Company Intel
Company Intel#J-18808-Ljbffr
Golden Dataset Curation & Automated EvaluationBuild the "Golden Set": Curate, maintain, and augment high-quality reference datasets (Golden Sets) of documents, user queries, and expected agent trajectories to serve as the ultimate source of truth for testing.Automate Eval Cycles: Design and implement automated, continuous evaluation pipelines to measure agent accuracy, latency, token spend, and fallback reliability before code hits production.Trajectory & Reasoning Auditing: Trace and dissect complex, multi-step agent "thought" processes (e.G., ReAct, Reflection loops) to pinpoint exactly where an agent deviates from its intended logic path.Behavioral Optimization: Refine system prompts, context windows, and few-shot examples to optimize how agents execute complex, multi-step workflows.Tool & Function-Calling Optimization: Fine-tune how agents interact with external APIs, databases, and UiPath RPA workflows-minimizing execution errors, redundant calls, and token overhead.Augment Development: Partner closely with AI Solution Leads and AI Agent Developers to feed evaluation insights back into the development lifecycle, helping them build robust, reusable, and self-correcting agent components.Production Guardrails & Lifecycle Management (LLMOps)Defeat Drift & Hallucinations: Actively monitor deployed agents to identify, troubleshoot, and mitigate semantic drift, prompt injections, infinite execution loops, and hallucinations.Maintain Autonomous Integrity: Implement robust guardrail frameworks to ensure agents maintain reliable, fact-based autonomous decision-making post-deployment in production.RAG & Knowledge Integration: Optimize Domain-Specific Knowledge Bases and Retrieval-Augmented Generation (RAG) pipelines to ensure agents pull from accurate data rather than assumptions.What Experience You NeedExperience: 3+ years of professional experience in software quality engineering, test automation, or data/ML engineering, with a dedicated focus on LLM testing, prompt tuning, or orchestration patterns over the last 1-2 years.Agentic & LLM Frameworks: Proven hands-on experience working with LLM orchestration frameworks (e.G., LangGraph, ADKs or specialized internal SDKs).Function Calling Mastery: Deep understanding of JSON schema design for LLM tool-calling, function-calling, and structured outputs.Advanced Debugging & Automation: Strong background in writing automated test scripts (Python-heavy) and using tracing/observability concepts to debug cascading errors in asynchronous, non-deterministic systems.What Could Set You ApartExperience with AI evaluation and observability platformsLive production experience testing Agentic workflows and GenAI solutionsFamiliarity with Google Cloud AI suite (Vertex & Gemini Enterprise Agent Platform) and UiPath ecosystem (Maestro).Experience utilizing LLMs to securely generate high-quality synthetic data for edge-case testing.Proficiency in Python or TypeScript, with a deep understanding of asynchronous programming, API design, and microservices architecture.Demonstrated learning agility and a proactive approach to mastering new technologies.This is a newly created position.Primary Location:CAN-Toronto-5700 YongeFunction:Function - Tech Dev and Client ServicesSchedule:Full timeAdditional Information
Synopsis of the roleAt Equifax, we are moving past passive AI chat interfaces to build the future of autonomous workflows. We are creating intelligent, self-correcting multi-agent systems that can navigate complex software environments, utilize external tools, and solve open-ended business problems with minimal human intervention. To ensure these systems are safe, reliable, and enterprise-grade, we are seeking an analytical Agentic AI Evaluation & Tuning Engineer .In this role, you will be the guardian of our production AI reliability. You will bridge the gap between raw Large Language Model (LLM) capabilities and flawless autonomous execution. Unlike traditional software testers or prompt engineers, you will focus on the behavior, decision-making logic, tool-use efficiency, and long-term stability of multi-agent architectures. Your mission is to build the automated evaluation frameworks that keep our agents accurate, cost-effective, and hallucination-free.Your Match
How well this role fits your profile.Confirmed H-1B sponsor. The Department of Labor record shows filings under EQUIFAX INC. .Filings 651Approved 94.8%Avg wage $116KFrom public Department of Labor LCA disclosures. Sponsorship history is a signal about the employer, not a commitment on this role.Company Intel
Company Intel#J-18808-Ljbffr
Vacancy posted 45 minutes ago
Similar jobs that could be interesting for youBased on the Agentic Ai Optimization Developer in Winnipeg, MB vacancy
- ...At Equifax, we are moving past passive AI chat interfaces to build the future of autonomous... .... We are seeking a highly skilled Agentic AI Developer to be the core engineer constructing our... ...ambiguous, non‑linear business problems.Optimize Model Execution: Optimize agentic loops...SuggestedLong term contractFull timeTemporary workLocal area
$140k - $190k per year
...successful, the technologies we develop will solve some of the world’s... ...and ResponsibilitiesAs an AI Developer at Xanadu, you will... ...build and improve the modeling, optimization, simulation, data processing,... ...Design, develop, and maintain our agentic AI research system for...Suggested- ...and execute complex workflows. We're looking for a Senior Agentic AI Developer who can turn these capabilities into reliable, production-... ...practices Context Engineering methods, including cache hit optimization Retrieval methods: RAG, embeddings, vector search, graph...SuggestedInternshipWork at officeFlexible hours
- Build autonomous AI workflows at Equifax in Toronto using Python, TypeScript, and advanced LLM orchestration across secure cloud environments.As an Agentic AI Developer, you will create production-grade multi-agent systems and stateful graph workflows. You will use LangGraph...Suggested
- Build agentic AI solutions with Python at Fidelity Investments Canada in a 100% remote Software Developer position. Transform how engineering teams deliver software.As a Software Developer in AI Engineering and SDLC Transformation, you will apply generative AI and agentic engineering...SuggestedRemote work
- ...Matters Our public-sector client is building AI-powered solutions that use AI agents,... ...integrations and orchestration. As an AI Developer, you will take high-level requirements and... ...technical solutions. You will combine hands-on agentic AI development with strong backend and...
- Develop agentic AI, MCP servers, and reusable platform capabilities for a private equity-backed dental SaaS company. Work full-time in Calgary or remotely within Canada.The client, represented by Cornerbridge Talent Partners, is building an intelligence layer across clinical...Full timeRemote work
- ...our artificial intelligence initiatives, we want to develop a new generation of applications based on Agentic AI. These solutions go beyond traditional... ..., APIs, and external systems.Create, maintain, and optimize Docker images.Develop, adapt, and maintain Helm charts...Long term contractFull timeTemporary work
$140k - $170k per year
...our engineering teams already ships more than twice as fast with AI. Now we’re expanding beyond code to everything around it: briefs,... ...technical possibilities, this is just the beginning. As a Senior AI Developer, you’ll join us to shape and build this solution ensuring that we...Long term contractInternshipWork at officeLocal areaRemote workWork from homeWorldwideFlexible hoursShift work$140k - $170k per year
...production agent systems using Claude and AI-assisted development tools; heavy focus... ...driven iteration. About the RoleSenior AI Developer to design and ship production agent... ...DescriptionRoleWorkleap is hiring a Senior AI Developer (Agentic Systems) to shape and build production...Full timeInternshipWork at officeRemote workFlexible hours- Lead agentic AI development as a Senior Software Developer with Euna Grants in a hybrid Oakville, Ontario engineering environment. Build scalable software using C# and .NET.This senior developer anchors software supporting the full grants lifecycle for governments and nonprofits...
$209.55k - $283.51k per year
Staff Agentic Developer - Data and AI Intelligence Department: Product DevelopmentEmployment Type: Full TimeLocation: Canada - Remote (0002)Reporting To: Nissy Elsa JohnCompensation: CA$209,547 - CA$283,506 / yearDescription This is a flexible position...Full timeContract workInternshipWork at officeRemote workFlexible hours- ...forte utilisation d'outils d'IA pour le développement logiciel (AI-assisted / Agentic Development) est également attendue afin d'accélérer la... ...DescriptionPortage CyberTech is looking for a passionate Java Full Stack Developer with a strong R&D mindset and solid knowledge of Public Key...Permanent employmentFull timeRemote workFlexible hours
- A North American software provider is seeking a Senior Developer to design and build AI-native systems that impact business outcomes. The role emphasizes... ...and distributed systems skills, and a background in agentic coding practices. This position offers a competitive salary...
- ...Go, and distributed systems expertise for Vena AI, working remotely, hybrid, or in Toronto.As a Staff Agentic Developer, you will drive engineering execution for the runtime... ...frameworksProduction LLM routing, optimization, reliability, and observability experienceFluency...Remote work
- ...specializing in software development, AI and machine learning,... ...Learning Software Engineer – GPU & AI Optimization to join our growing... ...computing platforms.This role involves developing and optimizing machine learning kernels, leveraging agentic AI workflows to improve...
- Agentic AI Expert at Rodeo FX . Repeatedly voted one of Montreal’s Top Employers and Employer of the Year for the 2022 Mercuriades... ...integrations that follow software engineering best practices. Develop reusable, scalable components so new Agentic AI use cases can be...Permanent employmentFull timeContract workLocal areaFlexible hours3 days per week
- Build production agent systems with Claude and AI-assisted development tools as a Senior AI Developer at Workleap, remotely across Canada.Workleap is hiring a Senior AI Developer focused on agentic systems and production engineering. You will design and ship agents automating...Remote work
- We are looking for an Agentic AI Specialist to design, build, and deploy autonomous AI workflows that improve how teams work across engineering... ..., reflection, autonomous execution, and workflow handoffs.Develop secure tool and API integrations that allow agents to interact safely...
- ...approach and leverages quantitative and qualitative insights to optimize the experience and make business decisions.About the Location... ...success.About the Job 5+ years of experience as a Front-end or UX Developer required. UX Optimization Developer We are seeking a UX...Seasonal workWork at officeRemote workWork from homeHome office1 day per week
$175k - $225k per year
...s Good. POSITION SUMMARYToronto’s AI Lab is seeking a Lead Agentic AI Researcher to drive the development... ...and long-horizon consistency. Develop personalized inference control via activation... ...shift. Enjoy tuning and optimizing large multimodal models and have experience...Long term contractWorldwideWork visaShift work- ...steps. Our partner is looking for an AI Engineer (Agentic Systems) based in Canada. Join a high... .... Accountabilities Architect, develop, and deploy complex agentic systems, including... ...strong foundations in statistics, optimization, and machine learning to solve complex...
$98k - $138k per year
...for the healthcare community. As a Lead Agentic AI Engineer, you will work directly with engineers... ...Enablement, you will be accountable for developing systems that are secure, reliable,... ...through monitoring, evaluation, optimization, automated delivery practices, and continuous...Permanent employmentImmediate start- We are seeking a Senior Agentic AI Engineer to design, develop, and deploy production-grade AI applications using Large Language Models (LLMs), Agentic... ...using embeddings, vector search, and retrieval optimization techniques to deliver accurate, relevant, and grounded...
$200k per year
...specializing in data, analytics & AI consulting, dedicated to... ...Leading the design, build, and optimization of production AI systems - classical... ...models, LLM applications,and agentic systems - ensuring scalability... ...: Managing, mentoring, and developing a team of AI & ML engineers;...Manual labor- AI Architect – Agentic Systems -26-01384 100% Remote in Canada 6+ Months Duration T4 or C2C... ...assistants, triage agents, care pathway optimization, RCM automation) Design agentic AI architectures... ...agents, multi-agent orchestration) Develop classical ML models (risk scoring,...Hourly payLong term contractTemporary workApprenticeshipRemote workFlexible hours
- ...Assistance Program Role overviewThe Agentic AI Platform Specialist is responsible for the... ..., frameworks, and services used to develop, deploy, manage, monitor, and retire AI... ...practices. Experience with AI FinOps/cost optimization, model evaluation, agent performance measurement...Flexible hoursShift work
- Senior Java Backend Developer – Java, Distributed Systems, Agentic AI Senior Java Backend Developer – Core Java, Distributed Systems, Agentic AIStrong expertise in Core Java development, with a proven track record of building production-grade backend systemsExperience designing...
- ...that takes advantage of a new generation of AI capabilities. From intelligent assistants... ...and business systems, we're exploring how Agentic AI can solve real problems for our clients. We're looking for an Agentic AI Developer who enjoys building software, experimenting...Work at officeFlexible hours
- Elevate AI solutions with NTT DATA as an AI Architect focused on agentic systems. Design innovative AI workflows across various domains... ...a talented AI Architect to develop agent-based AI systems,... ...services • Collaborate with SMEs to optimize workflows Requirements: • 8+ years...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Agentic Ai Optimization Developer. Be the first to apply!

