Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Agentic Ai Optimization Developer

Equifax Canada

API Design Auditing LLMs Microservices Observability PythonResponsibilities
Golden Dataset Curation & Automated EvaluationBuild the "Golden Set": Curate, maintain, and augment high-quality reference datasets (Golden Sets) of documents, user queries, and expected agent trajectories to serve as the ultimate source of truth for testing.Automate Eval Cycles: Design and implement automated, continuous evaluation pipelines to measure agent accuracy, latency, token spend, and fallback reliability before code hits production.Trajectory & Reasoning Auditing: Trace and dissect complex, multi-step agent "thought" processes (e.G., ReAct, Reflection loops) to pinpoint exactly where an agent deviates from its intended logic path.Behavioral Optimization: Refine system prompts, context windows, and few-shot examples to optimize how agents execute complex, multi-step workflows.Tool & Function-Calling Optimization: Fine-tune how agents interact with external APIs, databases, and UiPath RPA workflows-minimizing execution errors, redundant calls, and token overhead.Augment Development: Partner closely with AI Solution Leads and AI Agent Developers to feed evaluation insights back into the development lifecycle, helping them build robust, reusable, and self-correcting agent components.Production Guardrails & Lifecycle Management (LLMOps)Defeat Drift & Hallucinations: Actively monitor deployed agents to identify, troubleshoot, and mitigate semantic drift, prompt injections, infinite execution loops, and hallucinations.Maintain Autonomous Integrity: Implement robust guardrail frameworks to ensure agents maintain reliable, fact-based autonomous decision-making post-deployment in production.RAG & Knowledge Integration: Optimize Domain-Specific Knowledge Bases and Retrieval-Augmented Generation (RAG) pipelines to ensure agents pull from accurate data rather than assumptions.What Experience You NeedExperience: 3+ years of professional experience in software quality engineering, test automation, or data/ML engineering, with a dedicated focus on LLM testing, prompt tuning, or orchestration patterns over the last 1-2 years.Agentic & LLM Frameworks: Proven hands-on experience working with LLM orchestration frameworks (e.G., LangGraph, ADKs or specialized internal SDKs).Function Calling Mastery: Deep understanding of JSON schema design for LLM tool-calling, function-calling, and structured outputs.Advanced Debugging & Automation: Strong background in writing automated test scripts (Python-heavy) and using tracing/observability concepts to debug cascading errors in asynchronous, non-deterministic systems.What Could Set You ApartExperience with AI evaluation and observability platformsLive production experience testing Agentic workflows and GenAI solutionsFamiliarity with Google Cloud AI suite (Vertex & Gemini Enterprise Agent Platform) and UiPath ecosystem (Maestro).Experience utilizing LLMs to securely generate high-quality synthetic data for edge-case testing.Proficiency in Python or TypeScript, with a deep understanding of asynchronous programming, API design, and microservices architecture.Demonstrated learning agility and a proactive approach to mastering new technologies.This is a newly created position.Primary Location:CAN-Toronto-5700 YongeFunction:Function - Tech Dev and Client ServicesSchedule:Full timeAdditional Information
Synopsis of the roleAt Equifax, we are moving past passive AI chat interfaces to build the future of autonomous workflows. We are creating intelligent, self-correcting multi-agent systems that can navigate complex software environments, utilize external tools, and solve open-ended business problems with minimal human intervention. To ensure these systems are safe, reliable, and enterprise-grade, we are seeking an analytical Agentic AI Evaluation & Tuning Engineer .In this role, you will be the guardian of our production AI reliability. You will bridge the gap between raw Large Language Model (LLM) capabilities and flawless autonomous execution. Unlike traditional software testers or prompt engineers, you will focus on the behavior, decision-making logic, tool-use efficiency, and long-term stability of multi-agent architectures. Your mission is to build the automated evaluation frameworks that keep our agents accurate, cost-effective, and hallucination-free.Your Match
How well this role fits your profile.Confirmed H-1B sponsor. The Department of Labor record shows filings under EQUIFAX INC. .Filings 651Approved 94.8%Avg wage $116KFrom public Department of Labor LCA disclosures. Sponsorship history is a signal about the employer, not a commitment on this role.Company Intel
Company Intel#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Agentic Ai Optimization Developer in Winnipeg, MB vacancy
  •  ...At Equifax, we are moving past passive AI chat interfaces to build the future of autonomous...  .... We are seeking a highly skilled Agentic AI Developer to be the core engineer constructing our...  ...ambiguous, non‑linear business problems.Optimize Model Execution: Optimize agentic loops... 
    Suggested
    Long term contract
    Full time
    Temporary work
    Local area

    Equifax Inc.

    Winnipeg, MB
    2 hours ago
  •  ...and execute complex workflows. We're looking for a Senior Agentic AI Developer who can turn these capabilities into reliable, production-...  ...practices Context Engineering methods, including cache hit optimization Retrieval methods: RAG, embeddings, vector search, graph... 
    Suggested
    Internship
    Work at office
    Flexible hours

    Osedea

    Winnipeg, MB
    2 hours ago
  • $140k - $190k per year

     ...successful, the technologies we develop will solve some of the world’s...  ...and ResponsibilitiesAs an AI Developer at Xanadu, you will...  ...build and improve the modeling, optimization, simulation, data processing,...  ...Design, develop, and maintain our agentic AI research system for... 
    Suggested

    Xanadu

    Winnipeg, MB
    2 hours ago
  • Build autonomous AI workflows at Equifax in Toronto using Python, TypeScript, and advanced LLM orchestration across secure cloud environments.As an Agentic AI Developer, you will create production-grade multi-agent systems and stateful graph workflows. You will use LangGraph... 
    Suggested

    Equifax Inc.

    Winnipeg, MB
    2 hours ago
  • Develop agentic AI, MCP servers, and reusable platform capabilities for a private equity-backed dental SaaS company. Work full-time in Calgary or remotely within Canada.The client, represented by Cornerbridge Talent Partners, is building an intelligence layer across clinical... 
    Suggested
    Full time
    Remote work

    Cornerbridge Talent Partners

    Winnipeg, MB
    2 hours ago
  •  ...Matters Our public-sector client is building AI-powered solutions that use AI agents,...  ...integrations and orchestration. As an AI Developer, you will take high-level requirements and...  ...technical solutions. You will combine hands-on agentic AI development with strong backend and... 

    Paralucent Inc

    Winnipeg, MB
    2 hours ago
  • Build agentic AI solutions with Python at Fidelity Investments Canada in a 100% remote Software Developer position. Transform how engineering teams deliver software.As a Software Developer in AI Engineering and SDLC Transformation, you will apply generative AI and agentic engineering... 
    Remote work

    Fidelity Investments Canada

    Winnipeg, MB
    2 hours ago
  •  ...our artificial intelligence initiatives, we want to develop a new generation of applications based on Agentic AI. These solutions go beyond traditional...  ..., APIs, and external systems.Create, maintain, and optimize Docker images.Develop, adapt, and maintain Helm charts... 
    Long term contract
    Full time
    Temporary work

    Thales Canada

    Winnipeg, MB
    2 hours ago
  • $140k - $170k per year

     ...our engineering teams already ships more than twice as fast with AI. Now we're expanding beyond code to everything around it: briefs,...  ...technical possibilities, this is just the beginning. As a Senior AI Developer, you'll join us to shape and build this solution ensuring that we... 
    Long term contract
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide
    Flexible hours
    Shift work

    Workleap

    Winnipeg, MB
    2 hours ago
  • $140k - $170k per year

     ...production agent systems using Claude and AI-assisted development tools; heavy focus...  ...driven iteration. About the RoleSenior AI Developer to design and ship production agent...  ...DescriptionRoleWorkleap is hiring a Senior AI Developer (Agentic Systems) to shape and build production... 
    Full time
    Internship
    Work at office
    Remote work
    Flexible hours

    vibehackers

    Winnipeg, MB
    2 hours ago
  • Lead agentic AI development as a Senior Software Developer with Euna Grants in a hybrid Oakville, Ontario engineering environment. Build scalable software using C# and .NET.This senior developer anchors software supporting the full grants lifecycle for governments and nonprofits... 

    Eunasolutions

    Winnipeg, MB
    2 hours ago
  • $209.55k - $283.51k per year

    Staff Agentic Developer - Data and AI Intelligence Department: Product DevelopmentEmployment Type: Full TimeLocation: Canada - Remote (0002)Reporting To: Nissy Elsa JohnCompensation: CA$209,547 - CA$283,506 / yearDescription This is a flexible position... 
    Full time
    Contract work
    Internship
    Work at office
    Remote work
    Flexible hours

    Vena Solutions

    Winnipeg, MB
    2 hours ago
  •  ...forte utilisation d'outils d'IA pour le développement logiciel (AI-assisted / Agentic Development) est également attendue afin d'accélérer la...  ...DescriptionPortage CyberTech is looking for a passionate Java Full Stack Developer with a strong R&D mindset and solid knowledge of Public Key... 
    Permanent employment
    Full time
    Remote work
    Flexible hours

    Portage CyberTech

    Winnipeg, MB
    2 hours ago
  • A North American software provider is seeking a Senior Developer to design and build AI-native systems that impact business outcomes. The role emphasizes...  ...and distributed systems skills, and a background in agentic coding practices. This position offers a competitive salary... 

    Constellation Dealer Group

    Winnipeg, MB
    2 hours ago
  •  ...Go, and distributed systems expertise for Vena AI, working remotely, hybrid, or in Toronto.As a Staff Agentic Developer, you will drive engineering execution for the runtime...  ...frameworksProduction LLM routing, optimization, reliability, and observability experienceFluency... 
    Remote work

    Vena Solutions

    Winnipeg, MB
    2 hours ago
  •  ...specializing in software development, AI and machine learning,...  ...Learning Software Engineer – GPU & AI Optimization to join our growing...  ...computing platforms.This role involves developing and optimizing machine learning kernels, leveraging agentic AI workflows to improve... 

    Sapphire Stream Technology

    Winnipeg, MB
    2 hours ago
  • We are looking for an Agentic AI Specialist to design, build, and deploy autonomous AI workflows that improve how teams work across engineering...  ..., reflection, autonomous execution, and workflow handoffs.Develop secure tool and API integrations that allow agents to interact safely... 

    Adamson Systems Engineering Inc

    Winnipeg, MB
    2 hours ago
  • $98k - $138k per year

     ...for the healthcare community. As a Lead Agentic AI Engineer, you will work directly with engineers...  ...Enablement, you will be accountable for developing systems that are secure, reliable,...  ...through monitoring, evaluation, optimization, automated delivery practices, and continuous... 
    Permanent employment
    Immediate start

    Urban Ridge Supplies

    Winnipeg, MB
    2 hours ago
  • $200k per year

     ...specializing in data, analytics & AI consulting, dedicated to...  ...Leading the design, build, and optimization of production AI systems - classical...  ...models, LLM applications,and agentic systems - ensuring scalability...  ...: Managing, mentoring, and developing a team of AI & ML engineers;... 
    Manual labor

    Welcome to the Jungle

    Winnipeg, MB
    2 hours ago
  • AI Architect - Agentic Systems - 26-01384100% Remote in Canada6+ Months DurationT4 or C2C*Must Reside...  ...agents, multi-agent orchestration) Develop classical ML models (risk scoring, prediction...  ...agent logic Deploy, monitor, and optimize AI systems in Azure Basic... 
    Hourly pay
    Long term contract
    Temporary work
    Apprenticeship
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...Assistance Program Role overviewThe Agentic AI Platform Specialist is responsible for the...  ..., frameworks, and services used to develop, deploy, manage, monitor, and retire AI...  ...practices. Experience with AI FinOps/cost optimization, model evaluation, agent performance measurement... 
    Flexible hours
    Shift work

    Bombardier Inc.

    Winnipeg, MB
    2 hours ago
  • Senior Java Backend Developer – Java, Distributed Systems, Agentic AI Senior Java Backend Developer – Core Java, Distributed Systems, Agentic AIStrong expertise in Core Java development, with a proven track record of building production-grade backend systemsExperience designing... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    2 hours ago
  • Agentic AI Expert at Rodeo FX . Repeatedly voted one of Montreal’s Top Employers and Employer of the Year for the 2022 Mercuriades...  ...integrations that follow software engineering best practices. Develop reusable, scalable components so new Agentic AI use cases can be... 
    Permanent employment
    Full time
    Contract work
    Local area
    Flexible hours
    3 days per week

    Rodeo FX

    Winnipeg, MB
    2 hours ago
  • $175k - $225k per year

     ...s Good. POSITION SUMMARYToronto’s AI Lab is seeking a Lead Agentic AI Researcher to drive the development...  ...and long-horizon consistency. Develop personalized inference control via activation...  ...shift. Enjoy tuning and optimizing large multimodal models and have experience... 
    Long term contract
    Worldwide
    Work visa
    Shift work

    LG Electronics Canada

    Winnipeg, MB
    2 hours ago
  •  ...that takes advantage of a new generation of AI capabilities. From intelligent assistants...  ...and business systems, we're exploring how Agentic AI can solve real problems for our clients. We're looking for an Agentic AI Developer who enjoys building software, experimenting... 
    Work at office
    Flexible hours

    Osedea

    Winnipeg, MB
    2 hours ago
  •  ...approach and leverages quantitative and qualitative insights to optimize the experience and make business decisions. About the LocationCollaborative...  ...success. 5+ years of experience as a Front-end or UX Developer required.UX Optimization DeveloperWe are seeking a UX... 
    Seasonal work
    Work at office
    Remote work
    Work from home
    Home office
    1 day per week

    PetSmart

    Winnipeg, MB
    2 hours ago
  • We are seeking a Senior Agentic AI Engineer to design, develop, and deploy production-grade AI applications using Large Language Models (LLMs), Agentic...  ...using embeddings, vector search, and retrieval optimization techniques to deliver accurate, relevant, and grounded... 

    enableIT

    Winnipeg, MB
    2 hours ago
  •  ...steps. Our partner is looking for an AI Engineer (Agentic Systems) based in Canada. Join a high...  .... Accountabilities Architect, develop, and deploy complex agentic systems, including...  ...strong foundations in statistics, optimization, and machine learning to solve complex... 

    Jobgether

    Winnipeg, MB
    2 hours ago
  • Elevate AI solutions with NTT DATA as an AI Architect focused on agentic systems. Design innovative AI workflows across various domains...  ...a talented AI Architect to develop agent-based AI systems,...  ...services • Collaborate with SMEs to optimize workflows Requirements: • 8+ years... 
    Remote work

    NTT DATA

    Winnipeg, MB
    2 hours ago
  • Build production agent systems with Claude and AI-assisted development tools as a Senior AI Developer at Workleap, remotely across Canada.Workleap is hiring a Senior AI Developer focused on agentic systems and production engineering. You will design and ship agents automating... 
    Remote work

    vibehackers

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Agentic Ai Optimization Developer. Be the first to apply!