Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Architect

$200k - $220k per year

Harnham

Our client is a high-growth SaaS technology company at the forefront of applying AI to complex, knowledge-intensive workflows. With a strong investment in agentic AI and next-generation automation, they are building scalable, production-ready systems that transform how organizations interact with content, documents, and enterprise knowledge.

This is a rare opportunity for a seasoned AI architect to define the technical foundations of a rapidly evolving AI platform and have a significant impact on the future direction of the business.

RESPONSIBILITIES

  • Lead the design and evolution of the company's agentic AI architecture, establishing standards, patterns, and infrastructure for scalable AI-driven product experiences.
  • Build and enhance critical AI infrastructure across evaluation frameworks, testing systems, observability platforms, tracing capabilities, and production agent execution environments.
  • Design and implement agent orchestration layers, multi-agent workflows, reasoning engines, memory systems, planning frameworks, and adaptive feedback mechanisms.
  • Partner closely with engineering teams to review architecture, identify technical risks, and drive best practices without creating delivery bottlenecks.
  • Establish a robust AI quality framework, including evaluation datasets, grading systems, regression testing, release gates, experimentation platforms, and production feedback loops.
  • Collaborate with engineering, machine learning, and product leaders to make informed architectural decisions and ensure reliable delivery of advanced AI capabilities.
  • Mentor senior engineers through design reviews, architecture discussions, and technical leadership, raising standards across the wider engineering organization.
  • Evaluate emerging advancements in agentic AI and apply them to build scalable, measurable, and impactful solutions.

SKILLS AND EXPERIENCE

Required

  • 10+ years of software engineering experience with substantial expertise designing and delivering production AI systems at Staff, Principal, or equivalent level.
  • Proven experience building and shipping agentic AI products, including multi-agent systems, LLM orchestration, tool-use frameworks, and agent execution environments.
  • Deep expertise in AI evaluation methodologies, including quality rubrics, curated datasets, deterministic and model-based grading, regression testing, and continuous feedback systems.
  • Strong experience with advanced Retrieval-Augmented Generation (RAG) and agentic search architectures, including query decomposition, multi-hop retrieval, hybrid search, reranking, metadata filtering, source routing, evidence validation, citations, and confidence scoring.
  • Strong understanding of large language models, retrieval systems, and modern agent design patterns.
  • Expertise in large-scale systems architecture, cloud-based AI infrastructure, model serving, deployment pipelines, monitoring, and observability.
  • Strong Python development skills and hands-on experience with agent frameworks such as LangChain, LangGraph, Microsoft Agent Framework, or similar technologies.
  • Demonstrated ability to influence and guide engineering organizations of 15-20+ engineers through architecture and technical leadership.

Preferred

  • Experience building agent-based systems within SaaS products focused on content, document management, or enterprise knowledge workflows.
  • Experience with cloud-native machine learning infrastructure on AWS or comparable cloud platforms.
  • Prior experience operating as a Principal Architect, Distinguished Engineer, or Staff-plus technical leader in a fast-growth technology environment.

BENEFITS

  • Competitive base salary of CAD $200,000 - $220,000.
  • Opportunity to shape the future of a cutting-edge AI platform.
  • High-impact individual contributor role with significant technical ownership.
  • Collaborative, innovation-focused engineering culture.
  • Flexible hybrid working environment.
  • Career growth within a rapidly scaling technology organization.

KEY TERMS

Principal AI Infrastructure Architect | Principal Engineer | AI Architecture | Agentic AI | Multi-Agent Systems | LLMs | RAG | Agent Frameworks | LangChain | LangGraph | Microsoft Agent Framework | AI Infrastructure | AI Evaluation | Observability | Tracing | Model Serving | Python | Distributed Systems | SaaS | Machine Learning Platform | AWS | Enterprise AI | Staff Engineer | Principal Architect | AI Quality Engineering | Knowledge Systems | Retrieval Systems | Orchestration Frameworks

#J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal AI Architect in Toronto, ON vacancy
  •  ...36,000 accounting and audit professionals list Caseware as a skill on their LinkedIn profiles! We are seeking a Principal Software Developer – AI Data Architect to drive the technical vision and architectural strategy of Caseware’s AI-Ready Data Platform. This role will... 
    Principal
    Long term contract
    Permanent employment
    Full time
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Caseware

    Toronto, ON
    more than 2 months ago
  •  ...companies around the globe. About the Client Our client is a leading Canadian financial institution seeking a senior AI Solution Architect to join its Solutions Architecture team. The organization is expanding its digital capabilities, integrating strategic business... 
    Suggested
    Long term contract
    Full time
    For contractors
    Internship
    Work at office
    Remote work

    Workana

    Toronto, ON
    14 days ago
  • $208k - $286k per year

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...to you. The Opportunity We are looking for a Product Architect, AI to help define how Auth0 and Okta lead the market in agentic... 
    Suggested
    Long term contract
    Full time
    Local area
    Worldwide
    Flexible hours
    Shift work
    Early shift

    Okta

    Toronto, ON
    11 days ago
  •  ...advisor to Digital Banking & Channel Technology teams. The Associate Principal Architect, Security supports the integration of security by design and...  ...and beyond. As part of our recruitment process, EQ uses AI to help screen, assess, and/or select applicants for this position... 
    Principal
    Hourly pay
    Permanent employment
    Full time
    Internship
    Work at office

    Eq Bank

    Toronto, ON
    more than 2 months ago
  •  ...of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by...  ...create technical champions and deliver impactful results. PRINCIPAL DATA CLOUD ARCHITECT WILL: Run training sessions, workshops, webinars to help... 
    Principal
    Long term contract
    Full time

    Snowflake

    Toronto, ON
    more than 2 months ago
  •  ...Bits In Glass (BIG) is a high-growth AI and automation consulting firm with offices...  ...first pods to many. Work with senior AI architects across our global operating bench to keep...  ...or systems integrator, or a Field CTO or principal architect role at an AI, data, or cloud platform... 
    Permanent employment
    Full time
    Internship

    Bits In Glass

    Toronto, ON
    18 days ago
  • $135k - $165k per year

     ...The Principal, Sales AI Strategy and Execution is a senior individual contributor on Tipalti’s Data team and supporting the Sales organization...  ...experience for both the buyer and the seller. Your objective is to architect and optimize the system and execute on this vision for... 
    Principal
    Full time
    Internship
    Work from home

    Tipalti

    Toronto, ON
    more than 2 months ago
  •  ...About us: Axiomatic AI is building a new class of AI systems designed to reason with the rigor of the scientific method. By combining...  .... Position overview We are seeking an AI Measurement Architect to design the intelligent automation layer of our measurement... 
    Full time
    Flexible hours

    Axiomatic_AI

    Toronto, ON
    more than 2 months ago
  • $120k - $170k per year

     ...found them—and to create a place where our people are proud to Build. Better. About the Role We're looking for a Senior / Principal AI Platform Engineer to build the secure, scalable platform capabilities that enable enterprise AI delivery across our clients'... 
    Principal
    Long term contract
    Permanent employment
    Full time
    Flexible hours

    RAVL

    Toronto, ON
    more than 2 months ago
  •  ...Infosys is seeking a Principal Technology Architect in Banking domain. The resource will be joining our financial services Architecture team, this is...  ...Markets, or Payments. Proven experience driving Cloud, Data, AI, Digital Engineering, and/or technology modernization... 
    Principal
    Internship
    Relocation

    Infosys

    Toronto, ON
    3 days ago
  •  ...Job Summary As a Principal Architect you will serve as a trusted executive advisor responsible for influencing our clients’ cybersecurity transformation...  ...management, and emerging topics related to cybersecurity and AI. ~ Executive Presence: Demonstrable experience in... 
    Principal

    Palo Alto Networks

    Toronto, ON
    15 hours ago
  •  ...Job Description Are you a Principal-level software engineer who enjoys solving complex customer problems while remaining deeply hands...  ...Reuters is looking for a Principal Software Engineer / Architect - AI, CoCounsel Forward Deployed Engineering (FDE) to help design,... 
    Principal
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 days ago
  • $135k - $180k per year

     ...Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed...  ...and at scale. What is the opportunity? As a Principal Azure Platform & Cloud Operations Architect, you will play a hands-on role in strengthening how Zafin... 
    Full time
    Internship

    Zafin

    Toronto, ON
    3 days ago
  • $163k - $203.75k per year

     ...to build truly impactful solutions. As a Senior Business Solution Architect for People at Lyft, you'll eliminate this gap by serving as the...  ...functional business expertise with strong technical acumen, with an AI native approach, enabling you to translate complex business needs... 
    Full time
    Work at office
    3 days per week

    Lyft

    Toronto, ON
    more than 2 months ago
  • $125k - $135k per year

     ...Reporting to the VP, Technology & Application Development, the Principal CRM Developer is the senior hands-on engineer for the technology...  ...them, and applies CAO's engineering standards, including the CAO AI-Native SDLC Engineering Playbook, to the CRM and to the projects... 
    Principal
    Full time
    Manual labor
    Work at office
    Remote work
    Flexible hours
    2 days per week

    Condominium Authority Of Ontario

    Toronto, ON
    10 days ago
  •  ...Long Term Contract Job Purpose As a Principal Platform Architect , you will define the architectural blueprint for our next-generation, high-performance cloud platforms. You will bridge the gap between traditional telecom infrastructure and modern cloud-native environments... 
    Principal
    Long term contract

    InfoVision Inc.

    Toronto, ON
    4 days ago
  • $110k - $160k per year

    Senior / Principal Forward Deployed Engineering & AI Solutions Architect Position Description CGI is seeking an accomplished, independent and commercially astute Senior / Principal Forward Deployed Engineering & AI Solutions Architect to help establish, evolve and deliver... 
    Principal
    Toronto, ON
    9 days ago
  •  ...Who is Litmus Litmus is building the data foundation that powers industrial AI. AI doesn't work without real-world, contextualized data - Litmus makes that data usable. As AI adoption accelerates, most industrial environments still can't access or use their operational... 
    Principal
    Long term contract
    Internship
    Shift work

    Litmus

    Toronto, ON
    2 days ago
  •  ...together! Is this role right for you? Strategy & Responsible AI Governance – Work with the business to define and implement a...  ...readiness for emerging AI regulation across the agentic AI portfolio Architecting a Responsible Agentic Development Platform and Practice Work... 
    Principal
    Long term contract
    Flexible hours

    Tangerine

    Toronto, ON
    2 days ago
  •  ...etc. Firmware Engineer, Principal The  Embedded Software /...  ...next-generation data center, AI/ML, automotive, and compute applications...  ..., and customer delivery  Architecting and implementing embedded C/...  ...Working with IP hardware architects to influence future revisions... 
    Principal
    Remplacement
    Full time

    Qualcomm

    Toronto, ON
    a month ago
  • $191k - $362k per year

     ...Toronto, ON Lightmatter is leading the revolution in AI data center infrastructure, enabling the next giant leaps in human...  ...inventing the future of computing with light! We are hiring a Principal Digital Architect for high-speed photonic (mixed-signal) communication chips.... 
    Principal
    Long term contract
    Full time
    Temporary work
    Immediate start
    Flexible hours

    Lightmatter

    Toronto, ON
    2 days ago
  • $175k - $200k per year

     ...platform, powered by artificial intelligence (AI), reaching more than 63 million people...  ...Health markets (i.e., Pharmacy Retail). As Principal, Solution Engineering , you serve as the...  ...as well as specifically showcasing how we architect, integrate, and deploy LLM-powered agent... 
    Principal
    Full time
    Work at office
    Remote work
    Flexible hours

    League

    Toronto, ON
    more than 2 months ago
  • $140k - $180k per year

     ...people are proud to Build. Better. As a Principal Data Engineering leader at RAVL, you will...  ..., and elevate enterprise-grade data and AI platforms that are secure, scalable, and high...  ...modern cloud-native technologies. Architect and implement scalable batch and streaming... 
    Principal
    Full time
    Remote work

    RAVL

    Toronto, ON
    more than 2 months ago
  • $160k - $220k per year

     ...We're looking for an exceptional backend engineer and hands-on architect to help us scale and connect millions of devices to wireless networks...  ...database technologies ~ Experience integrating and leveraging AI-assisted development tools such as Claude and Opencode to... 
    Principal
    Full time
    Worldwide
    Flexible hours

    Us Mobile

    Toronto, ON
    a month ago
  •  ...won’t just contribute. You’ll make things happen–fast. As a Principal Infrastructure Architect on our Infrastructure Architecture team, you will be the...  ...databases in production. Know the infrastructure demands of AI/ML data workloads (feature stores, vector databases,... 
    Principal
    Remote work
    Worldwide

    ZoomInfo Technologies LLC

    Toronto, ON
    15 hours ago
  •  ..., security-sensitive systems is seeking a Principal Engineer to take significant ownership of...  ...native platform while helping establish an AI-native approach to software delivery—moving...  ...leadership role for someone who can architect and build critical systems, introduce new... 
    Principal
    Internship

    Motion Recruitment

    Toronto, ON
    3 days ago
  •  ...Principal Consultant - AI Infrastructure Services Today, every organization needs to be digital, powered by data, running in a multi-cloud world...  ...Advanced degree preferred (e.g., MBA, MS, MEng) and architect-level certifications (e.g., AWS Solutions Architect Professional... 
    Principal
    Work at office

    Dell

    Toronto, ON
    4 days ago
  • $150k per year

     ...flexibility that’s recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful work of your career and see your...  ...collections range from thousands to millions of records. As a Principal AI Platform Engineer, you will design and build the platform our... 
    Principal
    Long term contract
    Local area

    Legaltech Hub, Inc.

    Toronto, ON
    4 days ago
  • $175k - $210k per year

     ...Description General Information: Job Title: Principal Engineer - Zynque Location: Toronto (Onsite/ Hybrid) Job Type: Full-Time...  ...or logistics systems exposure (WMS, OMS, TMS, EDI integrations) AI-assisted engineering workflows; AI is deeply embedded in how we... 
    Principal
    Long term contract
    Full time
    Internship
    Live In
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Fulfillment IQ

    Toronto, ON
    more than 2 months ago
  •  ...Job Description What is the opportunity? We’re looking for an experienced Senior Principal AI Engineer who will bring strategic leadership and deep subject-matter expertise in designing and implementing enterprise-scale AI/ML infrastructure, automation tools (MLOps and DevOps... 
    Principal
    Full time
    Internship
    Early shift

    rbc

    Toronto, ON
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Architect. Be the first to apply!