Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Gen AI Engineer - LLM, Agentic AI, Knowledge Graphs

Temporary

Astra North Infoteck Inc.

Role: Senior AI Engineer

Work Schedule: Hybrid, Tuesday to Thursday, 8:30 AM to 5:00 PM EST (3 days per week required in office)

We are looking for an experienced and highly motivated Senior AI Engineer to join the Technology Strategy team.

In this role, you will design and build the agentic workflow that breaks a complex analytical engagement into stages, coordinates large language models and tools, and keeps every result grounded in source evidence. You will be accountable for how the system stores and retrieves knowledge, how it exposes its capabilities to other agents and assistants, and how it proves that what it produces is faithful to the source.

Position Responsibilities

You are an expert in agentic systems, knowledge graphs, AI-enabled document generation and rendering, with extensive knowledge in cloud infrastructure, the AI service stack, CI/CD, and observability. You will work closely with engineering and business partners to deliver an AI system that is accurate, explainable, safe to operate, and presentable to the business.

1. Design and build the agentic analysis workflow

• Model a long-running, multi-stage analytical workflow as a sequence of AI-agent steps that can pause, resume, and recover without losing work.

• Orchestrate large language models and tools (retrieval, calculation, rules, and structured extraction) into reliable, traceable steps.

• Engineer prompts and structured-output contracts so each step returns validated, machine-usable results rather than free text.

• Build on an event-sourced service framework (for example, the Akka SDK) where state, decisions, and evidence are persisted at every step.

2. Build and operate the knowledge graph

• Design and run the knowledge graph that stores entities, relationships, and provenance extracted from the source corpus (for example, Neo4j or MongoDB Atlas).

• Build the ingestion and extraction pipeline that turns raw documents into a validated, queryable graph, with every fact citing its source.

• Implement graph-based and vector retrieval (GraphRAG and embeddings) so agents answer from grounded evidence rather than memory.

3. Expose capabilities through open agent interfaces

• Build Model Context Protocol (MCP) tool servers and agent-to-agent (A2A) interfaces, so the system's capabilities are available to external assistants and to larger multi-agent workflows.

• Integrate with MCP-compatible clients and low-code agent builders, for example Microsoft Copilot Studio agents, so business users can query the graph and trigger analysis conversationally.

• Build a conversational interface that answers questions strictly from the grounded knowledge graph.

4. Set a high bar for grounding, evaluation, and safety

• Implement anti-hallucination controls: every output statement traces to a cited source, and anything unsupported is flagged or withheld.

• Build automated evaluation (section-level scoring, regression tests, edge-case coverage, and human-review rubrics) and turn it into clear acceptance criteria.

• Add guardrails for prompt injection, data minimization, and safe output, with explicit human-in-the-loop checkpoints, and produce the evidence that AI and model-governance review will ask for.

5. Get it to production, and keep it there

• Own the path from code to production: build and deployment pipelines, environment configuration, secrets, and access, on an enterprise container and agent-hosting platform.

• Work with the cloud AI building blocks the system depends on: managed model endpoints, search and retrieval, document storage, document intelligence (OCR), and the graph datastore.

• Put logging, metrics, tracing, and alerting across the workflow, define health checks and recovery for long-running jobs that must resume after failure, and watch the cost, latency, and rate limits of model and retrieval calls before they become an incident.

6. Stand behind the deliverables

• Own the data contract between the analytical layer and the rendering layer, so structured output maps cleanly onto rendered components.

• Keep generation deterministic and testable: the same input produces the same document, so a regression fails the build instead of surfacing in a business review.

• Work with the rendering toolchain (for example Apache POI, PDFBox, or pptxgenjs) closely enough to diagnose a broken deliverable, extend a template, and hold the line on structural fidelity: required sections, tables, ordering, and cross-format consistency.

Required Qualifications

• 6-10 years building production software, including recent hands-on delivery of AI or large-language-model systems beyond prototypes.

• Strong JVM engineering (Java; Kotlin or Scala a plus) with solid practices: Git workflows, code review, automated testing, structured logging, and clean design.

• Hands-on experience with modern GenAI patterns: prompt engineering, structured or JSON outputs, tool and function calling, retrieval-augmented generation, and agentic workflows.

• Experience designing and querying a graph or document database (Neo4j and Cypher, or MongoDB Atlas) and using vector search and embeddings for semantic retrieval.

• A track record of owning your own delivery path: you have taken something you built through a pipeline into production and operated it, rather than handing it over.

• Practical experience evaluating non-deterministic systems: test design, quality scoring, regression suites, and translating evaluation into business-ready acceptance criteria.

• Demonstrated ability to design and explain solution architecture (data flow, runtime flow, interfaces, failure modes, and controls) and to explain model behaviour, limitations, and trade-offs in plain language.

Adjacent Areas

• Platform and reliability: a major cloud (Azure preferred), containerized deployment with Docker and Kubernetes, CI/CD, observability, and automated quality gates on a service you ran in production.

• Deliverable generation and

Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Senior Gen AI Engineer - LLM, Agentic AI, Knowledge Graphs in Toronto, ON vacancy
  • $125k - $135k per year

     ...to offer at  . The Opportunity: We’re looking for an AI Engineer, GenAI & Agentic Solutions to join our Data & Analytics Partners team. Reporting...  ...AI, retrieval-augmented generation, intelligent knowledge experiences, and tool-integrated agentic workflows. Working... 
    Suggested
    Full time
    Internship

    Aviso Wealth

    Toronto, ON
    1 day ago
  •  ...About the Company: Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest...  ...? Join us! About the Role As a Staff Agentic AI Engineer at Netomi, you will be a senior individual contributor helping build the core agentic... 
    Senior
    Full time

    Netomi

    Toronto, ON
    1 day ago
  •  ...Senior AI Engineer Location: Toronto, ON | Hybrid (3 days onsite: Tuesday-Thursday, 8:30 AM to 5:00 PM) We are seeking an experienced...  ...objectives. The ideal candidate brings deep expertise in agentic AI systems, knowledge graphs, AI-powered document generation,... 
    Senior
    Contract work
    Internship

    Astra North Infoteck Inc.

    Toronto, ON
    3 days ago
  •  ...— keep reading. About the Role The Agentic AI Foundations team is building the core platform...  ...agent-native operations. As a Software Engineer II on the team, you will help design,...  ...across Socure can build on, working alongside senior and staff engineers who set the... 
    Senior
    Full time
    Internship

    Socure

    Toronto, ON
    1 day ago
  •  ...consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been recognized by...  ...firms, including Forrester and Gartner. We are seeking a Senior Knowledge Graph SME to lead the architecture, design, and implementation of an... 
    Senior
    Full time
    Work at office
    Local area

    Tiger Analytics Inc.

    Toronto, ON
    7 days ago
  •  ...traditional business models into agile, AI-powered ecosystems....  ...looking for a Forward Deployed Engineer to work at the intersection of...  ...harnesses, agent loops, state graphs, tools, context, evaluations, observability...  ...delivery cycles Drive agentic engineering practices across... 
    Senior
    Full time
    Immediate start

    Tribalscale

    Toronto, ON
    1 day ago
  • $130k - $180k per year

     ...We are currently looking for a Senior Full Stack Engineer to join our growing   Web Applications team.   You'll work on complex projects, actively...  ...Management, TCV, Inovia, F-Prime, Golden Ventures, and Google's AI fund, Gradient Ventures, we provide an indispensable tool for... 
    Senior
    Full time
    Home office

    Benchsci

    Toronto, ON
    1 day ago
  •  ...About Us We believe AI will fundamentally transform how people...  ...Position:   As a member of the LLM inference team, you will help...  ...systems, inference engine optimization, and writing high...  ...in software engineering.  ~ Knowledgeable and passionate about machine learning... 
    Senior
    Full time
    Internship
    Flexible hours

    Centml

    Toronto, ON
    1 day ago
  • $100k - $125k per year

     ...We are currently looking for a Software Engineer, Gen AI & Web Apps to join our team. Reporting to the Engineering Manager, you'll work on...  ...concepts (e.g., prompting, RAG workflows, or interacting with LLM APIs). ~ A proactive mindset—you are comfortable asking questions... 
    Full time
    Home office

    Benchsci

    Toronto, ON
    1 day ago
  • $135k - $210k per year

     ...Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based...  ...capabilities that will underpin Guidepoint’s Next-Gen research enablement platform and data...  ...systems, including large language model (LLM) applications and research agents, while ensuring... 
    Senior
    Full time
    Worldwide

    Guidepoint

    Toronto, ON
    1 day ago
  •  ...Gen AI Developer – AWS, Generative AI, LLMs & Amazon Bedrock Location: Toronto- Hybrid: 2 days a week in office Job Description...  ...Retrieval-Augmented Generation (RAG) solutions and prompt engineering techniques. • Utilize AWS AI/ML services such as Amazon Bedrock... 
    Contract work
    Work at office
    2 days per week

    Astra North Infoteck Inc.

    Toronto, ON
    6 days ago
  • $116k - $145k per year

     ...team’s purpose is to serve as the strategic engine of the Commercial organization. By...  ...seeking a technical and strategic Manager, AI & Agentic Workflows to lead the evolution of our Commercial...  ...a proven track record of influencing senior stakeholders and navigating ambiguity.... 
    Senior
    Remote job
    Long term contract
    Full time

    Wealthsimple

    Toronto, ON
    1 day ago
  • $90k - $130k per year

     ...Zafin is an AI platform company helping regulated institutions modernize how critical...  ...scale. What’s the Opportunity?  The AI Knowledge Operations Specialist is responsible for preparing...  ...closely with Industry Consultants, Agent Engineers, AI Evaluation Engineers, and other team... 
    Full time

    Zafin

    Toronto, ON
    1 day ago
  • $160k - $220k per year

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential...  ...for Auth0 customers. The Staff Software Engineer  At Okta, we’re building the next generation...  ...developers and AI-native tooling (e.g., llm.txt) Drive Integration with Emerging AI Frameworks... 
    Full time
    Local area
    Worldwide

    Okta

    Toronto, ON
    1 day ago
  •  ...About the Role We are a small team of AI builders in Paytm Labs. As a Staff AI Platform Engineer, you will work across inference and agentic systems. You will contribute to Paytm'...  ...experience, with 3+ years in AI systems or LLM applications ~ Strong understanding of... 
    Full time

    Paytm

    Toronto, ON
    1 day ago
  •  ...teams and customers who depend on AI — risk, fraud, collections,...  ...— and design, build, and ship agentic systems into their production environments...  ...for agentic systems; mentor engineers and partner with ML, product,...  ..., with 3+ in AI systems or LLM applications, and production systems... 
    Senior
    Full time

    Paytm

    Toronto, ON
    1 day ago
  • $170k - $220k per year

     ...Apply Digital is a global AI-native transformation partner,...  ...elite talent to connect strategy, agentic experiences, technology, and data...  ...APIs across services. Coach engineers on effective agent design, prompt...  ...AI-powered systems, including: LLM integrations (Gemini 3, Claude... 
    Senior
    Long term contract
    Full time
    Internship
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Apply Digital

    Toronto, ON
    1 day ago
  •  ...apply now.\n\nWe are currently seeking a Agentic AI Systems Developer - Remote to join our team...  ...AI, classical ML, and full-stack engineering in regulated environments. \n \n\n\nKey Responsibilities...  ..., RCM automation) \n\n\u2022 Build LLM-powered systems (RAG, tool-calling agents... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Ntt Data

    Toronto, ON
    1 day ago
  •  ...Position: Senior AI Engineer Location: Toronto, ON Job ID#:   RQ11252  Duration: 8 Months Role Overview We are seeking...  ...AI/ML solutions ~ Hands-on experience with Generative AI and LLM-based applications in enterprise environments ~ Experience developing... 
    Senior
    Full time

    Symbiotic Digital

    Toronto, ON
    1 day ago
  • $120k - $170k per year

     ...and Responsibilities: As an AI Specialist at Xanadu, you will...  ...researchers, scientists, engineers, and software developers. By infusing...  ..., develop, and maintain our agentic AI research system for...  ...context/harness engineering, knowledge retrieval, and agent orchestration... 
    Full time

    Xanadu

    Toronto, ON
    1 day ago
  •  ...Competitive Intelligence Klue Engineering is hiring! We're looking for a Senior Software Engineer to join our team...  ...building and optimizing state-of-the-art LLM-powered agents that can reason,...  ..., query understanding, and agentic reasoning loops to deliver fast, accurate... 
    Senior
    Full time
    Work at office

    Klue Inc.

    Toronto, ON
    1 day ago
  • $120k - $160k per year

     ...real outcomes. The Opportunity ShyftLabs is looking for a Senior AI Engineer to sit at the intersection of AI/ML engineering and backend...  ...development skills, someone equally comfortable fine-tuning an LLM integration as they are designing a robust API or event-driven... 
    Senior
    Full time
    Work at office
    3 days per week

    Shyftlabs

    Toronto, ON
    1 day ago
  •  ...Analytics is a global leader in AI and analytics, helping Fortune...  ...looking for a highly skilled  AI Engineer with 7+ years of experience in...  ...implementing complex RAG and Agentic AI architectures. Requirements...  ...integrating Generative AI/LLM APIs, AWS Bedrock, and other model... 
    Long term contract
    Local area

    Tiger Analytics Inc.

    Toronto, ON
    a month ago
  • $167.5k - $235k per year

     ...autonomous cross-functional team to build AI agents that fundamentally...  ...platform that can read operational knowledge, reason about it in context, and execute...  ...consists of fewer than five engineers. The work spans critical areas including LLM-powered agent design, robust backend... 
    Senior
    Long term contract
    Full time
    Casual work
    Internship
    Work at office
    Local area
    Immediate start

    Justworks

    Toronto, ON
    1 day ago
  • $90 per hour

     ...Ontario Canada. Preferably in Toronto. The Role: The Senior Data Engineer will be a core technical contributor on the evaluation team...  ...be responsible for determining whether an enterprise-scale knowledge graph requires a purpose-built graph database or whether PostgreSQL... 
    Senior
    Hourly pay
    Full time
    Fixed term contract
    Remote work
    Flexible hours

    Dept

    Toronto, ON
    1 day ago
  • $130k - $145k per year

     ...the role: We are seeking a highly skilled and passionate Senior DevOps Engineer, AI infrastructure to join our team! You will play a key role in...  ...solutions, including exploring and applying advanced concepts like Agentic AI, within our financial operations.  This role offers a... 
    Senior
    Full time
    Internship
    Work at office
    Flexible hours

    Financeit

    Toronto, ON
    1 day ago
  •  ...uncharted. By combining our expertise across connectivity, AI, security and more, we’ll map a new way forward....  ...to 60% at a typical company. Role Summary As a Senior Software Engineer specializing in agentic applications, you will be a key technical leader and influential... 
    Senior
    Long term contract
    Full time
    Contract work
    Local area

    Rivian and Volkswagen Group Technologies

    Toronto, ON
    1 day ago
  •  ...Principal Data Scientist – (Gen AI, Machine Learning):   Are you energized by the idea of innovating with...  ...solutions for Generative AI, including AI Agents, RAG, Knowledge Bases, Data Mining, Anomaly Detection, and LLM fine-tuning. These innovations power flagship... 
    Senior
    Long term contract
    Full time
    Worldwide
    Shift work

    Extreme Networks

    Toronto, ON
    1 day ago
  •  ...and future generations. As an AI Developer on Xplore's Data & AI...  ...design, build, and deploy the agentic workflows and AI-enabled...  ...Unlike a research-oriented ML engineer focused on model development, or...  ...Demonstrated experience taking LLM-based or agentic applications into... 

    Xplore Inc.

    Toronto, ON
    2 days ago
  •  ...talent at your fingertips. With our AI-powered Global Work Platform™, companies...  ...with you, not just for you. Our AI & Knowledge team is on the front lines of that...  ...AI assistant, and we’re looking for a Senior Full-Stack Software Engineer who wants to help define what AI-native... 
    Senior
    Full time
    Local area
    Flexible hours
    Shift work

    Pebl

    Toronto, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Gen AI Engineer - LLM, Agentic AI, Knowledge Graphs. Be the first to apply!