Senior Gen AI Engineer - LLM, Agentic AI, Knowledge Graphs
Astra North Infoteck Inc.
Role: Senior AI Engineer
Work Schedule: Hybrid, Tuesday to Thursday, 8:30 AM to 5:00 PM EST (3 days per week required in office)
We are looking for an experienced and highly motivated Senior AI Engineer to join the Technology Strategy team.
In this role, you will design and build the agentic workflow that breaks a complex analytical engagement into stages, coordinates large language models and tools, and keeps every result grounded in source evidence. You will be accountable for how the system stores and retrieves knowledge, how it exposes its capabilities to other agents and assistants, and how it proves that what it produces is faithful to the source.
Position Responsibilities
You are an expert in agentic systems, knowledge graphs, AI-enabled document generation and rendering, with extensive knowledge in cloud infrastructure, the AI service stack, CI/CD, and observability. You will work closely with engineering and business partners to deliver an AI system that is accurate, explainable, safe to operate, and presentable to the business.
1. Design and build the agentic analysis workflow
• Model a long-running, multi-stage analytical workflow as a sequence of AI-agent steps that can pause, resume, and recover without losing work.
• Orchestrate large language models and tools (retrieval, calculation, rules, and structured extraction) into reliable, traceable steps.
• Engineer prompts and structured-output contracts so each step returns validated, machine-usable results rather than free text.
• Build on an event-sourced service framework (for example, the Akka SDK) where state, decisions, and evidence are persisted at every step.
2. Build and operate the knowledge graph
• Design and run the knowledge graph that stores entities, relationships, and provenance extracted from the source corpus (for example, Neo4j or MongoDB Atlas).
• Build the ingestion and extraction pipeline that turns raw documents into a validated, queryable graph, with every fact citing its source.
• Implement graph-based and vector retrieval (GraphRAG and embeddings) so agents answer from grounded evidence rather than memory.
3. Expose capabilities through open agent interfaces
• Build Model Context Protocol (MCP) tool servers and agent-to-agent (A2A) interfaces, so the system's capabilities are available to external assistants and to larger multi-agent workflows.
• Integrate with MCP-compatible clients and low-code agent builders, for example Microsoft Copilot Studio agents, so business users can query the graph and trigger analysis conversationally.
• Build a conversational interface that answers questions strictly from the grounded knowledge graph.
4. Set a high bar for grounding, evaluation, and safety
• Implement anti-hallucination controls: every output statement traces to a cited source, and anything unsupported is flagged or withheld.
• Build automated evaluation (section-level scoring, regression tests, edge-case coverage, and human-review rubrics) and turn it into clear acceptance criteria.
• Add guardrails for prompt injection, data minimization, and safe output, with explicit human-in-the-loop checkpoints, and produce the evidence that AI and model-governance review will ask for.
5. Get it to production, and keep it there
• Own the path from code to production: build and deployment pipelines, environment configuration, secrets, and access, on an enterprise container and agent-hosting platform.
• Work with the cloud AI building blocks the system depends on: managed model endpoints, search and retrieval, document storage, document intelligence (OCR), and the graph datastore.
• Put logging, metrics, tracing, and alerting across the workflow, define health checks and recovery for long-running jobs that must resume after failure, and watch the cost, latency, and rate limits of model and retrieval calls before they become an incident.
6. Stand behind the deliverables
• Own the data contract between the analytical layer and the rendering layer, so structured output maps cleanly onto rendered components.
• Keep generation deterministic and testable: the same input produces the same document, so a regression fails the build instead of surfacing in a business review.
• Work with the rendering toolchain (for example Apache POI, PDFBox, or pptxgenjs) closely enough to diagnose a broken deliverable, extend a template, and hold the line on structural fidelity: required sections, tables, ordering, and cross-format consistency.
Required Qualifications
• 6-10 years building production software, including recent hands-on delivery of AI or large-language-model systems beyond prototypes.
• Strong JVM engineering (Java; Kotlin or Scala a plus) with solid practices: Git workflows, code review, automated testing, structured logging, and clean design.
• Hands-on experience with modern GenAI patterns: prompt engineering, structured or JSON outputs, tool and function calling, retrieval-augmented generation, and agentic workflows.
• Experience designing and querying a graph or document database (Neo4j and Cypher, or MongoDB Atlas) and using vector search and embeddings for semantic retrieval.
• A track record of owning your own delivery path: you have taken something you built through a pipeline into production and operated it, rather than handing it over.
• Practical experience evaluating non-deterministic systems: test design, quality scoring, regression suites, and translating evaluation into business-ready acceptance criteria.
• Demonstrated ability to design and explain solution architecture (data flow, runtime flow, interfaces, failure modes, and controls) and to explain model behaviour, limitations, and trade-offs in plain language.
Adjacent Areas
• Platform and reliability: a major cloud (Azure preferred), containerized deployment with Docker and Kubernetes, CI/CD, observability, and automated quality gates on a service you ran in production.
• Deliverable generation and
$125k - $135k per year
...to offer at . The Opportunity: We’re looking for an AI Engineer, GenAI & Agentic Solutions to join our Data & Analytics Partners team. Reporting... ...AI, retrieval-augmented generation, intelligent knowledge experiences, and tool-integrated agentic workflows. Working...SuggestedFull timeInternship- ...About the Company: Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest... ...? Join us! About the Role As a Staff Agentic AI Engineer at Netomi, you will be a senior individual contributor helping build the core agentic...SeniorFull time
- ...Senior AI Engineer Location: Toronto, ON | Hybrid (3 days onsite: Tuesday-Thursday, 8:30 AM to 5:00 PM) We are seeking an experienced... ...objectives. The ideal candidate brings deep expertise in agentic AI systems, knowledge graphs, AI-powered document generation,...SeniorContract workInternship
- ...— keep reading. About the Role The Agentic AI Foundations team is building the core platform... ...agent-native operations. As a Software Engineer II on the team, you will help design,... ...across Socure can build on, working alongside senior and staff engineers who set the...SeniorFull timeInternship
- ...consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been recognized by... ...firms, including Forrester and Gartner. We are seeking a Senior Knowledge Graph SME to lead the architecture, design, and implementation of an...SeniorFull timeWork at officeLocal area
- ...traditional business models into agile, AI-powered ecosystems.... ...looking for a Forward Deployed Engineer to work at the intersection of... ...harnesses, agent loops, state graphs, tools, context, evaluations, observability... ...delivery cycles Drive agentic engineering practices across...SeniorFull timeImmediate start
$130k - $180k per year
...We are currently looking for a Senior Full Stack Engineer to join our growing Web Applications team. You'll work on complex projects, actively... ...Management, TCV, Inovia, F-Prime, Golden Ventures, and Google's AI fund, Gradient Ventures, we provide an indispensable tool for...SeniorFull timeHome office- ...About Us We believe AI will fundamentally transform how people... ...Position: As a member of the LLM inference team, you will help... ...systems, inference engine optimization, and writing high... ...in software engineering. ~ Knowledgeable and passionate about machine learning...SeniorFull timeInternshipFlexible hours
$100k - $125k per year
...We are currently looking for a Software Engineer, Gen AI & Web Apps to join our team. Reporting to the Engineering Manager, you'll work on... ...concepts (e.g., prompting, RAG workflows, or interacting with LLM APIs). ~ A proactive mindset—you are comfortable asking questions...Full timeHome office$135k - $210k per year
...Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based... ...capabilities that will underpin Guidepoint’s Next-Gen research enablement platform and data... ...systems, including large language model (LLM) applications and research agents, while ensuring...SeniorFull timeWorldwide- ...Gen AI Developer – AWS, Generative AI, LLMs & Amazon Bedrock Location: Toronto- Hybrid: 2 days a week in office Job Description... ...Retrieval-Augmented Generation (RAG) solutions and prompt engineering techniques. • Utilize AWS AI/ML services such as Amazon Bedrock...Contract workWork at office2 days per week
$116k - $145k per year
...team’s purpose is to serve as the strategic engine of the Commercial organization. By... ...seeking a technical and strategic Manager, AI & Agentic Workflows to lead the evolution of our Commercial... ...a proven track record of influencing senior stakeholders and navigating ambiguity....SeniorRemote jobLong term contractFull time$90k - $130k per year
...Zafin is an AI platform company helping regulated institutions modernize how critical... ...scale. What’s the Opportunity? The AI Knowledge Operations Specialist is responsible for preparing... ...closely with Industry Consultants, Agent Engineers, AI Evaluation Engineers, and other team...Full time$160k - $220k per year
...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential... ...for Auth0 customers. The Staff Software Engineer At Okta, we’re building the next generation... ...developers and AI-native tooling (e.g., llm.txt) Drive Integration with Emerging AI Frameworks...Full timeLocal areaWorldwide- ...About the Role We are a small team of AI builders in Paytm Labs. As a Staff AI Platform Engineer, you will work across inference and agentic systems. You will contribute to Paytm'... ...experience, with 3+ years in AI systems or LLM applications ~ Strong understanding of...Full time
- ...teams and customers who depend on AI — risk, fraud, collections,... ...— and design, build, and ship agentic systems into their production environments... ...for agentic systems; mentor engineers and partner with ML, product,... ..., with 3+ in AI systems or LLM applications, and production systems...SeniorFull time
$170k - $220k per year
...Apply Digital is a global AI-native transformation partner,... ...elite talent to connect strategy, agentic experiences, technology, and data... ...APIs across services. Coach engineers on effective agent design, prompt... ...AI-powered systems, including: LLM integrations (Gemini 3, Claude...SeniorLong term contractFull timeInternshipWork at officeImmediate startRemote workFlexible hours- ...apply now.\n\nWe are currently seeking a Agentic AI Systems Developer - Remote to join our team... ...AI, classical ML, and full-stack engineering in regulated environments. \n \n\n\nKey Responsibilities... ..., RCM automation) \n\n\u2022 Build LLM-powered systems (RAG, tool-calling agents...Full timeWork at officeRemote workFlexible hours
- ...Position: Senior AI Engineer Location: Toronto, ON Job ID#: RQ11252 Duration: 8 Months Role Overview We are seeking... ...AI/ML solutions ~ Hands-on experience with Generative AI and LLM-based applications in enterprise environments ~ Experience developing...SeniorFull time
$120k - $170k per year
...and Responsibilities: As an AI Specialist at Xanadu, you will... ...researchers, scientists, engineers, and software developers. By infusing... ..., develop, and maintain our agentic AI research system for... ...context/harness engineering, knowledge retrieval, and agent orchestration...Full time- ...Competitive Intelligence Klue Engineering is hiring! We're looking for a Senior Software Engineer to join our team... ...building and optimizing state-of-the-art LLM-powered agents that can reason,... ..., query understanding, and agentic reasoning loops to deliver fast, accurate...SeniorFull timeWork at office
$120k - $160k per year
...real outcomes. The Opportunity ShyftLabs is looking for a Senior AI Engineer to sit at the intersection of AI/ML engineering and backend... ...development skills, someone equally comfortable fine-tuning an LLM integration as they are designing a robust API or event-driven...SeniorFull timeWork at office3 days per week- ...Analytics is a global leader in AI and analytics, helping Fortune... ...looking for a highly skilled AI Engineer with 7+ years of experience in... ...implementing complex RAG and Agentic AI architectures. Requirements... ...integrating Generative AI/LLM APIs, AWS Bedrock, and other model...Long term contractLocal area
$167.5k - $235k per year
...autonomous cross-functional team to build AI agents that fundamentally... ...platform that can read operational knowledge, reason about it in context, and execute... ...consists of fewer than five engineers. The work spans critical areas including LLM-powered agent design, robust backend...SeniorLong term contractFull timeCasual workInternshipWork at officeLocal areaImmediate start$90 per hour
...Ontario Canada. Preferably in Toronto. The Role: The Senior Data Engineer will be a core technical contributor on the evaluation team... ...be responsible for determining whether an enterprise-scale knowledge graph requires a purpose-built graph database or whether PostgreSQL...SeniorHourly payFull timeFixed term contractRemote workFlexible hours$130k - $145k per year
...the role: We are seeking a highly skilled and passionate Senior DevOps Engineer, AI infrastructure to join our team! You will play a key role in... ...solutions, including exploring and applying advanced concepts like Agentic AI, within our financial operations. This role offers a...SeniorFull timeInternshipWork at officeFlexible hours- ...uncharted. By combining our expertise across connectivity, AI, security and more, we’ll map a new way forward.... ...to 60% at a typical company. Role Summary As a Senior Software Engineer specializing in agentic applications, you will be a key technical leader and influential...SeniorLong term contractFull timeContract workLocal area
- ...Principal Data Scientist – (Gen AI, Machine Learning): Are you energized by the idea of innovating with... ...solutions for Generative AI, including AI Agents, RAG, Knowledge Bases, Data Mining, Anomaly Detection, and LLM fine-tuning. These innovations power flagship...SeniorLong term contractFull timeWorldwideShift work
- ...and future generations. As an AI Developer on Xplore's Data & AI... ...design, build, and deploy the agentic workflows and AI-enabled... ...Unlike a research-oriented ML engineer focused on model development, or... ...Demonstrated experience taking LLM-based or agentic applications into...
- ...talent at your fingertips. With our AI-powered Global Work Platform™, companies... ...with you, not just for you. Our AI & Knowledge team is on the front lines of that... ...AI assistant, and we’re looking for a Senior Full-Stack Software Engineer who wants to help define what AI-native...SeniorFull timeLocal areaFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Gen AI Engineer - LLM, Agentic AI, Knowledge Graphs. Be the first to apply!
- senior manager risk management Toronto, ON
- pega senior system architect Toronto, ON
- senior electrical engineer Toronto, ON
- senior executive Toronto, ON
- senior network engineer Toronto, ON
- senior analyst Toronto, ON
- cpa senior accountant Toronto, ON
- senior accountant Toronto, ON
- senior human resources Toronto, ON
- senior line cook Toronto, ON

