AI Developer

We are seeking a talented individual to join our team at Marsh. This role will be based in Toronto . This is a hybrid role that has a requirement of working at least three days a week in the office.

We are seeking an AI Developer to design, build, and maintain scalable backend services and APIs in Python, with a strong focus on Flask and FastAPI, including both synchronous and asynchronous patterns. The position also involves developing production-grade AI and LLM capabilities such as REST and WebSocket APIs, RAG pipelines, agent/tool-calling workflows, and model evaluation and optimization across GPT and open-source solutions.

We will count on you to:

• Designing, building, and maintaining robust, scalable backend services and APIs in Python (focus on Flask and FastAPI, synchronous and asynchronous patterns).
• Writing clean, efficient, and scalable Python code with strong attention to performance, reliability, and security.
• Developing and exposing AI/LLM capabilities as production-grade APIs (REST / WebSocket streaming responses, authentication).
• Implementing Large Language Model (LLM) solutions (GPT family and open-source models) including prompt design, evaluation, versioning, and cost/performance optimization.
• Build and maintain RAG pipelines (ingestion, embeddings, vector search e.g., pgvector) and agent/tool-calling (MCP / function calling) workflows.
• Integrating external/internal tools and data sources for LLM-based agents (databases, APIs, file systems, messaging platforms).
• Integrate data sources (SQL Server, PostgreSQL) and implement efficient schemas, queries, and transaction handling. ORM usage e.g., SQLAlchemy).
• Applying classical machine learning (scikit-learn) and statistical techniques when they provide simpler or more cost‑effective solutions
• Performing systematic evaluation and monitoring of AI/LLM outputs (quality, hallucination mitigation, latency, cost KPIs) and implementing guardrails/content filtering.

What you need to have:

• 3+ years of experience in a corporate IT environment
• 1+ year of experience in Artificial Intelligence, Machine Learning, Python, Flask, and FastAPI; sound software design, debugging, and performance profiling skills.
• Solid SQL Server & PostgreSQL knowledge (schema design, indexing, optimization; ORM experience).
• Maintaining adherence to security, privacy, and compliance best practices (secret management, data handling, access control).
• Strong commitment to secure, reliable, well-documented code ensuring adherence with quality standards.

What makes you stand out:

• Exposure to containerization and orchestration (Docker, Kubernetes) for deployment workflows.
• CI/CD familiarity (e.g., GitHub Actions) for automated testing, build, and deployment pipelines.
• Light JavaScript for integration or tooling.
• Organized, self-directed, and deadline-focused in distributed team environments.
• Fast learner, quality conscious and committed to deadlines

Why join our team:

• We help you be your best through professional development opportunities, interesting work and supportive leaders.
• We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have an impact on colleagues, clients and communities.
• Our scale enables us to provide a range of career opportunities, as well as benefits and rewards to enhance your well-being.

Marsh (NYSE: MRSH) is a global leader in risk, reinsurance and capital, people and investments, and management consulting, advising clients in 130 countries. With annual revenue of over $27 billion and more than 95,000 colleagues, Marsh helps build the confidence to thrive through the power of perspective. For more information, visit corporate.marsh.com, or follow us on LinkedIn and X.

Marsh is committed to embracing a diverse, inclusive and flexible work environment. We aim to attract and retain the best people and embrace diversity of age background, disability, ethnic origin, family duties, gender orientation or expression, marital status, nationality, parental status, personal or social status, political affiliation, race, religion and beliefs, sex/gender, sexual orientation or expression, skin color, or any other characteristic protected by applicable law. In accordance with the Accessibility for Ontarians with Disabilities Act, 2005, Marsh will provide a reasonable accommodation to employees and prospective employees to the point of undue hardship upon request and as required in respect of the individual’s particular restrictions and limitations. If you require a specific accommodation because of a disability or medical need, please contact View email address on careers.marsh.com.

Marsh is committed to hybrid work, which includes the flexibility of working remotely and the collaboration, connections and professional development benefits of working together in the office. All Marsh colleagues are expected to be in their local office or working onsite with clients at least three days per week. Office-based teams will identify at least one “anchor day” per week on which their full team will be together in person.

This is a Replacement position.