Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI/LLM Engineer (Python) - Remote

Kake

Kake is a remote-first company and a people-first global community of senior engineers. Kake engineers are behind some of the world’s most innovative products (Brands you’ve heard!), from Fortune 500 to fast-growing companies. We believe it’s not where your table is, but what you bring to the table that matters. Our community spans 45,000+ engineers across 55+ countries; join a culture where great people stay, grow, and thrive (and love eating kake!).

Senior AI/LLM Engineers with strong Python experience, skilled in designing, building, and productionizing LLM-powered applications and AI systems at scale. It's a great fit for people who enjoy working at the intersection of software engineering and applied AI, and who take ownership from prototyping through production deployment.

What you’ll build and own

  • Design, build, and deploy LLM-powered features and applications using Python.
  • Develop and maintain backend services and APIs (e.g., FastAPI) that expose AI/LLM capabilities to other systems.
  • Build and optimize RAG pipelines, including embeddings, vector search, and retrieval strategies.
  • Design, test, and iterate on prompts, agents, and orchestration flows using frameworks such as LangChain, LlamaIndex, or similar.
  • Integrate with LLM providers and APIs (e.g., OpenAI, Anthropic, open-source models) and manage tradeoffs around cost, latency, and quality.
  • Evaluate model outputs systematically, building tooling and metrics to test accuracy, safety, and regression across iterations.
  • Work with containerized environments and data infrastructure (e.g., PostgreSQL, Redis, vector databases) to support reliable AI systems in production.
  • Collaborate with cross-functional stakeholders to translate ambiguous product needs into technically sound AI solutions.

Core Requirements

  • Strong proficiency in Python and experience with FastAPI or similar backend frameworks.
  • Experience working with LLM APIs (e.g., OpenAI, Anthropic, or similar) and frameworks such as LangChain or LlamaIndex.
  • Experience with RAG architectures , embeddings, and vector databases (e.g., Pinecone, Weaviate, pgvector, or similar).
  • Hands-on experience with Docker and containerized development environments.
  • Experience working with PostgreSQL, Redis, or similar data stores.
  • Strong experience writing functional and integration tests, including evaluation frameworks for AI/LLM output quality.
  • Excellent written and verbal communication skills in English.
  • Ability to work independently in a remote, fast-paced environment.

Nice-to-Have

  • Experience fine-tuning or evaluating open-source LLMs.
  • Familiarity with prompt engineering best practices and agentic workflows.
  • Experience with distributed systems, streaming (e.g., Kafka), or large-scale applications.
  • Background in machine learning fundamentals (e.g., scikit-learn, PyTorch, or TensorFlow).
  • Comfortable working flexible hours to overlap with distributed teams across different time zones.

Why Join Kake?

The icing on the Kake:

  • Competitive Pay in USD: Work globally, get paid globally.
  • Fully Remote: Simply put, we trust you.
  • Better Me Fund: We invest in your personal growth and passions.
  • Compassion is Badass: Join a community that invests in social good.

Ready for your piece of the Kake?

Quick note: Due to the high volume of applications, only shortlisted candidates will be contacted.

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI/LLM Engineer (Python) - Remote in Toronto, ON vacancy
  •  ...Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM Required Skillsets: • 3–5+ years   of hands-on   CI/CD, cloud, and platform engineering   experience in enterprise   environments. • Strong proficiency in   Python for automation, API integrations, infrastructure... 
    Suggested
    Permanent employment

    Astra North Infoteck Inc.

    Toronto, ON
    a month ago
  •  ...Role: Senior Manager, AI Location: Mississauga , Ontario – Hybrid (4 days/week...  ...Reports to: Directo r, Platform Engineering   At Mattamy Asset Management ( MAM...  ...including 2+ years delivering production AI/LLM solutions and 2+ years leading technical... 
    Senior
    Full time
    Work at office

    Mattamy Homes

    Toronto, ON
    more than 2 months ago
  •  ...role 247 Labs is looking for a hands-on AI Engineer to design, develop, deploy, and maintain production...  ..., and external enterprise systems. Use Python and SQL to extract, clean, validate,...  ...including meaningful hands-on production LLM development. ~ Strong Python programming... 
    Suggested

    247 Labs Inc.

    Toronto, ON
    2 days ago
  • $100k - $145k per year

    Job Description As a Senior Machine Learning Engineer , you will build and deploy production machine learning and large language model (LLM) systems that extract actionable insights from complex...  ...world products. This role may be remote within the United States or hybrid... 
    Remote work
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    22 hours ago
  •  ...The Opportunity We are looking for a senior Forward Deployed Engineer who combines production-grade software engineering, data engineering, AI application development, and client-...  ...production. Profile unfamiliar data using Python, pandas, PySpark, and SQL to assess... 
    Senior

    Astra-North Infoteck Inc. ~ Conquering today’s challenges, a...

    Toronto, ON
    3 days ago
  •  ...AI DEVELOPER – AI/ML, PYTHON, LANGCHAIN, RAG, NLP, LLM TORONTO, ON - HYBRID (4 DAYS WFO) ROLE DESCRIPTIONS What is the opportunity? The Senior AI Engineer will work on the development and deployment of cutting-edge machine learning models, drive innovation, and... 
    Senior
    Permanent employment

    Astra North Infoteck Inc.

    Toronto, ON
    20 days ago
  • $150k - $200k per year

     ...Stikeman Elliott is building its own agentic AI platform, with production agents working...  ...use and continues to expand. This is the senior engineering role responsible for advancing its...  ...at least one year working directly with LLM-powered or agentic applications in production... 
    Senior
    Full time

    Stikeman Elliott Llp

    Toronto, ON
    3 days ago
  • $108.8k - $220.4k per year

     ...You Are: As an experienced and senior AI/LLM Architect, you will play a pivotal role in designing and delivering end-to-end AI platform...  ...reinvented enterprise. Operating at the intersection of business and engineering, you will own the technical design of advanced AI systems —... 
    Senior
    Full time
    Work at office
    Local area

    1200 Accenture Inc Company

    Toronto, ON
    3 days ago
  •  ...Senior Software Engineer Job Type: Contractor (~15 hours/week) Location: Remote Job Summary We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on... 
    Remote job
    Senior
    For contractors

    YO AI Labs

    Toronto, ON
    a month ago
  •  ...Munich Re Group in Toronto is seeking a Senior/Staff Software Engineer with deep Python expertise to build scalable APIs and services powering data-driven life...  ...solutions. You will work on mission-critical systems handling AI, EHRs, and sensitive medical data to enable faster,... 
    Senior

    Munich Re Group

    Toronto, ON
    3 days ago
  •  ...Job Description Senior AI Engineer The Opportunity We are seeking an accomplished Senior AI Engineer to contribute to the design,...  ...Design and implement AI-driven automation solutions, including LLM-powered automation, prompt engineering, and conversational AI... 
    Senior
    Full time
    Flexible hours

    RBC

    Toronto, ON
    1 day ago
  •  ...Senior AI Engineer Toronto Downtown, ON - Hybrid (4 Days WFO) In Person Interview Required  Key Responsibilities • AI Product Delivery...  ...and architect scalable Generative AI solutions, including LLM pipelines, Agentic workflows, Model Context Protocol (MCP), Graph... 
    Senior
    Long term contract
    Permanent employment

    Astra North Infoteck Inc.

    Toronto, ON
    6 days ago
  • $175k - $210k per year

     ...Guidepoint is investing in applied AI across its research platform....  ...— combining real-time voice, LLM-driven orchestration, and retrieval...  .... You'll be an early engineer on a new initiative: taking working...  .... ~ Strong TypeScript or Python; comfortable working across... 
    Senior
    Internship
    Work at office

    Guidepoint

    Toronto, ON
    3 days ago
  • $150k - $180k per year

     ...roadmap. Through CivCheck, we created Guided AI Plan Review™ (GPR) - a pioneering...  ...enterprise offering. We’re seeking a Senior Applied AI Engineer to serve as a forward‑deployed AI expert...  ...building agentic AI workflows and LLM‑powered applications in production, including... 
    Remote work
    Senior
    Full time
    Contract work
    Part time
    Internship

    Clariti Cloud Inc.

    Toronto, ON
    3 days ago
  •  ...CoreFactor is searching for a Senior AI Engineer on a permanent/full-time basis.  This position is hybrid and will require the successful incumbent...  ...evaluation methodology, guardrails, and reliability of LLM-powered systems.  Drive continuous iteration and improvement... 
    Senior
    Permanent employment
    Full time
    Work at office

    CoreFactor

    Toronto, ON
    18 days ago
  •  ...America. MediCore is Rules Cube's AI-powered patient access and clinic...  ...America, and we're building out the engineering team behind it. The Role As a Senior Full Stack Engineer on the MediCore...  ...to end, from database design and Python APIs to polished front-end experiences... 
    Senior
    Full time

    Rules Cube

    Toronto, ON
    22 days ago
  •  ...Competitive Intelligence Klue Engineering is hiring! We're looking for a Senior Software Engineer to join our team...  ...building and optimizing state-of-the-art LLM-powered agents that can reason,...  ...code. You're comfortable with Python and have experience with backend frameworks... 
    Senior
    Full time
    Work at office

    klue

    Toronto, ON
    19 hours ago
  • $64k - $106k per year

     ...and optimize large-scale feature engineering in PySpark over hundreds of...  ...Design and implement agentic AI solutions that automate model improvement...  ...preferred. Expert-level Python, writing production-grade ML...  ...with agentic AI architectures, LLM-based solutions, and working fluently... 
    Senior
    Full time
    Internship
    Work at office

    Canadian Tire

    Toronto, ON
    1 day ago
  • $120k - $220k per year

     ...Senior Founding Engineer - AI Agents Salary: $120k – $220k CAD 0.25% – 1.5% Job Location: Toronto Experience: 3 years of exp Job Type: Full Time Job Location Toronto Remote Work Policy In office - WFH flexibility Visa Sponsorship... 
    Remote work
    Senior
    Full time
    For contractors
    Internship
    Work at office
    Work from home
    Relocation
    Visa sponsorship

    Tyce

    Toronto, ON
    3 days ago
  • # Quality Engineer  – Test Automation, Java/Python & GenAI Roles and Responsibilities: • Partner with DevOps,   Development...  ...exploratory, automated,   and AI-focused   tests that ensure   product...  ...with AI   evaluation frameworks,   LLM testing, prompt   engineering, retrieval... 
    Senior
    Permanent employment

    Astra North Infoteck Inc.

    Toronto, ON
    a month ago
  • $100 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: Agent Engineer Type: Contract Compensation...  ...–$500/hour Location: Remote Role Responsibilities Build and operate LLM agents in production... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $130k - $180k per year

     ...North America Role is 95% remote in Toronto (we meet up 1x a month...  ...we are looking to hire a BE Python Developer for the Platform team...  .../DevOps Open on seniority from Senior to Staff level...  ...outstanding Senior/Staff/Lead Platform Engineer who wants to play a core role... 
    Remote work
    Senior
    Long term contract
    Full time
    Visa sponsorship
    Work visa
    Flexible hours

    Acquird.io

    Toronto, ON
    more than 2 months ago
  • $136k - $170k per year

     ...Lyft is looking for software engineers from a scope of disciplines. We...  ...passengers and drivers. The Applied AI team is looking for a Backend...  .... ~ Experience with Python and Go. ~ Experience with cloud...  ...Bonus points: Experience with LLM orchestration (LangChain, etc.)... 
    Senior
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft

    Toronto, ON
    1 day ago
  • $130k - $180k per year

     ...North America Role is 95% remote in Toronto (we meetup 1x a...  ...looking to hire a Full Stack Python/React Developer for an applications team We're open on seniority from Upper Intermediate to Staff...  ...Senior/Staff/Lead Full Stack Engineer who wants to play a key role... 
    Remote work
    Senior
    Long term contract
    Visa sponsorship
    Work visa
    Flexible hours

    Acquird.io

    Toronto, ON
    3 days ago
  • $100k - $145k per year

     ...We're building the next generation of AI‑powered platforms for tax and accounting professionals, and we’re looking for a Senior Software Engineer who can architect high‑performance backend...  ...reliability of systems that coordinate LLM interactions, serve high‑traffic APIs, and... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    22 hours ago
  •  ...teams and customers who depend on AI — risk, fraud, collections,...  ...standards for agentic systems; mentor engineers and partner with ML, product,...  ..., with 3+ in AI systems or LLM applications, and production systems...  ...evaluation. ~ Proficiency in Python across a broad stack — pipeline... 
    Senior
    Full time

    Paytm

    Toronto, ON
    more than 2 months ago
  • $120k - $160k per year

     ...real outcomes. The Opportunity ShyftLabs is looking for a Senior AI Engineer to sit at the intersection of AI/ML engineering and backend...  ...development skills, someone equally comfortable fine-tuning an LLM integration as they are designing a robust API or event-driven... 
    Senior
    Full time
    Work at office
    3 days per week

    Shyftlabs

    Toronto, ON
    more than 2 months ago
  • $164.49k - $197.39k per year

     ...any stack, GrafanaCloud brings AI to observability and observability...  ...on GrafanaLabs. We are a 100% remote company with team members...  ...GrafanaLabs is seeking a Staff Engineer (AI & Automation) to own the AI...  ...build multi-agent architectures, LLM integrations, and backend services... 
    Remote work
    Local area

    Grafana

    Toronto, ON
    3 days ago
  •  ...Select how often (in days) to receive an alert: Title: Senior AI Platform Software Engineer Requisition ID: Join a purpose driven winning team,...  ...or distributed systems. Advanced programming skills in Python, Java, Scala, Go, or a similar language, with a strong record... 
    Senior
    Flexible hours

    Scotiabank

    Toronto, ON
    2 days ago
  • $100k - $145k per year

     ...Job Description: What if the AI agents you help build empower legal...  ...builds and ships using AI-native engineering practices: agentic coding tools that let a small, senior group move at a pace well beyond...  ...AI agent systems on top of modern LLM APIs, agent SDKs, and... 
    Senior
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI/LLM Engineer (Python) - Remote. Be the first to apply!