Python Ai Engineer
EPAM Systems Inc
We are hiring a
Python AI Engineer
to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG chatbot into a broader, agentic knowledge system.
Today, our platform supports Confluence/GitHub ingestion → chunking → pgvector → RAG retrieval → FastAPI serving. In our next growth phase, we are expanding toward hybrid retrieval (vector + sparse + graph), multi-source ingestion, robust evaluation pipelines, agent infrastructure, and shared chat platform primitives.
If you are passionate about building scalable, reliable, and production-grade AI infrastructure rather than just chasing demo behavior, we want to hear from you.
Req.#1093687315
Responsibilities
Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg
Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity
Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls
Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability
Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions
Ingestion infrastructure across current and future content sources
Full-stack observability across application, pipeline, database, and model-serving behavior
Cost, latency, throughput, and failure-mode management for AI-heavy workloads
Release workflows that validate AI behavior changes, not just code compilation
Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform
Requirements
Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments
Experience building CLI tools using Python, Golang, or Rust
Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines
Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement
Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows
Systems Understanding: Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems
Strong skills across metrics, tracing, dashboards, alerting, and log analysis
Experience with ingestion, ETL, or content-processing pipelines at scale
An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery
Nice to have
Experience with Qdrant, Neo4j, or other vector/graph infrastructure
Prior experience supporting RAG, search, evaluation, or agent platforms
Background in enterprise or highly regulated environments
Familiarity with enterprise tooling such as Vault, Splunk, Artifactory, or ECR
Comfort leveraging AI-assisted engineering workflows in day-to-day work
We offer
Extended Healthcare with Prescription Drugs, Dental and Vision, and Healthcare Spending Account (Company Paid)
Life and AD&D Insurance (Company Paid)
Employee Assistance Program (Company Paid)
Telehealth (Company Paid)
Short-term Disability (Company Paid)
Long-Term Disability
Paid Time Off (including vacation and sick days)
Registered Retirement Savings Plan (RRSP) with Company match
Maternity/Parental/Adoption Leave Top-up
Employee Stock Purchase Program
Critical Illness Insurance
Employee Discounts
Unlimited access to LinkedIn learning solutions
EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.
At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.
#J-18808-Ljbffr
Python AI Engineer
to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG chatbot into a broader, agentic knowledge system.
Today, our platform supports Confluence/GitHub ingestion → chunking → pgvector → RAG retrieval → FastAPI serving. In our next growth phase, we are expanding toward hybrid retrieval (vector + sparse + graph), multi-source ingestion, robust evaluation pipelines, agent infrastructure, and shared chat platform primitives.
If you are passionate about building scalable, reliable, and production-grade AI infrastructure rather than just chasing demo behavior, we want to hear from you.
Req.#1093687315
Responsibilities
Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg
Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity
Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls
Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability
Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions
Ingestion infrastructure across current and future content sources
Full-stack observability across application, pipeline, database, and model-serving behavior
Cost, latency, throughput, and failure-mode management for AI-heavy workloads
Release workflows that validate AI behavior changes, not just code compilation
Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform
Requirements
Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments
Experience building CLI tools using Python, Golang, or Rust
Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines
Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement
Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows
Systems Understanding: Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems
Strong skills across metrics, tracing, dashboards, alerting, and log analysis
Experience with ingestion, ETL, or content-processing pipelines at scale
An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery
Nice to have
Experience with Qdrant, Neo4j, or other vector/graph infrastructure
Prior experience supporting RAG, search, evaluation, or agent platforms
Background in enterprise or highly regulated environments
Familiarity with enterprise tooling such as Vault, Splunk, Artifactory, or ECR
Comfort leveraging AI-assisted engineering workflows in day-to-day work
We offer
Extended Healthcare with Prescription Drugs, Dental and Vision, and Healthcare Spending Account (Company Paid)
Life and AD&D Insurance (Company Paid)
Employee Assistance Program (Company Paid)
Telehealth (Company Paid)
Short-term Disability (Company Paid)
Long-Term Disability
Paid Time Off (including vacation and sick days)
Registered Retirement Savings Plan (RRSP) with Company match
Maternity/Parental/Adoption Leave Top-up
Employee Stock Purchase Program
Critical Illness Insurance
Employee Discounts
Unlimited access to LinkedIn learning solutions
EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.
At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Python Ai Engineer in Winnipeg, MB vacancy
- ...professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise...SuggestedFull timeInternshipRemote workRelocation
- ...Toronto, ON (hybrid - 3 day/week onsite) Collabera is seeking an AI Engineer to support the AI & Emerging Technology team at a major... ...top of them. This person should be particularly strong in Python, AWS, GenAI application development, RAG, and agentic AI . They...SuggestedContract workFor contractorsLocal area3 days per week
- NOW HIRING: AI ENGINEER PYTHONClient: Citi Bank Location: Mississauga, Canada Employment: FULL-TIME Experience: 12+ Years Overall REQUIRED Key Responsibilities Design, build & deploy Python-based AI/LLM applications using FastAPI/Flask Develop scalable REST...SuggestedFull time
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior AI Engineer (Python) based in Canada. Join a high-performing engineering team to develop and enhance an enterprise AI platform that powers...SuggestedRemote workRelocationRelocation package
- Join Baseten as a Python Engineer and develop transformative AI solutions for dynamic companies. Leverage your technical skills to deliver high-scale AI applications that enhance customer experiences. In this role, you will work closely with clients, driving projects from...SuggestedInternship
- Build production-grade AI infrastructure with Python and FastAPI at EPAM Systems, supporting enterprise knowledge systems and reliable retrieval. Work... ...across backend services and observability.As a Python AI Engineer, you will evolve a Confluence-focused RAG chatbot into a broader...
- Build scalable AI solutions with Python as a Forward Deployed AI Engineer at BCG X in Toronto or Montreal. Client collaboration and software development are central.BCG X seeks Forward Deployed AI Engineers for its growing engineering team. You will work across the analytics...Permanent employment
$120.8k - $170.8k per year
...President (VP), to join our team as an Application Development AI Engineer. The ideal candidate is a seasoned engineer with a proven track... ...design.Technical Skills: 6+ years' experience and mastery of Python programming language3+ years proven experience with API design (...Full time- Build customer-facing AI platform services in Python with Cloudbeds, working completely remotely on reliable production systems and agentic workflows.As a Senior Software Engineer on the Core AI Squad, you will build production AI capabilities across Cloudbeds products. The...Remote work
- Build production AI backend systems with Python, FastAPI or Flask, and background processing as a Senior AI Engineer. Focus on scalable, reliable delivery.This senior role develops practical AI capabilities across task-specific ML models, LLM integration, and agentic systems...
- Build production AI solutions with Python and backend engineering for Thomson Reuters, supporting tax and audit professionals in a hybrid work model. Deliver secure applications using LLMs and client-facing technical delivery across complex business needs.As a Senior Software...
- Build scalable AI solutions with Python at BCG X, serving clients from Toronto or Montreal while applying software development expertise.As a Forward Deployed AI Engineer, you will help develop the next generation of AI solutions. You will partner with clients across BCG regions...Permanent employment
- Build reliable software with Python and AI at ZoomInfo, working remotely on applications, services, and data platforms for business teams.As a Senior Software Engineer, you will own complex technical projects from ambiguous requirements through production. You will use Python...Remote work
- Build AI platform integrations at DRW using Go, Python, and API gateways while connecting cloud providers, internal models, and tools.As a Platform Engineer, you will help operationalize DRW’s AI tooling ecosystem... ...: Configure multi-engine API gateways, routing, limits...
- ...efficient machine learning kernels with C++ and Python onsite at Sapphire Stream Technology in... ..., Ontario.This Machine Learning Software Engineer role centers on advanced software... ...testing, and runtime solutions for advanced AI and computing platforms with SST. #J-18808...
- Take charge as an AI Engineer with a focus on advanced Python and innovative AI/ML frameworks. This role will engage you in building scalable AI solutions leveraging generative AI technologies. We are in search of a proficient AI Engineer who possesses extensive experience...Manual labor
- ...first company and a people-first global community of senior engineers. Kake engineers are behind some of the world’s most... ...stay, grow, and thrive (and love eating kake!). Senior AI/LLM Engineers with strong Python experience, skilled in designing, building, and productionizing...Remote workFlexible hours
- About Glia Glia is the #1 Banking AI platform, empowering community and regional financial... ...synthesis. Latency is a first-class engineering constraint for us, not an afterthought.LLM... ...code.Our Tech Stack Coding languages: Python, Elixir, TypeScript, React (JavaScript)Persistence...Internship
- ...highly skilled and experienced Lead Software Engineer to join our team. In this role, you will... ...modern technology stacks and Generative AI capabilities. You will collaborate closely... ...depth knowledge and hands‑on experience with Python frameworks like Django, Flask, FastAPI, or...
- ...offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents,... ...practices. Technical Skills • Languages & Core ML: Python, Machine Learning, Deep Learning, Generative AI • LLMs...
- Foundation AI is seeking a Senior Software Engineer to join a rapidly growing SaaS company that builds AI-driven document intake platforms for the claims and litigation industries. You will balance hands-on coding with technical leadership, mentoring engineers, and shaping scalable...Remote work
- AIT Global Inc. is seeking an experienced AI Engineer in Mississauga, ON to design, build, and deploy Python-based AI/LLM applications using FastAPI or Flask. You will develop REST APIs and scalable enterprise solutions, and contribute to AI-powered data analytics platforms....
$65 - $130 per hour
Why Join ExadelWe're an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients... ...systems in production. Advanced proficiency in Python, along with experience using TypeScript or...Contract workInternshipWork at officeLocal areaRemote work- ...: Montreal (day 1 onboarding onsite/in-office presence required 3x/week)Years of experience:5-7 years of Python & Database experience (70%)2-3 years of hands-on AI project experience (30%)Skills Required:Strong proficiency of Python with experience developing production-grade...Work at office
- ...leading technology company in Toronto is seeking a Senior Software Engineer to design and implement backend services for AI-native products. The ideal candidate has over 4 years of experience, strong skills in Python, FastAPI, and PostgreSQL. Responsibilities include building...Flexible hours
- NOW HIRING: PYTHON DEVELOPER GENAI / AILocation: Mississauga, Ontario, Canada Client: Citi Bank Employment: Full-... ...a Python Developer with strong expertise in Generative AI, LLMs, RAG, Agentic AI, Data Engineering, and MLOps to build and deploy enterprise-grade AI solutions...Full time
- # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted... ...Opportunity: We are hiring Senior Software Engineers - Python / TypeScript (USA) for a short-term AI Engineering and...Hourly payContract workTemporary workFreelanceImmediate startRemote work
- Miratech is seeking a Senior AI Engineer with strong Python experience and expertise in LangGraph and LangChain to join our US healthcare client. You will help build and enhance an enterprise AI platform enabling intelligent workflows, conversational experiences, and automation...Remote work
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- UKG is looking to hire a Python Engineer to join our extremely talented Data Science team. As a Python Software Engineer at UKG, you’ll be embedded... ...the Data Science team where you can work on the next generation AI Platform. You’ll get to work directly with other Software...Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Ai Engineer. Be the first to apply!
Related searches

