Python AI Infrastructure Engineer
EPAM Systems Inc
Build production-grade AI infrastructure with Python and FastAPI at EPAM Systems, supporting enterprise knowledge systems and reliable retrieval. Work across backend services and observability.
As a Python AI Engineer, you will evolve a Confluence-focused RAG chatbot into a broader agentic knowledge system. You will use Pydantic, SQLAlchemy async, asyncpg, and modern retrieval pipelines. Your work will support ingestion, evaluation, agent runtime capabilities, and shared conversational platform primitives.
Key Responsibilities:
- Architect backend services with Python 3.11 and FastAPI
- Design retrieval trade-offs involving quality, latency, cost, and safety
- Build agent memory boundaries, tool sandboxing, permissions, and budget controls
- Improve grounding, failure analysis, and citation enforcement
- Create observability using OpenTelemetry, Prometheus/Grafana, Docker, Helm, and GitHub Actions
Requirements:
- Strong hands-on Python experience in infrastructure-heavy environments
- Experience building CLI tools with Python, Golang, or Rust
- Hands-on LangGraph, LangChain, pgvector, and retrieval pipeline experience
- Experience designing LLM evaluation frameworks and regression detection
- Strong Docker, Helm, GitHub Actions, and Kubernetes workflow experience
Apply Python, retrieval, agent infrastructure, and observability expertise to dependable enterprise AI systems at EPAM Systems.
#J-18808-LjbffrVacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Python AI Infrastructure Engineer in Toronto, ON vacancy
- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise AI platform that enables intelligent workflows, conversational experiences, and AI...PythonInternshipRemote workRelocation
- ...Palona’s AI agents operate continuously in production, handle... ...and face sharp traffic peaks. Infrastructure is therefore part of the product... ...looking for an Infrastructure Engineer who combines cloud and reliability... ...current environment includes Python services, Docker, AWS and...PythonLong term contractFull timeTemporary workInternship
usd218k per year
...Who are we? Equinix is the world’s digital infrastructure company®, shortening the path to connectivity to enable the innovations that enrich... ...internal technical teams Software Reliability & Support Engineering Manages internal/external customer relationships and...SuggestedFull timeWork at office$92k - $118k per year
...scalable backend applications and integrate AI-powered workflows into complex financial... ...re looking for a Backend Developer – Java/Python & AI with practical experience building... ...on development role combines core backend engineering with the practical application of AI to enhance...PythonFull timeInternshipImmediate start- ...Senior Forward Deployed AI Engineer (Python, Data & GenAI) The Opportunity We are looking for a senior Forward... ...data-access, API, identity, network, security, infrastructure, and deployment blockers with technical teams...PythonPermanent employment
$180k - $275k per year
...communities. The Role As Principal Software Engineer for a new product within Veeva, you will... ...member of a team building our next major AI-driven platform — one that will transform... ...development expertise (Production level Python development required) Enterprise SaaS...PythonInternshipWork at officeLocal areaRemote workWork from homeFlexible hours$130k - $165k per year
...What We Need We’re looking for a Senior AI Engineer to design and build production-grade... ...latency, throughput, token consumption, and infrastructure cost to meet platform SLA requirements... ...by prompt or model changes. ~ Strong Python and distributed backend engineering skills...Python- ...our weekly changelog . About the Role As a Platform Engineer on Infrastructure, you'll share responsibility for everything Platform owns: our... ...for home office setup. ~ Unlimited token usage and access to AI tools. ~ A fast-moving, high-impact environment where your...Full timeInternshipHome office
$72k - $138k per year
...and on the job coaching -- We are looking for a passionate AI Research Engineer to join our team. You will work at the intersection of... ...research (industry or academic). ~ Strong programming skills in Python and experience with frameworks such as PyTorch, TensorFlow, JAX...PythonPermanent employmentFlexible hoursusd216k - usd297k per year
...come join ours. About this role: Our Engineering organization owns the software that... ...Qualifications: You've built and run data infrastructure that other teams depended on, at... ...scientists can actually use it. Solid Python plus at least one of Kotlin, Java, Scala...PythonWork at officeLocal areaRemote workWork from homeMonday to fridayFlexible hours3 days per week$117k - $130k per year
...applying new technologies to complex problems. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining software solutions that meet business requirements, using Python and/or Golang programming languages. You are capable of navigating...PythonFull timeRemote workShift work$92.92 - $107.21 per hour
...an experienced, high-performing Senior Python Engineer to join their core technology and platform... ...application development and big data infrastructure, utilizing tools such as FastAPI, Docker... ...shared framework libraries. Exposure to AI-assisted engineering practices (e.g.,...PythonContract workWork at office- ...Strong hands-on coding experience with version 17 and above, aware of best practices in UI / UX design, understanding of data binding. Python : Fundamental knowledge of the technology, hands on coding experience, experience with Python Pandas, independently handle...PythonFull time
- ...Director, Engineering, AI Job Description Are you passionate about transforming how legal professionals... ...supported by automation, CI/CD, and infrastructure as code on AWS. Manage the project... .... Technical background. Strong Python and RESTful API design skills. AWS certifications...PythonLong term contractFull timeContract workWork at officeLocal areaFlexible hoursShift work
- ...Why Join Doppel Doppel is building the future of social engineering defense. Our AI-native platform uses agentic AI to protect executives,... ...world’s most recognized brands detect and dismantle attacker infrastructure while strengthening employee resilience through threat-informed...Full timeInternshipWork at officeFlexible hours
$140.6k - $190.6k per year
...Job Description: Engineering Manager, Are you passionate about transforming... ...of legal research with AI? Join our Global Westlaw Engineering... ...) ~ Strong proficiency in Python and in designing and building... ...DevOps, CI/CD pipelines, and infrastructure as code. ~ Success in...PythonFull timeInternshipWork at officeLocal areaWorldwideFlexible hoursShift work$173k - $197.4k per year
...Manager, AI Engineer About Capital One Canada For 30 years, we've been on a mission to change... .... Our investments in technology infrastructure and world-class talent — along with our... ...4 years of experience programming with Python, Go, Scala, or Java Preferred Qualifications...PythonLong term contractFull timeWork at officeWork from home$86.1k - $136.1k per year
...you anywhere you want to go. Full Stack Engineer The Opportunity We’re looking for a... ...services to data engineering and Generative AI, RAG, and agentic AI solutions. You’ll... ...scalable backend services and APIs using Python, FastAPI/async frameworks, and Java. Build...PythonLong term contractFull timeTemporary workLocal area- ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...Revenue Suite’s rapid growth and help engineers build and ship faster through integrations... ...container orchestration capacity, or integrating AI tooling into our production stack across...Contract workInternship
- ...connected future through world-class networks, AI-powered solutions, and digital experiences... ...We are looking for a hands-on AI Engineer (CP2) to design, build, and deploy the next... ...engineering foundation: Proven proficiency in Python, clean code architecture, robust API...PythonFull timeWork at office3 days per week
$100k - $137.7k per year
...Job Description Overview Join AtkinsRéalis as a Water Infrastructure Engineer and play a key role in delivering innovative municipal infrastructure and civil engineering projects across Ontario. As part of the Municipal Infrastructure team within the Civil Engineering...Full timeContract workInternshipFlexible hours- ...Developer – Documentation Modernization & AI Enablement Work Arrangement: 1 day onsite... ...repositories. Collaborate with engineering and DevOps teams to improve chatbot knowledge... ...strong scripting automation experience, with Python (preferred) or Java development experience...PythonPermanent employment1 day per week
- ...Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM Required Skillsets: • 3–5+ years of hands-on CI/CD, cloud, and platform engineering... ...in Python for automation, API integrations, infrastructure tooling, agent services, and production scripting....PythonPermanent employment
$72k - $138k per year
...continuously improve secure, resilient infrastructure across public cloud and on-... ...As a Cloud Infrastructure Engineer, you will design, implement,... ...Terraform PowerShell, Bash, and Python Jenkins, GitLab CI/CD,... ...human screening combined with AI technology to help identify the...PythonPermanent employmentFlexible hours$84k - $175k per year
...Delivery • Lead design and implementation of AI-powered applications and agents using:... ...GenAI solutions including: o Prompt engineering o Retrieval-Augmented Generation (RAG)... ...o API development and integration o Python / REST / microservices • Experience leading...PythonPermanent employmentFlexible hours$130k - $155k per year
...Acquisition. Our vision is to build an ML/AI first network of advertisers and publishers... ...Fluent is hiring its first dedicated AI Engineer. Over the past year, AI at Fluent has moved... ...are a builder who ships. You are strong in Python and SQL, you have put at least one LLM-...PythonFull timeWork at officeRemote work- ...Competitive Intelligence Klue Engineering is hiring! We're looking... ..." looks like and build the infrastructure to measure it continuously.... ...code. You're comfortable with Python and have experience with backend... ...availability. You use AI coding tools to accelerate your...PythonFull timeWork at office
$82.1k - $132.1k per year
...self-service tools and operating AI agents that influence product... ...rely on. We are seeking an AI Engineer to build those agents for our... ...point to. Proficiency in Python and strong SQL, with a solid grounding... .... Exposure to AI-adjacent infrastructure: vector databases, embeddings,...PythonRemplacementWork at officeLocal areaFlexible hours$154k - $199.5k per year
...Description: We are looking for an AI Platform Product Engineer who can lead AI initiatives from idea... ...in production (model usage, tokens, infrastructure and support). A critical thinker with... ...) and its AI services. Practical Python skills and experience with at least...PythonManual laborWork at officeWork from home$64k - $106k per year
...optimize large-scale feature engineering in PySpark over hundreds of millions... ...Design and implement agentic AI solutions that automate model... ...preferred. Expert-level Python, writing production-grade ML... ...agents is a strong asset. Infrastructure-as-code experience (Terraform...PythonInternshipWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python AI Infrastructure Engineer. Be the first to apply!
