Staff Backend (Python) Engineer, AI Engineering:Duo Chat

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster.

The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software.

* Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab.

An overview of this role

As a  Staff Backend Engineer (Python) on the Duo Chat team in AI Engineering, you'll lead the backend architecture that powers GitLab Duo Chat across the GitLab DevSecOps platform. You'll solve hard problems in building reliable, secure, and scalable AI-powered chat workflows so customers can plan, write, review, and secure code faster, with confidence. This is a hands-on technical leadership role where you'll set direction for how we integrate and evolve large language model providers (including Google Vertex AI) across Ruby on Rails and Python services, raise the bar on observability and testing, and guide the team through ambiguous, high-impact technical decisions. Over your first year, you'll be expected to drive key architectural choices, reduce technical debt that slows iteration, and help the team ship durable improvements to response quality, reliability, and maintainability.

Some examples of our projects:

• Integrate new generative AI models and providers into GitLab Duo Chat to expand capabilities and improve response quality


• Improve debugging, observability, and test coverage for AI-powered chat workflows to increase reliability at scale

What you'll do

• Define the technical architecture and technical roadmap for the Duo Chat group, aligning backend execution with product direction and engineering priorities


• Solve the highest-scope and most ambiguous backend problems, delivering secure, well-tested, performant solutions with minimal guidance


• Integrate and extend generative AI capabilities in GitLab Duo Chat, including large language models (LLMs) and providers such as Google Vertex AI


• Develop, ship, and maintain backend features across Python and Ruby on Rails services that power Duo Chat experiences across the GitLab platform


• Design, implement, and review GraphQL application programming interface (API) contracts and supporting backend logic to ensure reliability, scalability, and clear frontend integrations


• Improve observability, debugging workflows, and incident readiness by strengthening logging, tracing, and production troubleshooting practices


• Drive code quality and long-term maintainability by setting internal standards, leading code reviews, and identifying and reducing technical debt


• Mentor engineers across the team and participate in Tier 2 on-call rotations, contributing to root cause analysis and follow-up improvements to resiliency and testing (including RSpec)

What you'll bring

• Production experience building and operating backend services in Python, including background jobs, APIs, and data models


• Ability to define and evolve technical architecture by weighing trade-offs, selecting patterns and tools, and setting a clear technical direction for others to follow


• Experience setting and driving a technical roadmap in partnership with product and engineering stakeholders


• Proficiency designing and maintaining REST and/or GraphQL APIs with attention to scalability, maintainability, and backward compatibility


• Hands-on experience integrating large language models into applications, including prompt design and building features powered by generative AI


• Strong SQL skills and experience working with relational databases such as PostgreSQL, including efficient queries and data modeling


• Experience mentoring engineers through code review, architectural guidance, and shared standards, and communicating complex technical decisions in a clear, async-first way


• Comfort contributing in a mature codebase across Python and Ruby on Rails, with openness to learning and applying transferable skills from related technologies or domains

About the team

The Duo Chat team sits within GitLab's AI Engineering organization and is responsible for building and evolving GitLab Duo Chat, the AI-powered chat experience embedded across the GitLab DevSecOps platform. You'll work with a small, cross-functional group of backend, frontend, and AI specialists who collaborate asynchronously across time zones, using GitLab issues, merge requests, and documentation as the primary way of working. The team focuses on integrating and scaling generative AI capabilities (including providers like Google Vertex AI), improving reliability and performance, and strengthening debugging, observability, and testing workflows so customers can safely use AI to plan, write, review, and secure their code across GitLab.

How GitLab Supports Full-Time Employees

Please note that we welcome interest from candidates with varying levels of experience; many successful candidates do not meet every single requirement. Additionally, studies have shown that people from underrepresented groups are less likely to apply to a job unless they meet every single qualification. If you're excited about this role, please apply and allow our recruiters to assess your application.

Country Hiring Guidelines: GitLab hires new team members in countries around the world. All of our roles are remote, however some roles may carry specific location-based eligibility requirements. Our Talent Acquisition team can help answer any questions about location after starting the recruiting process.

Privacy Policy: Please review our Recruitment Privacy Policy. Your privacy is important to us.

GitLab is proud to be an equal opportunity workplace and is an affirmative action employer. GitLab’s policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex (including pregnancy, lactation, sexual orientation, gender identity, or gender expression), national origin, age, citizenship, marital status, mental or physical disability, genetic information (including family medical history), discharge status from the military, protected veteran status (which includes disabled veterans, recently separated veterans, active duty wartime or campaign badge veterans, and Armed Forces service medal veterans), or any other basis protected by law. GitLab will not tolerate discrimination or harassment based on any of these characteristics. See also  GitLab’s EEO Policy and  EEO is the Law . If you have a disability or special need that requires  accommodation , please let us know during the  recruiting process .