Staff Backend Engineer, Python, AI Engineering – Duo Chat at GitLab

About the role

Staff Backend Engineer leading AI engineering for GitLab Duo Chat. Delivering scalable, reliable backend solutions for a cross-functional team in a remote setting.

Define the technical architecture and technical roadmap for the Duo Chat group, aligning backend execution with product direction and engineering priorities
Solve the highest-scope and most ambiguous backend problems, delivering secure, well-tested, performant solutions with minimal guidance
Integrate and extend generative AI capabilities in GitLab Duo Chat, including large language models (LLMs) and providers such as Google Vertex AI
Develop, ship, and maintain backend features across Python and Ruby on Rails services that power Duo Chat experiences across the GitLab platform
Design, implement, and review GraphQL application programming interface (API) contracts and supporting backend logic to ensure reliability, scalability, and clear frontend integrations
Improve observability, debugging workflows, and incident readiness by strengthening logging, tracing, and production troubleshooting practices
Drive code quality and long-term maintainability by setting internal standards, leading code reviews, and identifying and reducing technical debt
Mentor engineers across the team and participate in Tier 2 on-call rotations, contributing to root cause analysis and follow-up improvements to resiliency and testing (including RSpec)

Production experience building and operating backend services in Python, including background jobs, APIs, and data models
Ability to define and evolve technical architecture by weighing trade-offs, selecting patterns and tools, and setting a clear technical direction for others to follow
Experience setting and driving a technical roadmap in partnership with product and engineering stakeholders
Proficiency designing and maintaining REST and/or GraphQL APIs with attention to scalability, maintainability, and backward compatibility
Hands-on experience integrating large language models into applications, including prompt design and building features powered by generative AI
Strong SQL skills and experience working with relational databases such as PostgreSQL, including efficient queries and data modeling
Experience mentoring engineers through code review, architectural guidance, and shared standards, and communicating complex technical decisions in a clear, async-first way
Comfort contributing in a mature codebase across Python and Ruby on Rails, with openness to learning and applying transferable skills from related technologies or domains