Software Developer in Test II ensuring automated quality for Warner Bros. Discovery’s CNN Digital products. Building test suites and supporting reliable releases across web, mobile, OTT, and backend platforms.
About the role
- Senior Software Engineer developing LLM-powered agents at Klue in Vancouver. Building robust systems for managing competitive intelligence through advanced AI tools.
Responsibilities
- Build and ship backend systems that power agentic workflows. You design retrieval pipelines, orchestration layers, and multi-step agent architectures that turn millions of competitive data points (news, press releases, webpage changes, Slack posts, emails, reviews, CRM data) into actionable intelligence for our customers.
- Improve LLM-powered workflows end to end. From prompt design and retrieval strategy to caching and latency optimization, you'll make our agent responses faster, more accurate, and more reliable in production.
- Own evaluation of agentic systems at scale. You develop and operate evaluation frameworks (automated, offline, and human-in-the-loop) that measure relevance, quality, latency, and end-to-end task success across our agent pipelines. You'll define what "good" looks like and build the infrastructure to measure it continuously.
- Design and build human-in-the-loop systems. Working closely with product and design, you propose and prototype feedback mechanisms, review workflows, and correction loops that keep AI agents accurate and trusted over time. You understand when and how to bring humans into the loop, whether for validation, edge case handling, or continuous improvement, and obsess over making those experiences frictionless for our users.
- Ship with the customer in mind. You connect technical decisions to customer outcomes. You're energized by understanding how customers use the product, and you use that context to prioritize what to build next. You ship iteratively, measure impact, and course-correct quickly.
- Collaborate across product, infrastructure, and data teams. Align technical direction with product goals, contribute to architecture decisions, and help the team move faster by establishing patterns and best practices for production-grade agentic systems.
- Stay on the frontier. Evaluate and integrate advances in LLMs, retrieval architectures, and agentic reasoning. You have strong opinions (loosely held) about where this space is heading and bring that perspective to your work.
Requirements
- 5+ years building and operating backend systems in production, with meaningful experience in at least one of: search/retrieval, data pipelines, distributed systems, or API-heavy service architectures.
- Experience building or evaluating agentic / LLM-powered systems. You've worked with retrieval-augmented generation, multi-step agent workflows, or similar architectures and have thought critically about how to evaluate their output quality at scale.
- Strong software engineering fundamentals. You write clean, maintainable, well-tested code. You're comfortable with Python and have experience with backend frameworks, APIs, and production infrastructure. You care about reliability, observability, and CI/CD.
- Familiarity with search and retrieval systems. You've built or significantly improved retrieval pipelines and understand information retrieval fundamentals (hybrid retrieval, relevance tuning, query understanding). You've worked with tools like PGVector, Pinecone or Elasticsearch and understand their operational tradeoffs.
- Experience with cloud infrastructure (AWS, GCP, or Azure) and building systems that handle scale, large data volumes, low-latency requirements, and high availability.
- You use AI coding tools to accelerate your own work. You've integrated tools like Copilot, Curssor, Claude Code, or similar into your development workflow and can speak to how they've changed the way you build software.
- Customer-oriented mindset. You've shipped features where you understood the end-user problem, not just the technical specification. You're motivated by customer impact, not just technical elegance.
- Ability to lead projects and provide technical direction. You can own a problem end to end, make sound architectural decisions, and help others on the team level up.
Benefits
- Extended health & dental coverage that starts on Day 1
- Fun perks like discounts at Goodlife and Perkopolis
- Ownership: All full-time employees have the opportunity to participate in our Employee Stock Option Plan.
- Our Vacation Policy is Take The Time You Need. We just ask that you give notice and don’t leave your team hanging.
- Top-tier tools. All employees will receive a Mac (or PC, if that’s your jam) and access to A+ tooling.
- AI First. All employees are encouraged to lean into AI to work smarter and faster. Built something cool lately? Show us at our Friday Show, Don’t Tell Meetings.
- Growth / Leadership. Direct access to our leadership team, including our CEO, and opportunities to connect with incredible people across the company.
- Social connection. There’s no shortage of ways to stay connected and have fun. We get together once a year in Vancouver for a company-wide kickoff. Throughout the year our Hubs hold regular social events.
- Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Software Developer in Test II ensuring automated quality releases for Warner Bros. Discovery’s CNN Digital products. Building test suites across the software development lifecycle.
Full Stack Engineer building Yelp web features that drive app installs and user acquisition. Architecting full - stack solutions, running experiments, and mentoring engineers remotely across Canada.
Senior fullstack developer building .NET/C# and TypeScript legal - document software. Supporting SOVRA’s public procurement platform used by government agencies across North America.
Développeur full - stack senior pour la plateforme de documents juridiques de SOVRA. Conception d’API .NET, interfaces TypeScript et fonctionnalités assistées par l’IA.
Senior backend developer building Java and Spring Boot services powering Warner Bros. Discovery streaming subscriptions, commerce, and partner integrations. Operating scalable event - driven systems across AWS.
Guidewire tech lead driving Desjardins’ property and casualty insurance transformation. Leading scalable platform solutions, development practices and technical delivery.
Full - stack developer building Equisoft’s Kotlin - based insurance policy administration platform. Developing secure web features with React, Java, SQL, and microservices in an Agile team.
Senior Principal Architect shaping Rocket Software’s DataEdge data integration, cloud, and AI platform strategy. Driving cross - product architecture, shared services, and agentic systems.
Senior Full - Stack Developer building Laravel and Nuxt/Vue products for ScholarshipOwl’s AI - powered scholarship marketplace. Developing widgets, APIs, integrations, and LLM - driven education funding features.