Senior developer building production AI agents for Knak’s enterprise email and landing - page platform. Developing agent runtimes, evaluations, APIs, and AWS infrastructure.
About the role
- Staff Software Engineer building AI/ML and evaluation infrastructure for Thumbtack's home-services marketplace. Designing scalable GenAI platforms, model systems, and developer tooling.
Responsibilities
- Build and evolve core AI platform capabilities for GenAI-powered applications
- Design, develop, and deploy scalable tools and infrastructure for applied scientists
- Support ML model training and serving systems, feature and data workflows, CI/CD, orchestration, deployment, and evaluation tooling
- Work hands-on across backend services, execution infrastructure, AI models, and tooling
- Evaluate next-generation AI infrastructure frameworks and tools
- Drive projects to completion with focus on business impact and measurable outcomes
- Set technical direction across AI/ML and AI evaluation platforms
- Partner with applied scientists, product engineering teams, senior engineers, and engineering leadership
- Define multi-quarter roadmaps and make build/buy/adopt decisions
- Ensure the platform scales with Thumbtack's AI ambitions
- Solve complex technical problems and stay current with advances in AI infrastructure
Requirements
- 10+ years of professional software engineering experience
- Track record of technical leadership at staff level or equivalent scope
- Experience setting direction for systems spanning multiple teams and driving them through production
- 3+ years building AI/ML infrastructure in production
- Hands-on experience with LLM-powered systems in production
- Experience with LLM gateways or proxies, prompt and model lifecycle management, RAG or agentic architectures, and cost optimization for LLM workloads
- Experience building or operating AI evaluation systems
- Experience with offline evaluation pipelines, LLM-as-judge approaches and calibration against human judgment, regression testing, or A/B measurement of AI features
- Deep experience designing, building, and operating reliable distributed systems
- Production service ownership at meaningful scale
- On-call responsibility and incident leadership
- Demonstrated ability to use AI coding tools and validate, critique, and refine AI-generated output
Benefits
- Equal opportunity workplace
- Reasonable accommodation for individuals with disabilities
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Group Product Manager leading product managers and delivery for Caseware’s AI audit platform. Coordinating agents, evaluation tools, and AI workflow innovation at Canadian fintech Caseware.
Staff Software Engineer building scalable AI/ML platforms and evaluation systems. Enabling Thumbtack’s home - services marketplace and GenAI - powered customer experiences.
Senior Software Engineer owning end - to - end AI - powered cybersecurity product development at Sophos. Building LLM - driven workflows, automation, interfaces, APIs, and scalable systems.
AI/ML developer intern building cloud - native software for Kinaxis, a global supply - chain orchestration company. Developing ML pipelines, models, and reliable platform capabilities.
Staff AI Engineer building retrieval, inference, and agentic systems for Acquia’s Drupal - based digital experience platform. Shipping shared AI capabilities that turn enterprise data signals into customer workflows.
Applied AI Engineer building LLM - powered pipelines that transform municipal websites into structured CMS content. Automating migration, validation, and internal tooling for SimpliCity’s Canadian GovTech platform.
Senior Java Developer with AI experience building ELITS cloud software products. Leading Java, Kubernetes, CI/CD, architecture, and developer mentoring for Montreal’s hybrid team.
Software Architect building next - generation AI agents and automation for Jerry.ai’s insurance marketplace. Scaling voicebots, LLM systems, and external - system workflows across physical - asset services.
Senior frontend - focused engineer building Pebl’s conversational AI assistant. Shaping streaming, agentic UX for a platform enabling global hiring and workforce management.