Senior Software Engineer building foundational AI infrastructure for Juniper Square’s private - markets finance platform. Developing production systems, LLM capabilities, and reusable engineering tools.
About the role
- Senior developer building production AI agents for Knak’s enterprise email and landing-page platform. Developing agent runtimes, evaluations, APIs, and AWS infrastructure.
Responsibilities
- Build and scale the AI-agent harness behind Knak’s enterprise email and landing-page platform
- Design and implement the core Python agent runtime, including orchestration loops, tool definitions and execution, memory and context management, structured outputs, and failure handling
- Build and maintain evaluation datasets, automated evaluators, and LangSmith LLM-as-judge pipelines
- Diagnose agent failures, tune prompts and tool designs, and run model comparisons and benchmarks
- Build Python and Node.js AI microservices for agent hosting and LLM interaction
- Develop and maintain Laravel (PHP) APIs integrating agents into the Knak platform
- Use AWS services including Lambda, Bedrock, and CDN delivery to deploy secure, scalable infrastructure
- Tune MySQL queries and indexing
- Lead and participate in code reviews
- Collaborate with product, design, QA, and DevOps
- Mentor engineers on agent development and evaluation practices
- Contribute to architecture decisions and collaborate with engineering and product
Requirements
- 6+ years of backend software development experience
- Hands-on experience building LLM-powered agents in production, including tool calling, orchestration, context management, and prompt engineering
- Experience designing and running evaluations for LLM systems, including dataset curation, automated evaluators, LLM-as-judge, and regression tracking
- Strong proficiency in Python, Node.js, and MySQL
- Expertise in RESTful APIs, TDD, and CI/CD with GitHub Actions
- Experience with SaaS architecture, microservices, and AWS
- Knowledge of observability, performance tuning, and scalability
- Familiarity with Docker/Kubernetes
- Excellent problem-solving skills and a collaborative mindset
Benefits
- Competitive salaries
- Equity in the company
- Great benefits
- Paid vacation
- Life leave days
- Team lunches and off-sites
- Commitment to career growth
- Inclusive, barrier-free working environment
- Interview-process accommodations
- AI screening and transcribed video interviews with human decision-making
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Group Product Manager leading product managers and delivery for Caseware’s AI audit platform. Coordinating agents, evaluation tools, and AI workflow innovation at Canadian fintech Caseware.
Staff Software Engineer building AI/ML and evaluation infrastructure for Thumbtack's home - services marketplace. Designing scalable GenAI platforms, model systems, and developer tooling.
Staff Software Engineer building scalable AI/ML platforms and evaluation systems. Enabling Thumbtack’s home - services marketplace and GenAI - powered customer experiences.
Senior Software Engineer owning end - to - end AI - powered cybersecurity product development at Sophos. Building LLM - driven workflows, automation, interfaces, APIs, and scalable systems.
Staff AI Engineer building retrieval, inference, and agentic systems for Acquia’s Drupal - based digital experience platform. Shipping shared AI capabilities that turn enterprise data signals into customer workflows.
AI/ML developer intern building cloud - native software for Kinaxis, a global supply - chain orchestration company. Developing ML pipelines, models, and reliable platform capabilities.
Applied AI Engineer building LLM - powered pipelines that transform municipal websites into structured CMS content. Automating migration, validation, and internal tooling for SimpliCity’s Canadian GovTech platform.
Senior Java Developer with AI experience building ELITS cloud software products. Leading Java, Kubernetes, CI/CD, architecture, and developer mentoring for Montreal’s hybrid team.
Software Architect building next - generation AI agents and automation for Jerry.ai’s insurance marketplace. Scaling voicebots, LLM systems, and external - system workflows across physical - asset services.