Senior Software Engineer building secure, distributed infrastructure for autonomous AI agents at Cohere, an enterprise AI company. Developing execution, routing, authentication, and state-management platforms.
Responsibilities
Build the next generation of agentic AI infrastructure
Develop secure execution environments for agent-generated code
Design identity, authentication, and trust boundaries for agents
Build model routing and orchestration across different model types and environments
Implement rate limiting, quotas, and resource management for agent workflows
Create state management, memory, and filesystem abstractions for agents
Turn emerging ML research ideas into production-ready infrastructure
Build core platform capabilities for execution, storage, and state management
Prototype and evaluate new technologies and help decide what moves into production
Partner with research teams to shape infrastructure for future agent systems
Requirements
Experience building production ML infrastructure with strong systems fundamentals
Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks
Familiarity with model routing and LLM provider frameworks across different model types and environments
Experience with scalable, fault-tolerant distributed systems and Kubernetes
Track record of moving quickly on prototypes and making good decisions about productionization
Experience across on-prem, private cloud, and public cloud environments
Familiarity with storage systems, embedded databases, or filesystem abstractions
Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes
Interest in emerging ML infrastructure, edge inference, or browser-native models
Open-source contributions to LLM or agent infrastructure projects
Experience with identity, workload auth, or capability-based security systems
Must be authorized to work in the country currently residing in
Benefits
A weekly lunch stipend of $75/£75 or equivalent in your local currency
Full health and dental benefits, including a separate budget for mental health
RRSP matching, 401K, Pension Scheme
100% Parental Leave top-up for up to 6 months, for either parent
Annual enrichment benefits: arts & culture, fitness/wellness, quality time, and a workspace improvement credit
Education & learning stipend for conferences, courses, and coaching
6 weeks of paid vacation (30 working days)
Budget for traveling to other offices if you are remote
Annual company offsite
Daily lunch program, snacks, and regular community and social events for office-based employees
Co-working benefit for employees not near an office
Full Stack Software Developer building software for GHD’s engineering and environmental specialists. Delivering full - stack solutions, shaping requirements, and collaborating across digital transformation projects.
Fullstack Software Engineer building end - to - end product features for WorkWhile’s AI - powered labor - market platform. Leading projects, shaping systems, and mentoring teammates in a hybrid Toronto team.
Embedded Software Developer building C/C++ FortiGate firewall security features for Fortinet. Developing EMS integration, networking capabilities, and reliable security software.
Senior DevOps Developer building AWS/GCP infrastructure and developer platforms for Benevity, whose technology helps companies and employees take social action. Automating delivery, observability, security, and cloud operations.
Senior Software Engineer building full - stack card experiences and money - movement systems at fintech company Mercury. Leading architecture, launches, reliability, and engineering quality across Mercury's Cards Integration team.
Staff Engineer setting technical direction for ChargeLab, which provides software and open APIs for EV charger networks. Architecting distributed systems and guiding engineering standards across teams.
Full - stack/backend software developer building Cisco’s cloud, networking, and security solutions. Developing reliable tools across operating systems, databases, embedded networking, IT, and web services.
Senior Full - Stack Developer building Kotlin/Java and React features for Equisoft’s cloud - native insurance policy platform. Collaborating in Agile teams on secure, high - quality software.
Software Developer building C/C++ embedded applications for Ford of Canada’s connected vehicles. Designing features, debugging software, and executing unit tests in a hybrid Ottawa team.
Senior Software Engineer building C++ and Python behavior - planning systems for AeroVect’s autonomous airport ground - handling vehicles. Developing, testing, and optimizing decision - making software for dynamic airside environments.