System Software Engineer building communication and execution primitives for large-scale AI clusters. Optimizing distributed training and inference across thousands of GPUs.
Responsibilities
Help redefine the infrastructure layer of AI
Bridge high-level AI frameworks and low-level system software
Design and implement communication and execution primitives for running large-scale AI models efficiently across thousands of GPUs
Collaborate across the stack to influence the design of foundational technology for next-generation AI models
Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive software-hardware interface analysis
Conduct rigorous performance benchmarking and characterization on multi-node clusters
Requirements
Strong proficiency in C++ and Python
Deep understanding of systems programming fundamentals, including memory management, concurrency, and OS internals
Proficiency in a Linux development environment
Experience with GPU programming using CUDA and performance optimization for parallel architectures
Familiarity with distributed AI frameworks such as PyTorch, JAX, or DeepSpeed and/or inference engines such as vLLM, SGLang, or Dynamo/TRT-LLM
Hands-on experience with large-scale cluster orchestration and telemetry tools
Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field
Authorization to work in Canada is requested in the application
Ability to work in a hybrid role based in Montreal
Staff AI Engineer leading Compass, Basis’s LLM - powered agent platform for digital media operations. Architecting agent systems, MCP/A2A integrations, evaluation, and AI - assisted engineering practices.
Senior Applied AI Engineer turning machine learning research into production features for Clariti’s government technology platform. Building LLM, computer vision, and agentic AI capabilities.
Software Engineer evaluating AI - generated code, architecture, and reasoning for Gramian Consultancy. Creating coding problems and feedback to improve next - generation AI models.
AI Engineer embedding LLMs, RAG, and automation into KidKare’s configurable childcare SaaS platforms. Accelerating engineering delivery across legacy systems and development teams.
Freelance Mechanical CFD Engineer training AI agents through CAD - based fluid simulations. Building verified reference solutions and Python checks for a global technology platform.
CAD Engineer training and evaluating AI agents inside real CAD environments. Designing simulation - ready geometry and judging long engineering task solutions for a global platform.
Forward Deployed Engineer deploying Scopic’s SOC for AI platform for enterprise security and compliance. Building Python workflows, integrating MCPs, and leading client implementations.
CFD Engineer training and evaluating AI agents on expert - level fluid simulations. Building verified solutions from CAD geometry and writing Python checks for a global technology platform.
Freelance Mechanical CAD and Simulation Engineer training AI agents in real CAD environments. Designing geometry, building reference solutions, and evaluating engineering tasks for a global platform.
VP of AI Engineering guiding Wonderly’s engineering organization and AI - native software factory. Building internal tools and production systems that help Main Street businesses grow profitably.