System Software Engineer – AI

Posted 15 hours ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • System Software Engineer building communication and execution primitives for large-scale AI clusters. Optimizing distributed training and inference across thousands of GPUs.

Responsibilities

  • Help redefine the infrastructure layer of AI
  • Bridge high-level AI frameworks and low-level system software
  • Design and implement communication and execution primitives for running large-scale AI models efficiently across thousands of GPUs
  • Collaborate across the stack to influence the design of foundational technology for next-generation AI models
  • Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive software-hardware interface analysis
  • Conduct rigorous performance benchmarking and characterization on multi-node clusters

Requirements

  • Strong proficiency in C++ and Python
  • Deep understanding of systems programming fundamentals, including memory management, concurrency, and OS internals
  • Proficiency in a Linux development environment
  • Experience with GPU programming using CUDA and performance optimization for parallel architectures
  • Familiarity with distributed AI frameworks such as PyTorch, JAX, or DeepSpeed and/or inference engines such as vLLM, SGLang, or Dynamo/TRT-LLM
  • Hands-on experience with large-scale cluster orchestration and telemetry tools
  • Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field
  • Authorization to work in Canada is requested in the application
  • Ability to work in a hybrid role based in Montreal

Benefits

  • Meaningful equity
  • Benefits
  • RRSP

Job title

Job type

Full Time

Experience level

Mid levelSenior

Salary

CA$120,000 - CA$180,000 per year

Degree requirement

Bachelor's Degree

Tech skills

LinuxNode.jsPythonPyTorchC++

Location requirements

HybridMontrealCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.