System Software Engineer – AI

Posted 2 weeks ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • System Software Engineer at a stealth-mode startup building infrastructure for AI data centers. Collaborating across technology stacks to influence foundational design and optimization.

Responsibilities

  • Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models.
  • Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface.
  • Conduct rigorous performance benchmarking and characterization on multi-node clusters.

Requirements

  • Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).
  • Proficient in a Linux development environment.
  • Experience with GPU programming (CUDA) and performance optimization for parallel architectures.
  • Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).
  • Hands-on experience with large-scale cluster orchestration and telemetry tools.

Benefits

  • meaningful equity
  • benefits
  • 401k

Job type

Full Time

Experience level

Mid levelSenior

Salary

CA$120,000 - CA$180,000 per year

Degree requirement

Bachelor's Degree

Tech skills

LinuxNode.jsPythonPyTorch

Location requirements

HybridMontrealCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.