MLOps Engineer, LLM Systems, Serving, GPU Kernels, Profiling

Posted last week

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • MLOps Engineer creating and evaluating training data for a leading AI lab's GenAI systems. Focusing on GPU kernels, profiling, distributed debugging, and high-throughput LLM serving.

Responsibilities

  • Design challenging, domain-relevant tasks across GPU kernels, performance profiling, debugging, and inference serving, and write accurate, well-structured solutions
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, training infrastructure, and framework-level topics
  • Evaluate MLOps and ML systems tasks and solutions and provide clear, written technical feedback
  • Develop guidelines and detailed rubrics or evaluation frameworks covering kernel-level optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs
  • Collaborate with subject matter experts to keep training data consistent and accurate
  • Contribute to AI model training and evaluation work by writing and assessing MLOps and ML systems tasks and solutions for frontier AI training data

Requirements

  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU and accelerator performance engineering
  • Practical experience in at least one of: writing or optimizing custom GPU kernels (CUDA, Triton, Pallas); performance profiling and trace analysis (Kineto, torch.profiler, Nsight, XLA or JAX profiler); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, Ray Serve, KV cache, paged attention, continuous batching)
  • Working production experience with JAX and/or PyTorch
  • Familiarity with modern accelerators such as A100, H100, B200 or TPU
  • Ability to reason about throughput, latency and memory trade-offs
  • Demonstrable career progression
  • Ability to engage reliably for at least 40 hours/week during weekdays
  • Strong written communication skills and ability to explain complex technical decisions clearly

Job title

Job type

Part Time

Experience level

JuniorMid level

Salary

$90 - $120 per hour

Degree requirement

No Education Requirement

Tech skills

Distributed SystemsPyTorchRay

Location requirements

RemoteUnited States

Report this job

Found something wrong with the page? Please let us know by submitting a report below.