MLOps Engineer creating and evaluating training data for a leading AI lab's GenAI systems. Focusing on GPU kernels, profiling, distributed debugging, and high-throughput LLM serving.
Responsibilities
Design challenging, domain-relevant tasks across GPU kernels, performance profiling, debugging, and inference serving, and write accurate, well-structured solutions
Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, training infrastructure, and framework-level topics
Evaluate MLOps and ML systems tasks and solutions and provide clear, written technical feedback
Develop guidelines and detailed rubrics or evaluation frameworks covering kernel-level optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs
Collaborate with subject matter experts to keep training data consistent and accurate
Contribute to AI model training and evaluation work by writing and assessing MLOps and ML systems tasks and solutions for frontier AI training data
Requirements
2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU and accelerator performance engineering
Practical experience in at least one of: writing or optimizing custom GPU kernels (CUDA, Triton, Pallas); performance profiling and trace analysis (Kineto, torch.profiler, Nsight, XLA or JAX profiler); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, Ray Serve, KV cache, paged attention, continuous batching)
Working production experience with JAX and/or PyTorch
Familiarity with modern accelerators such as A100, H100, B200 or TPU
Ability to reason about throughput, latency and memory trade-offs
Demonstrable career progression
Ability to engage reliably for at least 40 hours/week during weekdays
Strong written communication skills and ability to explain complex technical decisions clearly
Quality Assurance Engineer validating conversational AI, IVR, and voice customer experience solutions for global IT services company Miratech. Automating tests and ensuring reliable integrations across enterprise platforms.
Quality Assurance Engineer validating conversational AI, IVR, and voice customer experiences at global IT services company Miratech. Creating automated tests and verifying integrations, workflows, and end - to - end quality.
AI Engineer building and improving production LLM features for dexter health’s AI - powered healthcare software. Shipping reliable workflows that reduce caregivers’ administrative workload.
Research Engineer productionizing generative AI models for Waabi’s autonomous trucks and robotaxis. Optimizing GPU performance, simulation realism, and deployment tooling at Waabi.
Engineer joining Cerebras to rapidly deploy AI models on proprietary CSX systems. Focused on debugging and enhancing model performance in a dynamic, innovative environment.