Engineer developing algorithms and optimizations for NVIDIA's LPX inference and compiler stack. Collaborating on neural network workload mappings to NVIDIA platforms.
Responsibilities
Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.
Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.
Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.
Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.
Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.
Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.
Requirements
Pursuing or recently completed a MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience.
Possess software engineering background with familiarity in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.
Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.
Understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.
Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.
MLOps Engineer building production ML infrastructure, pipelines, and monitoring for exacare ai’s post - acute care AI platform. Scaling reliable systems that help healthcare teams make safer placement decisions.
Senior Data Engineer building cloud - native data and ML platforms for Hive.co’s event - marketing automation products. Owning pipelines, model infrastructure, and audience - data systems at scale.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s AI - native omnichannel retail brands. Deploying machine learning that improves pricing and other commercial decisions.
Director leading agentic AI and machine learning products for Instacart’s grocery technology platform. Building retailer solutions and guiding teams from strategy through production deployment.
New - grad software engineer building Quora’s distributed ML platform, model serving, and developer tooling. Supporting Quora’s global knowledge - sharing product with scalable GPU infrastructure.
Applied Machine Learning Scientist developing Generative AI and predictive ML solutions at TD, a major North American bank. Supporting model evaluation, deployment, monitoring, and responsible AI governance.
Applied Machine Learning Scientist developing Generative AI and predictive ML solutions for TD banking. Evaluating models, managing AI lifecycles, and supporting responsible implementation.
Senior Machine Learning Engineer building conversational AI agents and production ML systems. Helping Numa automate automotive dealership service and sales through evaluation - first tooling and infrastructure.
Senior ML Engineer building production ML, RAG, and agentic AI capabilities for SailPoint’s cloud identity security platform. Driving scalable, customer - focused AI solutions from research to production.
Senior ML Engineer developing debiased pCTR and conversion models for Instacart’s grocery advertising ecosystem. Advancing ranking, retrieval, and sequence modeling across ads surfaces.