ML Engineer training diffusion models for Hapiko’s voice - activated Stickerbox, which turns kids’ spoken ideas into stickers. Bringing Spin Master characters into production safely and on - model.
About the role
- Senior Machine Learning Engineer focused on model optimization algorithms at Red Hat. Contributing to deep learning software and collaborating with product and research teams in open-source context.
Responsibilities
- Contribute to the design, development, and testing of various inference optimization algorithms in the vLLM
- Create and manage inference serving deployment pipelines
- Benchmark, profile, and evaluate different parallelizations, quantization and sparsification approaches to determine the best performance for specific hardware and models
- Stay up-to-date with the latest advancements in the open source LLM model architecture, LLM Inference parallelizations/optimizations techniques, and quantization research
- Stay up-to-date of latest CPU and GPU hardware architecture and features to boost AI inference performance
- Give thoughtful and prompt code reviews
- Continuous collaboration with internal and external open source committers and contributors while contributing to vLLM and related projects
Requirements
- Strong understanding of machine learning and deep learning fundamentals
- Experience in one or more of LLM Inference Optimizations, Computer Vision, NLP, and reinforcement learning
- Experience with tensor math libraries such as PyTorch and NumPy
- Strong programming skills with proven experience implementing Python based machine learning solutions
- Ability to develop and implement research ideas and algorithms
- Experience with mathematical software, especially linear algebra
- Understanding of Linear Algebra, Gradients, Probability, and Graph Theory
- BS, or MS, or PhD in computer science or computer engineering or a related field.
Benefits
- Flexible work arrangements
- Professional development opportunities
- Health insurance
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Trust & Safety ML Engineer safeguarding Hapiko’s generative - AI sticker printer for children. Owning moderation pipelines, safety evaluations, classifiers, red teaming, and compliance systems.
MLOps Engineer building production ML infrastructure, pipelines, and monitoring for exacare ai’s post - acute care AI platform. Scaling reliable systems that help healthcare teams make safer placement decisions.
Senior Data Engineer building cloud - native data and ML platforms for Hive.co’s event - marketing automation products. Owning pipelines, model infrastructure, and audience - data systems at scale.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s AI - native omnichannel retail brands. Deploying machine learning that improves pricing and other commercial decisions.
Director leading agentic AI and machine learning products for Instacart’s grocery technology platform. Building retailer solutions and guiding teams from strategy through production deployment.
New - grad software engineer building Quora’s distributed ML platform, model serving, and developer tooling. Supporting Quora’s global knowledge - sharing product with scalable GPU infrastructure.
Applied Machine Learning Scientist developing Generative AI and predictive ML solutions at TD, a major North American bank. Supporting model evaluation, deployment, monitoring, and responsible AI governance.
Applied Machine Learning Scientist developing Generative AI and predictive ML solutions for TD banking. Evaluating models, managing AI lifecycles, and supporting responsible implementation.
Senior Machine Learning Engineer building conversational AI agents and production ML systems. Helping Numa automate automotive dealership service and sales through evaluation - first tooling and infrastructure.