Senior Machine Learning Engineer focused on model optimization algorithms at Red Hat. Contributing to deep learning software and collaborating with product and research teams in open-source context.
Responsibilities
Contribute to the design, development, and testing of various inference optimization algorithms in the vLLM
Create and manage inference serving deployment pipelines
Benchmark, profile, and evaluate different parallelizations, quantization and sparsification approaches to determine the best performance for specific hardware and models
Stay up-to-date with the latest advancements in the open source LLM model architecture, LLM Inference parallelizations/optimizations techniques, and quantization research
Stay up-to-date of latest CPU and GPU hardware architecture and features to boost AI inference performance
Give thoughtful and prompt code reviews
Continuous collaboration with internal and external open source committers and contributors while contributing to vLLM and related projects
Requirements
Strong understanding of machine learning and deep learning fundamentals
Experience in one or more of LLM Inference Optimizations, Computer Vision, NLP, and reinforcement learning
Experience with tensor math libraries such as PyTorch and NumPy
Strong programming skills with proven experience implementing Python based machine learning solutions
Ability to develop and implement research ideas and algorithms
Experience with mathematical software, especially linear algebra
Understanding of Linear Algebra, Gradients, Probability, and Graph Theory
BS, or MS, or PhD in computer science or computer engineering or a related field.
Staff Model Risk Specialist governing machine learning and GenAI applications for Upstart, an AI lending marketplace. Evaluating model risks, controls, monitoring, and regulatory governance for Upstart Bank.
Student machine learning software engineer building end - to - end AI solutions at RBC Borealis, Royal Bank of Canada’s AI and data innovation group. Collaborating with researchers and business teams on algorithms, distributed data processing, and production - ready software.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s consumer businesses. Developing pricing and other commercial automation using experimentation, uncertainty, and policy learning.
Senior Deep Learning Engineer developing player - tracking, evaluation, and forecasting models for SumerSports’ football intelligence platform. Driving research threads into production for NFL and NCAA teams.
Machine Learning Specialist developing AI, models, and analytical data products for the Government of Alberta. Applying machine learning to improve public services and policymaking.
Machine Learning Engineer developing production AI models and scalable MLOps platforms for Wave, which helps small businesses thrive. Collaborating on financial - risk applications, governance, observability, and reliable deployment.
Senior Geospatial ML Engineer building satellite - imagery vegetation intelligence for a climate - tech company. Improving production models and pipelines to help utilities prevent wildfires and outages.
Senior Machine Learning Engineer building scalable recommender systems for Thomson Reuters’ legal, tax, compliance, government, and media platforms. Implementing secure ML products and infrastructure.
ML Engineer scaling Torc Robotics’ simulation platform for autonomous trucks. Embedding with Autonomy teams to operationalize replay, recompute, metrics, visualization, and model integrations.