Inference runtime engineer optimizing vLLM, the open - source AI inference engine. Improving LLM and diffusion - model serving across hardware and architectures.
IN
Inferact
Currently Hiring
About the company
Inferact is a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine.
Our mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.
Open jobs
Browse and apply for open jobs at Inferact.
2 jobs found
Exceptional generalist engineers for AI inference engine development, optimizing CUDA kernels and designing distributed systems. Fully remote opportunity with a focus on autonomy.