AI Inference Engineer – QVAC

Posted last week

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • AI Inference Engineer optimizing C++ inference engines for Tether’s private, on-device QVAC AI stack. Deploying efficient models across edge hardware without cloud infrastructure.

Responsibilities

  • Own the inference backbone behind QVAC’s local AI stack
  • Engineer the C++ systems layer for fast, reliable, and predictable model execution on user hardware
  • Optimize startup behavior, memory pressure, throughput, latency, and long-session stability
  • Define and evolve core abstractions for inference features
  • Deploy machine learning models to edge devices using llama.cpp and ggml
  • Port and enhance inference engines to run efficiently across different hardware
  • Collaborate with researchers on coding, training, and transitioning models from research to production
  • Integrate AI features into existing products
  • Ensure the inference layer is stable, optimized, and ready for stack integration

Requirements

  • Strong programming skills in C++
  • Strong experience with Llama.cpp and ggml inference engines
  • Experience with at least one GPU framework: CUDA, Vulkan, Metal, or OpenCL
  • Good understanding of deep learning concepts and model architectures
  • Experience with transformers, LLMs, and diffusion models
  • Demonstrated ability to rapidly assimilate new technologies and techniques
  • A degree in Computer Science, AI, Machine Learning, or a related field
  • Solid track record in AI R&D
  • Knowledge of training or fine-tuning LLMs is a bonus
  • Experience productionizing models is a bonus
  • Research experience in new model architectures is a bonus
  • Experience with distributed systems is a bonus
  • JavaScript experience is a bonus

Benefits

  • Remote work from anywhere in the world
  • Opportunity to collaborate with a global remote team
  • Work on private, on-device AI experiences and peer-to-peer AI products
  • Opportunity to contribute to innovative fintech, blockchain, AI, and digital asset products

Job type

Full Time

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

Distributed SystemsJavaScriptC++

Location requirements

RemoteWorldwide

Report this job

Found something wrong with the page? Please let us know by submitting a report below.