AI Inference Engineer optimizing C++ inference engines for Tether’s private, on-device QVAC AI stack. Deploying efficient models across edge hardware without cloud infrastructure.
Responsibilities
Own the inference backbone behind QVAC’s local AI stack
Engineer the C++ systems layer for fast, reliable, and predictable model execution on user hardware
Optimize startup behavior, memory pressure, throughput, latency, and long-session stability
Define and evolve core abstractions for inference features
Deploy machine learning models to edge devices using llama.cpp and ggml
Port and enhance inference engines to run efficiently across different hardware
Collaborate with researchers on coding, training, and transitioning models from research to production
Integrate AI features into existing products
Ensure the inference layer is stable, optimized, and ready for stack integration
Requirements
Strong programming skills in C++
Strong experience with Llama.cpp and ggml inference engines
Experience with at least one GPU framework: CUDA, Vulkan, Metal, or OpenCL
Good understanding of deep learning concepts and model architectures
Experience with transformers, LLMs, and diffusion models
Demonstrated ability to rapidly assimilate new technologies and techniques
A degree in Computer Science, AI, Machine Learning, or a related field
Solid track record in AI R&D
Knowledge of training or fine-tuning LLMs is a bonus
Experience productionizing models is a bonus
Research experience in new model architectures is a bonus
Experience with distributed systems is a bonus
JavaScript experience is a bonus
Benefits
Remote work from anywhere in the world
Opportunity to collaborate with a global remote team
Work on private, on-device AI experiences and peer-to-peer AI products
Opportunity to contribute to innovative fintech, blockchain, AI, and digital asset products
P&C insurance professionals converting underwriting, reinsurance, pricing, reserving, and claims expertise into AI training datasets. Fully remote, flexible contractor project.
Practicing economists creating and evaluating training data for advanced AI systems. Focusing on forecasting, antitrust, trade policy, public policy, and economic impact analysis.
Head of AI building Momentum’s self - improving ecommerce platform. Designing AI systems that identify retail opportunities, recommend improvements, and learn from experiments.
Freelance KI - Management lecturer delivering practice - oriented digital courses for Learning Digital GmbH, a certified continuing - education provider. Supporting and individually mentoring students worldwide.
AI technical expert building enterprise AI agents and learning tools for Equinix’s Digital University. Teaching engineers practical AI use, prompt engineering, and responsible AI practices.
US - licensed physicians evaluate clinical EHR cases and reasoning to test Mindrift’s medical AI systems. Flexible, task - based independent contractor project with no patient contact.
Physician Reviewer evaluating EHR vignettes, reasoning, diagnoses, and treatments for Mindrift’s medical AI projects. Flexible task - based contract for US - licensed physicians.
AI Agent Evaluation Engineer defining quality standards and evaluation systems for Cresta’s conversational AI receptionist. Analyzing multilingual calls, calibrating LLM judges, and maintaining regression suites.
Economists translating applied economic analysis into AI training tasks for Terac. Evaluating model outputs and creating prompts on forecasting, antitrust, trade, and policy.
AI Tutor refining Grok’s Maltese voice and language capabilities for SpaceXSI. Annotating multilingual audio and localizing English content into natural, culturally accurate Maltese.