Senior Machine Learning Engineer developing next-gen AI systems at Cresta. Leading high-impact AI initiatives and collaborating with cross-functional teams in a remote setting.
Responsibilities
Lead the design and development of Cresta’s next-generation AI Agents and Agentic Assist systems, defining system architecture and core modeling approaches.
Architect intelligent, multi-step agent workflows that combine real-time guidance, knowledge retrieval, reasoning, summarization, and automated actions into cohesive production systems.
Design, deploy, and optimize LLM-powered systems, including Retrieval-Augmented Generation (RAG) pipelines, multi-agent orchestration, and domain-adapted models.
Improve reasoning, planning, and tool-use capabilities in real-world AI applications.
Develop evaluation strategies for complex, non-deterministic systems, including offline benchmarking, online experimentation, and LLM-as-a-judge methodologies.
Diagnose and mitigate real-world failure modes such as hallucinations, retrieval errors, tool misuse, prompt brittleness, and multi-step reasoning breakdowns.
Define and measure quality metrics (e.g., accuracy, faithfulness, task completion, latency, cost, robustness) to improve system reliability and performance.
Optimize AI systems for scalability, latency, security, and cost efficiency in production environments.
Collaborate cross-functionally with product, frontend, and backend teams to integrate AI capabilities seamlessly into Cresta’s platform.
Mentor engineers, contribute to technical strategy, and help shape the roadmap for Cresta’s AI systems.
Requirements
Bachelor’s degree in Computer Science, Mathematics, or a related field; Master’s or Ph.D. preferred.
5–8+ years of industry experience building and deploying machine learning systems in production, including significant experience working with LLMs.
Strong expertise in NLP, Generative AI, transformer architectures, embeddings, and retrieval systems.
Proven experience designing and deploying Retrieval-Augmented Generation (RAG) systems in enterprise environments.
Experience building and evaluating complex agentic or multi-step LLM workflows.
Strong knowledge of modern ML frameworks and tools (e.g., PyTorch, TensorFlow, Hugging Face) and distributed/cloud-based infrastructure.
Demonstrated ability to optimize real-time ML systems for performance, scalability, and reliability.
Strong technical leadership skills, with the ability to influence cross-functional decisions and raise the engineering bar.
Benefits
We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
Paid parental leave to support you and your family
Monthly Health & Wellness allowance
Work from home office stipend to help you succeed in a remote environment
Machine Learning Engineering Intern developing innovative AI solutions for contact centers at Cresta. Collaborating with top researchers and engineers in AI to unlock customer experience potential.
MLOps/LLMOps Architect designing AI solutions for a next - gen AI platform in Canada. Collaborating with teams on architecture, deployment, and governance in AI environments.
Staff MLOps Engineer responsible for building infrastructure for AI/ML at NBCUniversal. Managing large media datasets, deploying models, and automating data pipelines.
Deep Learning Engineer at NBCUniversal implementing algorithms in computer vision and graphics. Transforming high dimensional data into high - fidelity content using advanced techniques.
Staff Deep Learning Engineer at NBCUniversal implementing core algorithms for 2D and 3D media datasets. Collaborating with cofounders and deploying large - scale algorithms for high - fidelity content.
Senior Machine Learning Engineer at DraftKings shaping player experiences through machine learning solutions. Leading initiatives to improve engagement and retention via advanced data strategies.
Machine Learning Developer at Rocket Innovation Studio designing frameworks for automated decision - making. Collaborating with data scientists to develop algorithms and hosting trained models into business processes.
MLOps Developer leading major workstreams for AI - enhanced aerial surveillance platforms. Focused on deploying deep learning models and influencing MLOps strategy.
Senior Staff Machine Learning Engineer at Workiva defining enterprise - level AI architecture and solutions. Leading technical direction and influencing secure AI platform design across multiple teams.