Staff Model Risk Specialist governing machine learning and GenAI applications for Upstart, an AI lending marketplace. Evaluating model risks, controls, monitoring, and regulatory governance for Upstart Bank.
About the role
- Senior Machine Learning Engineer developing next-gen AI systems at Cresta. Leading high-impact AI initiatives and collaborating with cross-functional teams in a remote setting.
Responsibilities
- Lead the design and development of Cresta’s next-generation AI Agents and Agentic Assist systems, defining system architecture and core modeling approaches.
- Architect intelligent, multi-step agent workflows that combine real-time guidance, knowledge retrieval, reasoning, summarization, and automated actions into cohesive production systems.
- Design, deploy, and optimize LLM-powered systems, including Retrieval-Augmented Generation (RAG) pipelines, multi-agent orchestration, and domain-adapted models.
- Improve reasoning, planning, and tool-use capabilities in real-world AI applications.
- Develop evaluation strategies for complex, non-deterministic systems, including offline benchmarking, online experimentation, and LLM-as-a-judge methodologies.
- Diagnose and mitigate real-world failure modes such as hallucinations, retrieval errors, tool misuse, prompt brittleness, and multi-step reasoning breakdowns.
- Define and measure quality metrics (e.g., accuracy, faithfulness, task completion, latency, cost, robustness) to improve system reliability and performance.
- Optimize AI systems for scalability, latency, security, and cost efficiency in production environments.
- Collaborate cross-functionally with product, frontend, and backend teams to integrate AI capabilities seamlessly into Cresta’s platform.
- Mentor engineers, contribute to technical strategy, and help shape the roadmap for Cresta’s AI systems.
Requirements
- Bachelor’s degree in Computer Science, Mathematics, or a related field; Master’s or Ph.D. preferred.
- 5–8+ years of industry experience building and deploying machine learning systems in production, including significant experience working with LLMs.
- Strong expertise in NLP, Generative AI, transformer architectures, embeddings, and retrieval systems.
- Proven experience designing and deploying Retrieval-Augmented Generation (RAG) systems in enterprise environments.
- Experience building and evaluating complex agentic or multi-step LLM workflows.
- Strong knowledge of modern ML frameworks and tools (e.g., PyTorch, TensorFlow, Hugging Face) and distributed/cloud-based infrastructure.
- Demonstrated ability to optimize real-time ML systems for performance, scalability, and reliability.
- Strong technical leadership skills, with the ability to influence cross-functional decisions and raise the engineering bar.
Benefits
- We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
- Paid parental leave to support you and your family
- Monthly Health & Wellness allowance
- Work from home office stipend to help you succeed in a remote environment
- Lunch reimbursement for in-office employees
- PTO: 3 weeks in Canada
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Student machine learning software engineer building end - to - end AI solutions at RBC Borealis, Royal Bank of Canada’s AI and data innovation group. Collaborating with researchers and business teams on algorithms, distributed data processing, and production - ready software.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s consumer businesses. Developing pricing and other commercial automation using experimentation, uncertainty, and policy learning.
Senior Deep Learning Engineer developing player - tracking, evaluation, and forecasting models for SumerSports’ football intelligence platform. Driving research threads into production for NFL and NCAA teams.
LP
Machine_Learning_Specialist / Data Scientist / AI Developer
LinkedIn Recruiter Post
We are seeking a Machine Learning Specialist / Data Scientist / AI Developer with 6+ years of experience in Python, R, SQL, and machine learning.
Machine Learning Specialist developing AI, models, and analytical data products for the Government of Alberta. Applying machine learning to improve public services and policymaking.
Machine Learning Engineer developing production AI models and scalable MLOps platforms for Wave, which helps small businesses thrive. Collaborating on financial - risk applications, governance, observability, and reliable deployment.
Senior Geospatial ML Engineer building satellite - imagery vegetation intelligence for a climate - tech company. Improving production models and pipelines to help utilities prevent wildfires and outages.
Senior Machine Learning Engineer building scalable recommender systems for Thomson Reuters’ legal, tax, compliance, government, and media platforms. Implementing secure ML products and infrastructure.
ML Engineer scaling Torc Robotics’ simulation platform for autonomous trucks. Embedding with Autonomy teams to operationalize replay, recompute, metrics, visualization, and model integrations.