Staff Model Risk Specialist governing machine learning and GenAI applications for Upstart, an AI lending marketplace.
Evaluating model risks, controls, monitoring, and regulatory governance for Upstart Bank.
Responsibilities
Partner with Machine Learning teams, GenAI application developers, business sponsors, and other stakeholders to maintain model and GenAI application inventories, risk assessments, documentation, monitoring reports, and governance materials.
Review methodologies, assumptions, data inputs, system designs, performance measures, controls, and limitations to provide effective challenge and identify remediation needs.
Evaluate quantitative methods and technologies ranging from traditional statistical and financial models to complex machine learning models and GenAI applications.
Conduct and document model risk assessments, monitoring reviews, and targeted quantitative analyses supporting internal policies and regulatory expectations.
Develop practical governance approaches for new and evolving machine learning and GenAI technologies.
Respond to model- and GenAI-related questions from regulators, lending partners, and external stakeholders in collaboration with Machine Learning, business, Legal, Compliance, and partner-facing teams.
Track model risk issues, remediation plans, program goals, and emerging risks; escalate material findings and recommend improvements.
Independently execute core components of Upstart Bank’s model risk management program across lending, fraud, compliance, finance, capital and liquidity, servicing, and operational risk models.
Requirements
Master’s degree in a quantitative field such as finance, mathematics, economics, statistics, or a related discipline
4+ years of experience in model risk management, model validation, model governance, machine learning, data science, quantitative risk, AI governance, or a related technical risk function
Internship or project experience related to model risk management, model validation, machine learning, or data science
Basic understanding of AI/ML methodologies such as tree-based models and neural networks
General familiarity with GenAI applications
Experience coding in R, Python, or similar languages such as Matlab
Preferred: PhD in a quantitative field
Preferred: 5+ years of experience in model risk management or model governance or related fields
Preferred: Familiarity with GenAI evaluation approaches, prompt and system design, retrieval-augmented generation, tool use, guardrails, and ongoing monitoring
Staff - level ML Engineer building Yelp’s content and contributor intelligence systems with neural networks, LLMs, and multimodal embeddings. Productionizing end - to - end ML pipelines for Yelp’s local - business platform.
Machine Learning Engineer II developing production ML models for Affirm’s pay - over - time platform. Building credit decisioning systems, scalable pipelines, and algorithms that predict default and guide approvals.
Sr. AI/ML Engineer building and deploying AI models for AlertMedia’s risk intelligence and response SaaS platform. Optimizing LLMs, machine - learning pipelines and production AI features.
New - grad Machine Learning Engineer building LLM agents and moderation systems for Quora’s knowledge - sharing platform. Evaluating and deploying ML solutions that improve content quality and safety at scale.
Senior MLOps Engineer scaling ML infrastructure for CivCheck, Clariti’s AI - powered government permitting software. Productionizing models with reliable pipelines, cloud systems, observability, and performance at scale.
Senior machine learning scientist leading predictive AI teams at TD, a major Canadian bank. Developing regression, classification, and anomaly detection models for personal banking.
ML Engineer training diffusion models for Hapiko’s voice - activated Stickerbox, which turns kids’ spoken ideas into stickers. Bringing Spin Master characters into production safely and on - model.
Trust & Safety ML Engineer safeguarding Hapiko’s generative - AI sticker printer for children. Owning moderation pipelines, safety evaluations, classifiers, red teaming, and compliance systems.
MLOps Engineer building production ML infrastructure, pipelines, and monitoring for exacare ai’s post - acute care AI platform. Scaling reliable systems that help healthcare teams make safer placement decisions.