Staff Model Risk Specialist governing machine learning and GenAI applications for Upstart, an AI lending marketplace. Evaluating model risks, controls, monitoring, and regulatory governance for Upstart Bank.
About the role
- Principal Machine Learning Engineer evaluating ML models at Autodesk for CAD/BIM workflows. Collaborating with teams to ensure quality, reliability and customer impact in ML-powered products.
Responsibilities
- Design and execute evaluation protocols (datasets, metrics, statistical analysis) that reflect real user workflows for CAD/BIM and production conditions
- Develop reproducible evaluation tools and automations to support model development, regression testing, and release-readiness decisions
- Collect, process, and analyze data from multiple sources to assess model behavior and customer outcomes
- Validate end-to-end ML-based product experiments and translate product requirements into measurable evaluation criteria
- Communicate findings and recommendations clearly to researchers, engineers, product teams, and leadership
- Document model quality issues discovered in production
Requirements
- BS or MS in Mechanical Engineering, Architecture, Computer Engineering, Computer Science, Applied Mathematics, Statistics, or equivalent professional experience
- 4+ years of professional experience in ML model evaluation, ML QA, or applied ML engineering
- Strong software engineering skills, including Python, data pipelines, testable and maintainable code, version control, and cloud-based workflows
- Strong written communication skills to document evaluation methods, results, and recommendations
Benefits
- Base salary
- Annual cash bonuses
- Commissions for sales roles
- Equity grants
- Comprehensive benefits package
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Student machine learning software engineer building end - to - end AI solutions at RBC Borealis, Royal Bank of Canada’s AI and data innovation group. Collaborating with researchers and business teams on algorithms, distributed data processing, and production - ready software.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s consumer businesses. Developing pricing and other commercial automation using experimentation, uncertainty, and policy learning.
Senior Deep Learning Engineer developing player - tracking, evaluation, and forecasting models for SumerSports’ football intelligence platform. Driving research threads into production for NFL and NCAA teams.
LP
Machine_Learning_Specialist / Data Scientist / AI Developer
LinkedIn Recruiter Post
We are seeking a Machine Learning Specialist / Data Scientist / AI Developer with 6+ years of experience in Python, R, SQL, and machine learning.
Machine Learning Specialist developing AI, models, and analytical data products for the Government of Alberta. Applying machine learning to improve public services and policymaking.
Machine Learning Engineer developing production AI models and scalable MLOps platforms for Wave, which helps small businesses thrive. Collaborating on financial - risk applications, governance, observability, and reliable deployment.
Senior Geospatial ML Engineer building satellite - imagery vegetation intelligence for a climate - tech company. Improving production models and pipelines to help utilities prevent wildfires and outages.
Senior Machine Learning Engineer building scalable recommender systems for Thomson Reuters’ legal, tax, compliance, government, and media platforms. Implementing secure ML products and infrastructure.
ML Engineer scaling Torc Robotics’ simulation platform for autonomous trucks. Embedding with Autonomy teams to operationalize replay, recompute, metrics, visualization, and model integrations.