Staff Model Risk Specialist governing machine learning and GenAI applications for Upstart, an AI lending marketplace. Evaluating model risks, controls, monitoring, and regulatory governance for Upstart Bank.
About the role
- Staff Machine Learning Engineer working on AI capabilities for clinicians and patients at Fullscript. Contributing to scalable, reliable, and clinically useful AI experiences.
Responsibilities
- Lead the design, development, and deployment of production, multi-turn LLM-powered features, including summarization tools and clinician-facing conversational agents that support follow-up questions and reasoning over clinical context
- Own backend services in Python that integrate LLM agents with Fullscript’s platform and support reliable production use
- Help define technical direction for prompting, grounding, safety, and orchestration strategies used across clinical AI workflows
- Establish and improve evaluation approaches for LLM outputs, including accuracy, hallucinations, edge cases, and overall feature quality
- Shape engineering patterns for model-related workflows, including testing, CI/CD, observability, and version control
- Partner with medical, product, and engineering teams to identify high-value opportunities for AI and turn them into practical, scalable product capabilities
- Work cross-functionally with engineering, analytics, and medical SMEs to refine requirements and ensure data and system design support clinical use cases
- Provide technical leadership across projects by creating clarity in ambiguous problem spaces, guiding tradeoff decisions, and raising the quality bar for the team
- Stay current with the latest LLM research and emerging AI technologies, and help assess where they can be applied effectively at Fullscript
Requirements
- 6+ years of experience building and implementing machine learning applications in production, including meaningful experience with LLM-powered agents, conversational experiences, or agent-based workflows
- A track record of owning complex technical problems end to end and shaping implementation beyond your immediate code contributions
- Experience designing and deploying AI systems that answer open-ended questions, support follow-up interactions, and operate reliably in production
- Strong experience with LLM application frameworks and tooling, such as LangChain, LangGraph, or similar orchestration and RAG frameworks
- Familiarity with evaluation and monitoring frameworks for LLM outputs, conversational quality, and system reliability
- Knowledge of MCP, agent orchestration patterns, or related approaches for building multi-step AI systems
- Strong proficiency in Python and SQL
- Experience making sound technical decisions around quality, safety, maintainability, and scalability in production AI systems
- Strong communication and collaboration skills, with the ability to work effectively across technical and non-technical stakeholders.
Benefits
- Flexible PTO & competitive pay—rest fuels performance.
- RRSP match & stock options—invest in your future.
- Customizable benefits—flexible coverage, paramedical services, and an HSA.
- Fullscript discounts—save on wellness products.
- Continuous learning—training budget + company-wide initiatives.
- Wherever You Work Well—hybrid and remote flexibility.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Student machine learning software engineer building end - to - end AI solutions at RBC Borealis, Royal Bank of Canada’s AI and data innovation group. Collaborating with researchers and business teams on algorithms, distributed data processing, and production - ready software.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s consumer businesses. Developing pricing and other commercial automation using experimentation, uncertainty, and policy learning.
Senior Deep Learning Engineer developing player - tracking, evaluation, and forecasting models for SumerSports’ football intelligence platform. Driving research threads into production for NFL and NCAA teams.
LP
Machine_Learning_Specialist / Data Scientist / AI Developer
LinkedIn Recruiter Post
We are seeking a Machine Learning Specialist / Data Scientist / AI Developer with 6+ years of experience in Python, R, SQL, and machine learning.
Machine Learning Specialist developing AI, models, and analytical data products for the Government of Alberta. Applying machine learning to improve public services and policymaking.
Machine Learning Engineer developing production AI models and scalable MLOps platforms for Wave, which helps small businesses thrive. Collaborating on financial - risk applications, governance, observability, and reliable deployment.
Senior Geospatial ML Engineer building satellite - imagery vegetation intelligence for a climate - tech company. Improving production models and pipelines to help utilities prevent wildfires and outages.
Senior Machine Learning Engineer building scalable recommender systems for Thomson Reuters’ legal, tax, compliance, government, and media platforms. Implementing secure ML products and infrastructure.
ML Engineer scaling Torc Robotics’ simulation platform for autonomous trucks. Embedding with Autonomy teams to operationalize replay, recompute, metrics, visualization, and model integrations.