Senior Principal Data Scientist building predictive models and evaluation systems for Autodesk’s agentic AI design platform.
Defining telemetry, experimentation, and product intelligence for complex user workflows.
Responsibilities
Design and implement predictive models to analyze and anticipate user behavior, intent, and outcomes across multi-agent workflows
Define and establish data instrumentation, telemetry, and observability standards for agent-based systems and user interactions
Develop frameworks and prototypes for analyzing and optimizing non-deterministic user experiences driven by AI agents
Collaborate with product and engineering teams to integrate predictive intelligence into agent orchestration and decision-making systems
Create analytical models and reporting frameworks for business intelligence, forecasting, and performance insights
Guide experimentation strategies, including A/B testing, causal inference, and evaluation methodologies for agent performance
Provide technical leadership and recommendations on data architecture, model selection, and system scalability
Translate ambiguous, early-stage product questions into structured analytical programs with clear hypotheses, methods, and business impact
Help build fundamental experiences for Autodesk’s agentic product platform and define and predict user and product success
Partner with product, engineering, and platform teams to build measurement and intelligence tools and appropriate infrastructure
Requirements
10+ years in data science or applied ML, with significant time in product analytics or user behavior modeling
Ability to conduct applied research and translate emerging AI advances into practical product and measurement innovations
Knowledge of LLMs, agentic systems, MCP, tool-use frameworks, and RAG architectures
Familiarity with AI evaluation approaches including benchmark datasets, offline and online evaluation, LLM-as-a-Judge, human-in-the-loop evaluations, and quality measurement for non-deterministic outputs
Deep experience with predictive modeling, including classification, survival analysis, sequence models, or LTV/propensity frameworks
Fluency in designing instrumentation and event schemas for complex, stateful systems
Ability to define metrics and measurement frameworks for new product spaces
Experience working on or adjacent to AI/ML-powered products, especially products with nondeterministic outputs
Ability to translate modeling work into product and business language at the executive level
Benefits
Competitive compensation package
Annual cash bonuses may be included
Stock grants may be included
Comprehensive benefits package
Health and financial benefits
Time away
Everyday wellness benefits
In-person onboarding and/or in-person ID verification may be required
Lead Data Scientist developing AML transaction - monitoring models for RBC, a major Canadian bank. Applying machine learning, rules, and analytics to identify financial crime risk.
Data Scientist building predictive weather models and commercial data products for Pelmorex, a weather intelligence company. Developing scalable machine learning solutions for B2B forecasting, advertising, and enterprise decision - making.
Associate Data Scientist building predictive models and AI applications for AlgaeCal’s clinically backed natural bone - loss solution. Turning large datasets into strategies that improve efficiency, sales, and profitability.
Senior Data Scientist building real - time courier pay and dynamic pricing models for Just Eat Takeaway.com. Optimizing marketplace efficiency and earnings fairness through machine learning and experimentation.
Data Scientist building production ML, NLP, and GenAI solutions for Irth’s critical - infrastructure SaaS platform. Developing Databricks pipelines and maintainable software for damage prevention and asset integrity.
Junior data scientist supporting derivatives, VaR, stress testing, and regulatory risk models at Desjardins. Implementing methodologies and risk - system products in a hybrid Montréal role.
Evaluating data science and quantitative AI outputs for Gramian Consultancy, an IT professional services and engineering talent consultancy. Creating prompts, datasets, and feedback to improve AI models.
Data Scientist structuring medical knowledge and evaluating AI - driven educational products for Lecturio, a global medical and nursing e - learning platform. Developing statistical validation frameworks and Knowledge Graph API integrations.
Credit risk modelling data scientist developing and maintaining models for Desjardins. Guiding risk quantification, credit decisions, compliance, and practitioner - led modelling projects.