Junior data scientist supporting derivatives, VaR, stress testing, and regulatory risk models at Desjardins. Implementing methodologies and risk - system products in a hybrid Montréal role.
GC
Data Science, Quantitative AI Evaluation Specialist
Posted 22 hours ago
About the role
- Evaluating data science and quantitative AI outputs for Gramian Consultancy, an IT professional services and engineering talent consultancy. Creating prompts, datasets, and feedback to improve AI models.
Responsibilities
- Evaluate AI-generated outputs across data science, statistics, machine learning, experimentation, and quantitative problem-solving
- Create expert-level prompts, datasets, and reference solutions for AI training and evaluation
- Identify flawed methodologies, statistical inaccuracies, unsupported assumptions, and weaknesses in quantitative reasoning
- Assess the correctness, reliability, and clarity of analytical approaches and conclusions
- Provide structured, evidence-based feedback to help improve AI model capabilities
- Apply consistent evaluation criteria and communicate technical findings clearly
Requirements
- At least one year of experience working at a top company (tech, finance, or research), and 3 years of experience (overall) working in DS/SWE
- Bachelor’s degree in Data Science, Software Engineering, or a related field from a university in the United States, Canada, Australia, New Zealand, or the United Kingdom
- Foundational knowledge of data science, statistics, machine learning, or quantitative analysis
- Strong analytical and critical-thinking skills, with the ability to identify errors in data-driven reasoning
- Excellent written English and the ability to explain technical and statistical concepts clearly
- Ability to evaluate complex problems systematically and provide accurate, well-supported feedback
- Current residence in an English-speaking country
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Data Scientist structuring medical knowledge and evaluating AI - driven educational products for Lecturio, a global medical and nursing e - learning platform. Developing statistical validation frameworks and Knowledge Graph API integrations.
Credit risk modelling data scientist developing and maintaining models for Desjardins. Guiding risk quantification, credit decisions, compliance, and practitioner - led modelling projects.
Data Scientist developing transactional fraud detection models for Desjardins’ banking and debit payments. Deploying analytics, dashboards, and mitigation strategies to protect members and clients.
Product analytics consultant delivering business insights and dashboards for Allstate Canada’s personal insurance portfolio. Supporting strategic decisions through performance analysis, reporting automation, and stakeholder recommendations.
Growth Data Scientist partnering with product, design, engineering, and marketing leaders at fintech Mercury. Shaping banking growth strategy through funnel analytics, experimentation, and prioritized recommendations.
Principal Data Scientist leading causal marketing measurement for Upstart’s AI lending marketplace. Guiding attribution, experimentation, and budget allocation across growth channels.
Senior actuarial advisor commercializing predictive modeling and advanced analytics for Desjardins insurance pricing. Deploying innovative capabilities across Personal and Commercial Insurance.
Senior Data Scientist defining rigorous evaluation systems for AI models and agents. Improving quality and safe rollout at Alpaca, a global brokerage - infrastructure company.
Lead Data Scientist building production ML for Life360’s family safety and tracking products. Driving revenue experimentation, personalization, advertising, and subscription growth.