Associate Data Scientist designing and evaluating LLM-based applications for Manulife. Collaborating on AI initiatives and gaining experience in a supportive environment.
Responsibilities
Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces.
Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques.
Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods.
Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders.
Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services.
Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases.
Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities.
Participate in code reviews, documentation, and agile development cycles with the engineering team.
Requirements
Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles.
Strong programming skills in Python and SQL; experience with JavaScript is a plus.
Bachelor’s or master’s degree in computer science, Data Science, AI, or a related field.
Hands-on experience with LLM evaluation, bias detection, or alignment research (preferred).
Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus).
Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis.
Experience with cloud platforms such as Microsoft Azure and Databricks.
Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS.
Strong analytical thinking, attention to detail, and a passion for building responsible AI systems.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension)
global share ownership plan with employer matching contributions
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days
Data Scientist at Desjardins, a financial services cooperative, developing advanced analytics, machine learning and AI models. Advising stakeholders and supporting data - driven business decisions.
Data Scientist building IFRS 9, behavioural, and predictive credit - risk models for Financeit’s Canadian point - of - sale financing platform. Automating analytics and translating borrower data into actionable risk insights.
Scientifique de données principal optimisant acquisition, fidélisation et monétisation chez Shakepay, plateforme canadienne de services financiers Bitcoin. Pilotage de l'expérimentation, de l'analyse statistique et des décisions de croissance.
Senior Data Scientist developing machine learning and LLM solutions for Qventus, transforming healthcare operations. Building production models, experiments, and data pipelines that improve patient outcomes.
Data Scientist developing statistical and machine learning algorithms to detect bots and fraud. Supporting HUMAN Security’s platform that protects enterprises and internet platforms from cybercrime.
Data Manager leading clinical - trial database, validation, reconciliation, and lock activities for ClinChoice, a global full - service CRO. Hybrid permanent role in Mississauga, Ontario.
Data Scientist developing and maintaining credit risk models for Desjardins, a financial cooperative. Advising teams on risk quantification, Basel/IFRS standards, and credit decisions.
Senior Data Scientist optimizing Instacart’s $1B+ grocery advertising business through pacing, bidding, targeting, and experimentation. Driving production algorithms and revenue outcomes.
Senior Data Scientist scaling Instacart’s Meals initiative for grocery delivery. Leading experimentation, KPI tracking, and product analytics to drive engagement, activation, and reactivation.