Associate Data Scientist designing and evaluating LLM-based applications for Manulife. Collaborating on AI initiatives and gaining experience in a supportive environment.
Responsibilities
Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces.
Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques.
Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods.
Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders.
Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services.
Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases.
Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities.
Participate in code reviews, documentation, and agile development cycles with the engineering team.
Requirements
Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles.
Strong programming skills in Python and SQL; experience with JavaScript is a plus.
Bachelor’s or master’s degree in computer science, Data Science, AI, or a related field.
Hands-on experience with LLM evaluation, bias detection, or alignment research (preferred).
Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus).
Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis.
Experience with cloud platforms such as Microsoft Azure and Databricks.
Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS.
Strong analytical thinking, attention to detail, and a passion for building responsible AI systems.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension)
global share ownership plan with employer matching contributions
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days
Technical Lead governing AI data readiness and API gateways at Coupa, whose platform helps businesses optimize total spend. Defining safeguards for GenAI applications, data quality, compliance, and observability.
Senior Principal Data Scientist building predictive models and evaluation systems for Autodesk’s agentic AI design platform. Defining telemetry, experimentation, and product intelligence for complex user workflows.
Senior Data Scientist evaluating football ML models for SumerSports’ NFL intelligence platform. Building rigorous testing, comparison, and experimentation tooling for production model quality.
Data Scientist developing fraud detection solutions for Desjardins, North America's largest cooperative financial group. Applying data science expertise to protect financial products and services from fraud.
Data Scientist II applying SQL, Python, machine learning, and AI to Life & Health insurance products at TD Bank. Developing strategies and insights for better decisions.
Senior Data Scientist developing AI, analytics, and automation solutions for Desjardins, North America’s largest cooperative financial group. Building Finance prototypes, models, and AI agents for production.
Lead Analytics Consultant shaping Adobe Analytics and CJA strategies for Bounteous, a global AI services firm. Advising clients, designing implementations, and translating data into executive action.
Senior Data Scientist developing machine learning, GenAI agents, and analytics solutions for Sun Life’s Canadian financial - services business units. Leading technical delivery, stakeholder recommendations, and mentoring.
Senior Data Scientist needed for 12 - month contract, remote - first with 1 day/month onsite in North York, ON. Must have Python, SQL, GCP (Vertex AI & BigQuery), and forecasting experience.