Associate Data Scientist designing and evaluating LLM-based applications for Manulife. Collaborating on AI initiatives and gaining experience in a supportive environment.
Responsibilities
Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces.
Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques.
Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods.
Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders.
Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services.
Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases.
Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities.
Participate in code reviews, documentation, and agile development cycles with the engineering team.
Requirements
Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles.
Strong programming skills in Python and SQL; experience with JavaScript is a plus.
Bachelor’s or master’s degree in computer science, Data Science, AI, or a related field.
Hands-on experience with LLM evaluation, bias detection, or alignment research (preferred).
Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus).
Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis.
Experience with cloud platforms such as Microsoft Azure and Databricks.
Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS.
Strong analytical thinking, attention to detail, and a passion for building responsible AI systems.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension)
global share ownership plan with employer matching contributions
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days
Senior / Principal Data Scientist role focused on building and scaling GenAI and Agentic AI systems in production. Location: Toronto (Hybrid). Compensation up to $200K - 225k base.
Senior Data Science Manager leading a team of data scientists to drive marketing analytics at Reddit. Focused on strategic insights and data - driven decision making for marketing efforts.
Senior Data Scientist enhancing Reddit's user experience through data - driven projects. Collaborating with teams to analyze and model data for insights and strategies.
Data Scientist driving product strategy and user engagement at Reddit. Analyzing data and collaborating with teams to enhance user experiences in online communities.
Staff Data Scientist leading strategy and execution for marketing intelligence efforts at Reddit. Focus on optimizing marketing spend and measuring effectiveness for long - term growth.
Data Scientist on Aviva's Fraud Data Science team transforming large datasets into actionable insights. Designing and deploying machine learning models to enhance fraud detection capabilities.
Data Science Student undertaking challenging work assignments in analytics and machine learning at PCL. Collaborating under supervision in a supportive environment for personal and professional growth.