Associate Data Scientist designing and evaluating LLM-based applications for Manulife. Collaborating on AI initiatives and gaining experience in a supportive environment.
Responsibilities
Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces.
Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques.
Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods.
Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders.
Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services.
Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases.
Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities.
Participate in code reviews, documentation, and agile development cycles with the engineering team.
Requirements
Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles.
Strong programming skills in Python and SQL; experience with JavaScript is a plus.
Bachelor’s or master’s degree in computer science, Data Science, AI, or a related field.
Hands-on experience with LLM evaluation, bias detection, or alignment research (preferred).
Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus).
Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis.
Experience with cloud platforms such as Microsoft Azure and Databricks.
Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS.
Strong analytical thinking, attention to detail, and a passion for building responsible AI systems.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension)
global share ownership plan with employer matching contributions
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days
Data Scientist developing AI agents and advanced analytics solutions for Ciena. Focused on machine learning, generative AI, and delivering business value through intelligent data - driven tools.
Data Scientist driving detection and mitigation of fraud across audio verticals on our platform. Collaborating with data scientists and ML engineers to ensure fair engagement and accuracy for users and creators.
Senior Marketing Data Scientist for Mozilla providing analytical support to marketing team's investment decisions. Measuring marketing performance and uncovering insights to enhance impact.
Senior Data Scientist developing advanced machine learning models and managing data science services. Working in a hybrid environment to address client needs and optimize business functions.
Data Science Specialist at Nasdaq analyzing financial crime data for insights. Collaborating with teams to create impactful reports and presentations for fraud detection solutions.
Data Scientist at Dropbox partnering with product, engineering, and design teams for analytics and business growth. Focusing on revenue growth, product optimization, and launching high - impact initiatives.
Senior Data Science Manager driving data science projects and mentoring teams for AI product development at Dropbox. Collaborating cross - functionally to influence product strategies and analyze impactful data - driven insights.
Data Science Manager at Instacart leading a data science team to optimize consumer app experiences. Focusing on analytics and experimentation across critical shopper surfaces.
Clinical Data Manager overseeing comprehensive data management activities in clinical trials. Ensuring regulatory compliance and data quality while collaborating with clients and teams.