Lead ML validation team for Generative AI models at TD Bank. Oversee evaluation, testing, and compliance with industry standards and regulatory requirements.
Responsibilities
Lead R&D in the GenAI/Agentic/LLM evaluation and testing areas.
Lead a team of Machine Learning Scientists to perform validation of complex AI/ML models, particularly Generative AI, LLMs / NLP and Deep Learning models.
Validate AI/ML models, particularly Generative AI and Deep Learning models.
Recommend the approval of models or other corrective actions based on the independent validation.
Lead and support a team of model validators.
Ensure performance objectives are set for all staff and that performance feedback is provided on a regular basis.
Communicate group objectives and strategies and align group activities in support of business objectives.
Support employee development activities, coach and support direct reports in meeting their personal development objectives.
Assume a leadership role in developing standards and procedures for vetting and validation of Generative AI, NLP and diverse Deep Learning models that are compliant with the Bank’s internal Model Risk Policy, adhere with industry and academic best practices, and meet regulatory requirements.
Respond to requests from both Canadian and U.S. regulators, internal and external audit in their review/audit of models and vetting/validation process and procedures.
Requirements
Advanced quantitative and AI / ML skills with post-secondary degree in one or more of the following areas: computer science, machine learning / AI, engineering, statistics, mathematics, etc.
4+ years of experience in either developing or validating Generative AI, LLMs, NLP and other Deep Learning models; and 2+ years of experience in leading a small team of machine learning scientists.
In-depth knowledge of AI/ML methodologies, concepts and theory including Generative AI, Deep Learning, modern Natural Language Processing (NLP), Retrieval-Augmented Generation (RAG), Transformers, Diffusion models, etc.
Experience with Deep Learning and Generative AI technology stacks and libraries such as PyTorch, PromptFlow, LangChain, HuggingFace, etc.
Motivated to stay up to date with the latest advancements in Generative AI, machine learning, and cloud technologies.
Proficient in one or more scripting/programming languages such as Python.
Familiarity with cloud platforms (e.g., Azure, AWS) and big data technologies (e.g., PySpark, Hadoop).
Familiarity with Data Structures, Algorithm design, and principles of Object-Oriented Programming (OOP).
Knowledge of machine learning explain-ability/interpretability algorithms.
Excellent verbal and written communication skills.
Strong critical and analytic thinking skills.
Excellent time / project management and multitasking skills with minimal supervision.
Ability to work independently and collaboratively in a fast-paced, dynamic environment.
Machine Learning Resident for Theragraph involved in developing solutions for health datasets. Collaborating in a cross - functional team under the mentorship of an Amii Scientist.
Senior ML Engineer leading the scaling and innovation of machine learning initiatives at Wisedocs. Collaborating with other engineers to integrate the ML system into the platform for insurance tech.
Lead ML Engineer developing scalable data pipelines and ML systems for Newfold Digital. Collaborate with cross - functional teams using Python, SQL, and cloud ML platforms in an applied ML environment.
Senior Machine Learning Engineer designing and optimizing ML/AI systems for digital forensic tools. Collaborating with cross - functional teams to lead initiatives and drive innovation in digital investigations.
Senior MLOps Engineer focusing on applied MLOps for CreatorIQ, bridging data science and production - grade efficiency. Responsible for annotation workflows and cost - efficient model evaluation.
Senior AI/ML Engineer leading design and deployment of high - impact AI solutions at CloudWerx. Bridging predictive modeling with next - generation Agentic AI to solve client challenges.
Machine Learning Resident developing AI - assisted tools for geotechnical site characterization. Involves collaboration with scientists and engineers to develop predictive ML models.
Machine Learning Resident at Hines Health Services focusing on AI - driven medical workforce solutions. Supporting the development of scalable, AI - powered recruitment platforms over a 6 - month residency.
Software Engineer, Machine Learning developing next - generation AI technologies for clinical trial platforms. Building scalable data pipelines, optimizing model performance, and collaborating with cross - functional teams in a hybrid setting.
Senior Machine Learning Engineer at BenchSci focusing on developing machine learning models for biomedical applications. Collaborating with a team to enhance scientific experiments through AI - driven solutions.