Control Tester & Advisor responsible for assessing controls and providing risk advisory support at BMO financial group. Collaborating with business and technology teams to enhance Data & AI governance.
Responsibilities
Execute design effectiveness (DE) and operating effectiveness (OE) testing of controls related to Data Governance and AI Governance, including data quality, data management, AI lifecycle governance, and ethical AI controls.
Develop and document test steps and test scripts aligned to approved testing methodologies and risk frameworks.
Perform reperformance testing, sampling, and evidence validation to assess control execution.
Apply professional judgment to determine control effectiveness, identify control gaps, and assess residual risk.
Provide risk, control, and process advisory support to business and technology partners related to Data and AI governance.
Advise on control design, control enhancements, and process improvements to address identified risks or emerging governance expectations.
Support and provide input into risk assessments, including identification of inherent risks, evaluation of mitigating controls, and assessment of control coverage.
Assist stakeholders in understanding risk and control expectations, governance standards, and testing outcomes.
Offer guidance on data and AI governance best practices, including alignment to internal policies, standards, and risk frameworks.
Support proactive risk management efforts by identifying potential control weaknesses or governance gaps outside of formal testing cycles.
Lead and conduct walkthroughs with control owners and stakeholders to understand end-to-end processes related to in-scope control activities.
Document process flows, control descriptions, and key risks based on walkthroughs and artifact reviews.
Develop and maintain a working understanding of how data and AI controls operate within business and technology processes, enabling both testing and advisory activities.
Analyze and assess business and governance artifacts, including: Data governance policies, standards, and procedures Data lineage, metadata, and data quality documentation AI governance artifacts (e.g., model lifecycle documentation, approvals, monitoring evidence).
Evaluate whether artifacts sufficiently demonstrate control design, operating effectiveness, and risk mitigation.
Provide advisory feedback to stakeholders where artifacts or documentation do not fully support risk and control expectations.
Identify, document, and clearly articulate control deficiencies, design gaps, and operating issues, including root cause analysis.
Draft clear, risk-based issue descriptions and contribute to discussions on risk severity and impact.
Provide actionable, practical recommendations that balance risk mitigation with business and operational considerations.
Communicate testing results, risk insights, and advisory recommendations to stakeholders in a clear and professional manner.
Act as a primary testing and advisory contact for business partners, technology teams, and risk partners for assigned areas.
Partner with stakeholders to clarify control intent, evidence expectations, risk ownership, and remediation approaches.
Support ongoing governance forums, working groups, or risk discussions related to Data and AI governance.
Contribute to continuous improvement of Data & AI governance testing and advisory practices.
Create and maintain high-quality testing and advisory documentation, including workpapers, test scripts, walkthrough notes, risk assessments, and conclusions.
Ensure work meets quality standards, methodology requirements, and service level expectations while maintaining appropriate independence.
Requirements
3–5 years of relevant experience in control testing, risk management, audit, governance, or advisory functions.
Demonstrated experience performing control design and operating effectiveness testing.
Experience supporting or contributing to risk assessments and control evaluations.
Strong analytical skills with the ability to interpret complex governance, risk, and technical artifacts.
Strong written and verbal communication skills, including issue write-ups and advisory discussions.
Required: CISA, CRISC or CGRC.
Preferred: CDMP or AIGP
Preferred Experience in Data Governance, AI Governance, Model Risk Management, or Technology Risk.
Familiarity with data management concepts, AI/ML model lifecycles, and governance frameworks.
Experience balancing independent testing responsibilities with advisory and consultative support.
Test Development Team Lead leading automation and AI - assisted testing for Nureva’s IoT collaboration platform. Driving quality across embedded devices, applications, cloud services, and Azure connectivity.
Quality Assurance Lead Consultant delivering GMP compliance projects for pharmaceutical and health - product clients. Managing investigations, audits, quality systems, documentation, and product release.
Manual Mobile QA testing iOS and Android music - learning apps for Gismart’s Radiotech. Validating releases, A/B tests, configurations, and product quality.
QA Team Lead overseeing Nestlé Canada’s Toronto food manufacturing laboratory. Leading testing, food safety, audits, traceability, and laboratory staff development.
Bilingual software tester validating French online applications and phone systems for PLATO, a Canadian Indigenous - owned software testing services company. Testing CYARA Contact Centre and AWS Connect systems for finance - sector clients.
Senior Quality Engineer/Lead modernizing AI - enabled testing at EDC, Canada’s export - finance corporation. Building Python and Robot Framework automation across enterprise software delivery.
Ingénieur principal en qualité chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Modernisation de l’automatisation des tests et intégration de l’IA aux plateformes commerciales numériques.
Senior QA engineer preventing software defects across Ford’s electric vehicle platforms. Leading root - cause analysis, audits, quality metrics, and engineering process improvements.