Data Engineer at OTIP Group of Companies designing and developing scalable data pipelines. Responsible for MDM processing and migrating existing solutions to Snowflake.
Responsibilities
Reporting to the Senior Manager, Data Management, the Data Engineer designs, develops, and maintains scalable data pipelines and modern data platforms, primarily supporting a Python-based data processing platform
Focus on Master Data Management (MDM) processing and MDM platform modernization
Design, develop, and enhance data pipelines to ingest and process data from multiple source systems and file formats
Apply data quality rules, validations, and thresholds within data pipelines to ensure reliable and accurate data is loaded to databases
Implement and manage CI/CD pipelines to enable automated deployment using Azure DevOps
Support the migration of existing Python-based solutions to Snowflake, and MDM platforms (e.g., Profisee), supporting platform modernization
Monitor and support data pipelines to ensure they meet expectations, maintain robustness, and adhere to security standards
Collaborate with Data Architecture and Data Governance for critical platform and portfolio initiatives in collaboration with business and technology stakeholders
Support the conversion of SSIS packages to ADF as part of Cloud migration
Collaborate effectively with cross-functional teams and external partners across the organization
Ensure compliance with data stewardship standards, governance policies, and data security procedures
Requirements
Bachelor’s degree in computer science, engineering, or a related field (or equivalent practical experience)
3+ years of experience working as a Data Engineer using Python and SQL Server / Azure SQL
2+ years of experience using Azure DevOps, including Repos and CI/CD pipelines
3+ years of relational databases, preferably SQL Server and Azure SQL
3+ years of experience with Azure Data Factory (ADF), SSIS, and SSMS, including pipeline orchestration
Solid understanding of ETL / ELT patterns and data modeling best practices
Knowledge of Medallion Architecture within enterprise data warehouse environments
Strong analytical and problem-solving skills with high attention to detail
Ability to manage multiple priorities and work independently with minimal supervision
Excellent verbal and written communication skills
Experience working in Agile/Scrum delivery environments
Knowledge or hands-on experience with Snowflake is an asset
Practical experience implementing Master Data Management (MDM) solutions or frameworks is an asset
Experience or familiarity with MDM tools such as Profisee or Informatica is an asset
Benefits
Defined benefit pension plan for a financially confident retirement
100% coverage of approved continuing education and licensing fees (including RIBO courses in Ontario)
Access to a wealth of learning resources, including LinkedIn Learning for professional development
Principal Databricks Data Engineer needed for a full - time hybrid role in Toronto, ON. Requires 12 - 18 years of data engineering experience with Databricks and Spark.
Staff Data Scientist designing and driving AI evaluation methodologies at RBC. Leading technical guidance and establishing standards for robust AI evaluations.
Senior Product Manager responsible for core retail platforms, integrations, and data governance at Sur La Table. Driving execution and improving operational efficiency in a remote setting.
Experienced Data Platform Migration Specialist needed for 12 - month contract in Toronto to migrate data platforms to Azure and Snowflake using Snowflake, AKS, Python, and SQL.
Senior Product Manager overseeing data platform and intelligence capabilities at Wattpad. Collaborating with cross - functional teams to build systems for smarter product decisions.
Hands - on Manager, Data Architecture leading data analytics and data management for Optiom, a Canadian specialty insurer. Building a governed cloud data platform and analytics function.
Senior Backend Engineer enhancing health data platform at Molecular You. Owning platform quality, driving technology adoption, and ensuring security compliance.
AVP, Enterprise Data Architecture at Sun Life, managing enterprise data architecture and strategy. Collaborating with cross - functional teams to drive client - centric solutions leveraging data and analytics.