Data Engineer at OTIP Group of Companies designing and developing scalable data pipelines. Responsible for MDM processing and migrating existing solutions to Snowflake.
Responsibilities
Reporting to the Senior Manager, Data Management, the Data Engineer designs, develops, and maintains scalable data pipelines and modern data platforms, primarily supporting a Python-based data processing platform
Focus on Master Data Management (MDM) processing and MDM platform modernization
Design, develop, and enhance data pipelines to ingest and process data from multiple source systems and file formats
Apply data quality rules, validations, and thresholds within data pipelines to ensure reliable and accurate data is loaded to databases
Implement and manage CI/CD pipelines to enable automated deployment using Azure DevOps
Support the migration of existing Python-based solutions to Snowflake, and MDM platforms (e.g., Profisee), supporting platform modernization
Monitor and support data pipelines to ensure they meet expectations, maintain robustness, and adhere to security standards
Collaborate with Data Architecture and Data Governance for critical platform and portfolio initiatives in collaboration with business and technology stakeholders
Support the conversion of SSIS packages to ADF as part of Cloud migration
Collaborate effectively with cross-functional teams and external partners across the organization
Ensure compliance with data stewardship standards, governance policies, and data security procedures
Requirements
Bachelor’s degree in computer science, engineering, or a related field (or equivalent practical experience)
3+ years of experience working as a Data Engineer using Python and SQL Server / Azure SQL
2+ years of experience using Azure DevOps, including Repos and CI/CD pipelines
3+ years of relational databases, preferably SQL Server and Azure SQL
3+ years of experience with Azure Data Factory (ADF), SSIS, and SSMS, including pipeline orchestration
Solid understanding of ETL / ELT patterns and data modeling best practices
Knowledge of Medallion Architecture within enterprise data warehouse environments
Strong analytical and problem-solving skills with high attention to detail
Ability to manage multiple priorities and work independently with minimal supervision
Excellent verbal and written communication skills
Experience working in Agile/Scrum delivery environments
Knowledge or hands-on experience with Snowflake is an asset
Practical experience implementing Master Data Management (MDM) solutions or frameworks is an asset
Experience or familiarity with MDM tools such as Profisee or Informatica is an asset
Benefits
Defined benefit pension plan for a financially confident retirement
100% coverage of approved continuing education and licensing fees (including RIBO courses in Ontario)
Access to a wealth of learning resources, including LinkedIn Learning for professional development
Data Engineer developing scalable data processing architectures for CenterWell healthcare solutions. Utilizing AI and machine learning for data transformation in a remote setting.
Senior Data Engineer focused on Databricks to deliver scalable data pipelines at BDO Digital. Leading client engagements and collaborating with cross - functional teams.
Data Engineer at KUBRA building and maintaining data pipelines for BI solutions. Working closely with BI Analysts to ensure data is reliable and structured for client insights.
Data Engineer responsible for designing, building, and maintaining infrastructure for data handling at Avanquest. Focused on ensuring data accessibility and reliability for data scientists and analysts.
Data Migrations Specialist working with customers to transition their data smoothly into Clio's legal software. Collaborating with Sales and Customer Onboarding to enhance client experience.
Seeking Data Services Developer with 8 - 10 years experience in SQL & Python. Responsibilities include developing scalable data solutions, optimizing databases, and implementing ETL processes.
Data Engineering Advisor creating data systems and pipelines for data management solutions. Collaborating with stakeholders and using analytics to solve business problems in the financial sector.