Data Engineer responsible for designing and maintaining enterprise data warehouse for various projects. Collaborating with stakeholders to ensure efficient data flow and integration.
Responsibilities
Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform.
Develop and optimize T-SQL and Python-based data processing scripts and integrate them with Synapse pipelines for ETL tasks and data transformations.
Design and develop mapping dataflow solutions for complex data transformations.
Develop and maintain data storage solutions, ensuring efficient data retrieval and storage on Azure Data Lake and databases.
Implement and maintain API integrations, including REST APIs, for seamless data flow between systems.
Design and test the end-to-end process for data ingestion, data transformation, data cleansing, data delivery, data quality and data timeliness.
Implement and ensure data security and privacy measures, complying with industry standards and regulations.
Monitor and optimize the performance of Azure data services, Azure Synapse pipelines, Function Apps, and Logic Apps.
Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
Requirements
Bachelor's degree or equivalent in the field of Computer Science or Engineering
3+ years of Proven experience as a Data Engineer, specifically working with Microsoft Azure technologies.
Proficient in T-SQL, Pyspark, Mapping Dataflow and Python programming language
Hands-on experience with Azure data services, including Azure Data Factory, Azure Data Lake, Azure Function App, Azure Logic App, Azure SQL Database, Azure Synapse Analytics, mapping dataflow, and Event Hub.
Understanding of data warehousing concepts and best practices.
Experience with Data modeling.
Experience in working with structured, semi-structured and unstructured data.
Senior Data Engineer building Azure pipelines, data platforms, and ML workflows for Manulife’s retirement operations. Supporting trusted analytics across North American teams.
Lead AI/Data Engineer building production AI agents, data pipelines, and analytics infrastructure. Powering Dutch’s veterinary telemedicine platform for pet parents and veterinarians.
Architecte de données sénior concevant des architectures analytiques et gouvernance des données pour les transformations numériques de Wepoint. Travail flexible à Montréal ou Québec, en mode hybride, distant ou sur site.
Streaming Data Engineer building scalable Bronze, Silver, and Gold data pipelines for PLATO’s public sector clients. Managing real - time ingestion, processing, security, and data quality.
Senior Data Architect designing governed, event - driven healthcare data platforms for Wepoint. Leading Fabric, Power BI, ETL, and analytics architecture for Québec health - network transformations.
Staff Data Engineer building pipelines, models, and infrastructure for exacare ai’s post - acute care AI platform. Turning healthcare data into reliable foundations for product, analytics, and ML workflows.
Senior Data Engineer architecting cloud data platforms and pipelines for Arc’teryx supply chain analytics. Leading migrations, governance, observability, and engineering mentorship.
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.