Data Engineer responsible for designing and maintaining data pipelines to support analytics and AI initiatives. Collaborating with various stakeholders to ensure high data quality and efficiency.
Responsibilities
Design, build, and maintain batch, incremental, and file-based data pipelines to support analytics, reporting, and operational use cases.
Support data migration initiatives, including the movement of data from legacy systems to modern platforms, ensuring continuity, accuracy, and reconciliation.
Work with enterprise data integration tools such as Talend, including maintaining existing Talend jobs and supporting the migration or re-implementation of Talend pipelines into other platforms where required.
Establish and maintain a robust data engineering environment (e.g., dev/test/prod separation, access controls, naming standards, source control, deployment processes, and monitoring) that enables reliable delivery and safe change management.
Support ingestion, storage, and management of unstructured and semi-structured datasets (e.g., documents, PDFs, text extracts, files, metadata) alongside traditional relational data.
Support and optimize data models in Power BI dashboards and AI-enabled analytics.
Prepare and curate analytics- and AI-ready datasets, including clean, well-defined tables and reference data used in automation and AI-enabled solutions.
Collaborate closely with AI & Automation Specialists to ensure data requirements for AI initiatives are well understood, properly sourced, validated, and production-ready.
Translate business and reporting requirements into scalable data models, transformations, and pipeline designs.
Develop and maintain trusted datasets that support dashboards, scorecards, client reporting, and downstream analytics.
Implement data quality checks, validation logic, reconciliation processes, and monitoring to ensure data reliability and consistency.
Troubleshoot and resolve data issues across ingestion, transformation, and consumption layers, identifying root causes and remediation actions.
Develop and maintain clear documentation, including source-to-target mappings, data definitions, data lineage, and known limitations.
Work in partnership with analytics, IT, data governance, and security stakeholders to ensure data solutions comply with privacy, security, and regulatory expectations.
Contribute to the prioritization, planning, and delivery of multiple data engineering, migration, and enablement initiatives in parallel.
Requirements
Bachelor’s Degree in Computer Science, Information Technology, Data Analytics or related field
4+ year experience working in data engineering, analytics engineering, business intelligence, or data platform roles.
4+ years Experience with data integration and ETL/ELT tools (e.g., Talend, Azure Data Factory, or similar enterprise platforms).
Experience with Microsoft Power Automate (or similar workflow automation tools) to orchestrate process automation, notifications, and data movement/integration.
Proficiency with Python (or similar scripting languages) for data transformations, automation, API integrations, and lightweight tooling.
Understanding of data orchestration and scheduling patterns, including dependency management, retries, and operational runbooks for production pipelines.
Experience implementing data quality and observability practices (e.g., validation rules, monitoring/alerting, SLAs) to ensure reliable and trusted datasets.
Working knowledge of secure data handling and privacy-by-design principles (e.g., least-privilege access, encryption, PHI/PII considerations) when building and operating data pipelines.
Strong SQL experience for data transformation, validation, reconciliation, and performance tuning.
Experience with Power BI (data modeling, DAX fundamentals, and performance considerations) to support scalable dashboards and self-serve analytics.
Experience working with both structured and unstructured datasets, including file-based or document-oriented data sources.
Familiarity with relational and cloud-based data platforms used for analytics and reporting.
Experience supporting data migrations, legacy system consolidation, or platform modernization initiatives.
Understanding of data quality, documentation practices, and foundational data governance principles.
Strong analytical and problem-solving skills, particularly in diagnosing data quality issues and pipeline failures.
Ability to collaborate effectively with both technical and non-technical stakeholders, including analytics and AI delivery teams.
Strong written and verbal communication skills, with the ability to clearly document data flows, dependencies, and assumptions.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.