Senior Fabric Data Engineer modernizing learning-platform data for Cornerstone Galaxy. Building Microsoft Fabric pipelines, curated datasets, governance, and analytics-ready integrations.
Responsibilities
Design and implement robust data solutions using Microsoft Fabric, including OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks
Build and optimize scalable ingestion and transformation pipelines using PySpark, Python, and SQL across structured and unstructured datasets
Migrate and harmonize data from legacy source systems including Saba, Cura, and related enterprise platforms
Develop API-driven and scheduled workflows to ingest data from internal and external systems and support downstream processing
Implement business rules for learning history, completion status, certifications, compliance, skills, and learner profile data
Build curated and consumption-ready datasets/models for analytics, dashboards, and operational reporting
Perform SQL development and tuning for reporting, analytics, and downstream consumption
Implement automated data quality checks, reconciliations, monitoring, exception handling, and audit logging
Enforce secure access controls using Azure AD, RBAC, managed identities, and secure connectivity patterns
Support CI/CD, code promotion, release management, and operational monitoring in Agile delivery
Requirements
7+ years of experience in data engineering and enterprise data integration
Strong hands-on experience with Microsoft Fabric and related Azure data services
Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL
Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms
Experience with curated data layers, data modeling, and analytics-ready datasets
Experience tuning data pipelines for scale, resiliency, and cost optimization
Working knowledge of security, access controls, and data governance practices
Experience with Azure DevOps and Git-based deployment automation
Strong analytical, troubleshooting, and communication skills
Experience with learning, HR, or talent data domains
Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps
Exposure to AI tools such as GitHub Copilot and Claude
Experience with data governance tooling such as Purview
Exposure to AI/ML-ready data preparation and feature engineering practices
Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
Ability to work independently and proactively in a fast-paced delivery environment
Comfortable operating in remote or hybrid teams with cross-functional coordination
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.