Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company. Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.
About the role
- Senior Fabric Data Engineer modernizing learning-platform data for Cornerstone Galaxy. Building Microsoft Fabric pipelines, curated datasets, governance, and analytics-ready integrations.
Responsibilities
- Design and implement robust data solutions using Microsoft Fabric, including OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks
- Build and optimize scalable ingestion and transformation pipelines using PySpark, Python, and SQL across structured and unstructured datasets
- Migrate and harmonize data from legacy source systems including Saba, Cura, and related enterprise platforms
- Develop API-driven and scheduled workflows to ingest data from internal and external systems and support downstream processing
- Implement business rules for learning history, completion status, certifications, compliance, skills, and learner profile data
- Build curated and consumption-ready datasets/models for analytics, dashboards, and operational reporting
- Perform SQL development and tuning for reporting, analytics, and downstream consumption
- Implement automated data quality checks, reconciliations, monitoring, exception handling, and audit logging
- Enforce secure access controls using Azure AD, RBAC, managed identities, and secure connectivity patterns
- Support CI/CD, code promotion, release management, and operational monitoring in Agile delivery
Requirements
- 7+ years of experience in data engineering and enterprise data integration
- Strong hands-on experience with Microsoft Fabric and related Azure data services
- Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL
- Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms
- Experience with curated data layers, data modeling, and analytics-ready datasets
- Experience tuning data pipelines for scale, resiliency, and cost optimization
- Working knowledge of security, access controls, and data governance practices
- Experience with Azure DevOps and Git-based deployment automation
- Strong analytical, troubleshooting, and communication skills
- Experience with learning, HR, or talent data domains
- Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps
- Exposure to AI tools such as GitHub Copilot and Claude
- Experience with data governance tooling such as Purview
- Exposure to AI/ML-ready data preparation and feature engineering practices
- Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
- Ability to work independently and proactively in a fast-paced delivery environment
- Comfortable operating in remote or hybrid teams with cross-functional coordination
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
GCP Data Platform Engineer maintaining and optimizing production data platforms for Innodata, a global data engineering and AI services company. Supporting Airflow pipelines, GCP infrastructure, reliability, and troubleshooting.
Senior Data Engineer building finance data pipelines and models for Instacart’s grocery delivery platform. Owning financial data infrastructure supporting accounting, billing, invoicing, and reporting.
Senior Data Architect modernizing Alberta justice data marts into an integrated enterprise data warehouse. Designing ETL, Power BI testing, data models, governance, and reporting architecture.
Senior Data Architect integrating Alberta court data marts into an enterprise data warehouse. Designing ETL, data models, governance practices, and Power BI validation reports.
LP
Senior Data Engineer
LinkedIn Recruiter Post
Senior Data Engineer contract role: design/build ETL/ELT pipelines using Azure stack, primarily remote in Canada, occasional onsite in Edmonton.
Data & Analytics Engineer building scalable data platforms for Ledgebrook, an insurance company. Designing pipelines, governance, and cloud data systems while partnering with technical and insurance teams.
Data Engineer building scalable pipelines for SumerSports’ football intelligence platform. Supporting deep learning, video, LLM, analytics, and AI - driven products across sports.
Data Platform Engineer building ingestion pipelines, storage, governance, and observability systems for Movable Ink’s AI - driven marketing personalization platform. Supporting scalable, secure, multi - tenant data services.
Senior Data Engineer building AWS and dbt data pipelines for Tango’s cloud real - estate and facilities SaaS platform. Managing databases, warehouses, data quality, and analytics - ready datasets.