Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
About the role
- Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Responsibilities
- Build and maintain ingestion and orchestration pipelines using Fabric Data Factory and Azure Data Factory
- Integrate databases, APIs, files, and enterprise applications
- Develop ETL/ELT transformations using SQL, Python, PySpark, Fabric notebooks, and Dataflow Gen2
- Implement OneLake, Lakehouse, Warehouse, and Delta Lake solutions using medallion architecture where appropriate
- Develop full and incremental load patterns, change data capture, parameterized pipelines, and reusable ingestion frameworks
- Build dimensional models and curated datasets with analysts and business stakeholders
- Implement business rules, historical tracking, and source-to-target mappings
- Implement data quality checks, automated tests, reconciliation, and validation
- Handle schema changes, duplicate records, missing values, and late-arriving data
- Improve pipeline reliability through logging, monitoring, alerts, retries, dependency management, and safe reruns
- Troubleshoot failures and document operational runbooks
- Use Git and CI/CD to promote changes across environments
- Optimize SQL, Spark, and pipeline performance
- Implement agreed access controls
- Participate in code reviews and mentoring
- Work closely with architects, analysts, and clients from source analysis and development through testing, deployment, and production support
Requirements
- Strong experience building and operating production data pipelines, owning complex engineering work through deployment and support
- Hands-on experience with Microsoft Fabric, including OneLake, Lakehouse or Warehouse, Fabric Data Factory pipelines, and notebooks
- Strong SQL, Python, and PySpark skills
- Practical experience processing data in Apache Spark and Delta Lake
- Azure experience with Azure Data Factory, ADLS Gen2, and Azure SQL
- Experience integrating Azure services with Fabric
- Understanding of ETL/ELT, orchestration, incremental processing, data modeling, and structured and semi-structured data
- Experience with Git, deployment automation, testing, data quality, monitoring, and performance tuning in production environments
- Ability to work directly with clients to clarify requirements, explain issues, and manage dependencies
- Ability to work independently and collaborate across delivery teams
- Dataflow Gen2 and Power Query experience valued
- OneLake shortcuts or mirroring experience valued
- Power BI semantic model integration experience valued
- Azure Databricks, Azure Synapse, Microsoft Purview, or ERP and SaaS integration experience valued
- Streaming workloads, Fabric Real-Time Intelligence, KQL, or Eventstreams experience valued
- Microsoft Certified Fabric Data Engineer Associate or other relevant Azure or Microsoft data certifications valued
Benefits
- Opportunities to take ownership and deepen expertise
- Learning alongside experienced colleagues
- Opportunities to contribute to how the company delivers
- Opportunities to help shape a growing consulting practice
- Direct client work on meaningful challenges
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.
Senior SQL Developer building SQL warehouses, ETL pipelines, and reporting solutions for TD Bank’s treasury technology team. Supporting cloud modernization and business - critical financial analytics.
Data Migration Consultant managing CRM data imports, validation, and onboarding for Neon One, a nonprofit software company. Coordinating clients, engineers, and cross - functional teams.
Data Migration Specialist defining mappings and validating migrations for ClearRisk’s cloud - based claims and risk management solutions. Ensuring customer data is accurate, clean, and business - ready.
Senior Data Engineer building scalable data platforms and pipelines for Confluence’s investment data business. Collaborating on architecture while mentoring engineers and solving complex data challenges.
Senior Data Engineer building Dandy’s data infrastructure for its technology - powered dental operating system. Developing pipelines, governed data products, and AI - ready platform capabilities.
Senior Data Engineer supporting the Government of Alberta’s Data Management Platform. Building, monitoring, and modernizing Talend integrations, ETL/ELT pipelines, APIs, and data services.
Data Engineer building cloud data pipelines, models, and analytics infrastructure for Boeing’s aviation programs. Supporting machine learning applications and data governance from Richmond/Vancouver.
Data Engineer building cloud - based data pipelines and analytics infrastructure for Boeing’s aviation programs. Supporting machine learning, data governance, and high - performance systems from Richmond/Vancouver.