Lead Azure Data Engineer at 3Pillar, focusing on building robust data platforms with Azure Data Stack. Engage in data engineering projects to enhance client analytics capabilities.
Responsibilities
Understand client requirements and lead the creation of robust data platforms leveraging Data Lakehouse architectures, serving as the primary subject matter expert for the Azure data ecosystem (Microsoft Fabric, Azure SQL, and Power BI).
Design and implement scalable data models, ETL/ELT pipelines, and analytics layers using modern cloud ecosystems.
Architect Microsoft Fabric reporting solutions, establishing medallion layering, managing capacity planning, ensuring freshness governance, and configuring CDC/mirroring from Azure SQL into Fabric.
Enforce strict data-layer segregation ensuring PII is excluded by construction, maintaining multi-tenant isolation within the analytics layer, and strictly adhering to 10+ year regulated data retention policies.
Lead complex migration efforts off legacy systems (e.g., AirTable, Smartsheet) to Microsoft Fabric, effectively managing mid-program form and rule drift, and establishing reliable, per-client export channels.
Lead end-to-end analytics projects — from requirement gathering to deployment.
Mentor junior team members, perform code reviews, and ensure adherence to quality standards.
Work closely with cross-functional teams (engineering, product, business) to align data strategy with business goals.
Develop and optimize complex SQL queries, Power BI semantic models, dashboards, and reports (transitioning from legacy LookML/BigQuery paradigms).
Troubleshoot performance bottlenecks, data inconsistencies, and integration challenges.
Stay up to date with advancements in the analytics and cloud data ecosystem.
Drive innovation in reporting and analytics capabilities.
Recommend and implement new tools, frameworks, and practices to enhance the data platform.
Define best practices, coding standards, and governance for analytics projects.
Monitor data systems performance and implement optimization strategies.
Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
Build and oversee AI-ready data pipelines, focused on feeding scrubbed, segmented data to assistive AI and integrating GenAI into analytics and data products.
Drive adoption of AI-assisted data engineering across the team: copilots for SQL/transformation/pipeline code, plus automated testing and documentation.
Define governance and quality standards for data consumed by LLMs and agents.
Requirements
Demonstrated expertise with a minimum of 7 - 10 years of relevant experience in data engineering and business intelligence domain.
Strong primary expertise in the **Azure Data Stack, specifically Azure SQL, Microsoft Fabric**, and Power BI (semantic layer design, robust dashboard development), with a minimum of two years of hands-on experience in these specific tools.
Advanced SQL skills and a solid understanding of modern data architecture, including **Data Lakehouse** concepts, medallion architecture, star/snowflake schemas, and dimensional modeling.
**Proficiency in Python** for data engineering, ETL/ELT workflows, and automation tasks.
Experience designing and maintaining enterprise-grade **data pipelines** — specifically in Azure environments.
Proven track record of **leading analytics projects** and delivering scalable data solutions.
Ability to function as a **player-coach** — leading while also contributing hands-on.
Solid understanding of **data governance, security** (especially around PII and multi-tenant architectures), and **performance optimization** practices.
Strong communication skills and ability to translate complex technical concepts for business stakeholders.
Benefits
Medical & dental insurance - with employee contributions
Senior Platform Engineer managing AWS, Kubernetes, Terraform, and CI/CD infrastructure at Ledgebrook. Building secure self - service platforms that improve software delivery reliability.
Data platforms engineer modernizing General Motors’ Oracle workloads through cloud migration. Building secure, governed cloud data platforms, pipelines, infrastructure automation, and operational practices.
Senior Cloud Engineer designing secure Azure and AWS infrastructure for JLL Technologies’ enterprise real estate data platform. Driving CI/CD, Kubernetes, infrastructure - as - code, governance, and reliability across engineering teams.
Cloud Engineer designing and operating secure AKS platforms for Manulife’s Canadian financial services business. Automating infrastructure, improving reliability, and integrating developer platform capabilities.
Cloud Platform Engineer managing Kubernetes and Docker infrastructure for EQ Bank, Canada’s challenger bank. Supporting cloud operations, automation, monitoring, disaster recovery, and production incidents.
Architecte infonuagique chez TEHORA, firme québécoise de services techniques et de gestion de projets. Conception et gouvernance de plateformes cloud, sécurité, conformité et accompagnement des équipes.
Staff Cloud Architect leading cloud, data, and AI/ML architecture for Robots and Pencils’ applied AI engineering engagements. Designing scalable, secure production systems across US and Canadian remote teams.
Senior Cloud Architect designing cloud - native, data, and AI/ML systems for Robots & Pencils, an applied AI engineering firm. Building production - ready enterprise solutions across US and Canada.
Student Cloud Infrastructure Analyst at Sun Life, helping operate enterprise AI and AWS cloud platforms. Supporting Infrastructure as Code, CI/CD, automation, and DevOps initiatives.
Cloud infrastructure manager leading Azure operations, migrations, governance, and team delivery. Supporting Coastal Community Credit Union’s financial services and local member communities.