Senior Data Engineer developing and optimizing enterprise-grade data solutions within Microsoft Fabric ecosystem. Collaborating with data scientists, analysts, and stakeholders for data-driven decision-making.
Responsibilities
Design, develop, and maintain data pipelines to move data between Microsoft Fabric (Lakehouse/Warehouse) and Snowflake, often utilizing Fabric Data Factory
Set up connectors, mirroring, or Spark notebooks to sync data from OneLake to Snowflake, including handling incremental loads
Build and optimize data models (Star Schema/Data Vault) within Snowflake and Fabric for high-performance querying
Monitor and optimize Fabric to Snowflake compute usage and ensure efficient data movement
Ensure data security during transfer, using tools like Snowflake RBAC, Dynamic Data Masking, and Fabric's security features
Design and orchestrate complex integrations across Data Factory, REST APIs, and other enterprise data services
Develop reusable, optimized Spark jobs and configure compute pools for cost-efficient performance
Establish naming conventions, workspace governance, and CI/CD deployment strategies across Fabric
Build monitoring dashboards, alerts, and automated testing for pipelines and operations
Leverage AI coding agents and AI-assisted development tools (e.g., GitHub Copilot, Windsurf, or similar) to accelerate data engineering workflows, automate repetitive tasks, and improve code quality across the Fabric ecosystem
Requirements
5+ years of experience working on complex data integration and pipeline development across variety of systems
Proficient in SnowSQL, stored procedures, tasks, and data loading/unloading (COPY INTO)
Experience with Data Factory pipelines, Dataflow Gen2, and OneLake integration
Expertise in Spark/Python (PySpark) for data transformation, or ELT tools
Advanced SQL knowledge is essential for complex transformations
Ability to design and orchestrate complex data integrations, leveraging Data Factory, REST APIs, and other enterprise data sources
Leadership in defining and executing scalable ELT strategies using Spark notebooks, Data Factory, and Synapse pipelines
Advanced knowledge of data pipeline optimization, including performance tuning and workload configuration
Experience establishing naming conventions, workspace governance, and CI/CD deployment strategies
Leadership in data governance, including sensitivity classifications, security models, and access control frameworks
Ability to build and maintain monitoring, alerting, and automated testing for ADF pipelines and data assets
Hands-on experience using AI coding agents and AI-assisted development tools in a data engineering context
Benefits
Flexibility: Plan your workdays in a way that suits you best
Professional development opportunities
Award-Winning Workplace: Proudly recognized as a Great Place to Work for 20 consecutive years
Inclusive Culture: We are committed to an inclusive culture where every team member can be their authentic self
Team Lead guiding payment integrations and technical solutions at Euna Solutions, a cloud software provider for public - sector organizations. Leading consultants, implementations, APIs, and customer success.
AI Solutions Engineer building agentic automations for CSC Generation, an AI - native holding company transforming omnichannel retail brands. Connecting APIs, marketing platforms, and data workflows to reduce manual work across its multi - brand portfolio.
AI Controls Solutions Engineer deploying Phaidra’s reinforcement - learning control systems for industrial automation. Configuring, commissioning, and supporting HVAC solutions for enterprise data centers.
Senior Integration Engineer modernizing Vancity’s secure financial infrastructure with Azure Integration Services and C#. Designing event - driven, compliant backend systems for a member - owned Canadian credit union.
Senior Solutions Engineer enabling channel partners for Tailscale, which securely interconnects people and devices. Leading technical discovery, co - selling, architecture, demos, and partner enablement for secure networking solutions.
Solution Architect designing secure, scalable enterprise systems for Canada’s largest credit union. Translating business objectives into technology solutions and guiding delivery across platforms.
Project Manager leading retirement and benefits software implementations and data migrations for TELUS Health. Coordinating cross - functional delivery, client reporting, risks, and AI - assisted project operations.
Solutions Consultant guiding cybersecurity transformations for Palo Alto Networks, a cybersecurity company. Designing technical solutions, driving adoption, and leading customer - facing validation and workshops.