Senior Data Engineer developing and optimizing enterprise-grade data solutions within Microsoft Fabric ecosystem. Collaborating with data scientists, analysts, and stakeholders for data-driven decision-making.
Responsibilities
Design, develop, and maintain data pipelines to move data between Microsoft Fabric (Lakehouse/Warehouse) and Snowflake, often utilizing Fabric Data Factory
Set up connectors, mirroring, or Spark notebooks to sync data from OneLake to Snowflake, including handling incremental loads
Build and optimize data models (Star Schema/Data Vault) within Snowflake and Fabric for high-performance querying
Monitor and optimize Fabric to Snowflake compute usage and ensure efficient data movement
Ensure data security during transfer, using tools like Snowflake RBAC, Dynamic Data Masking, and Fabric's security features
Design and orchestrate complex integrations across Data Factory, REST APIs, and other enterprise data services
Develop reusable, optimized Spark jobs and configure compute pools for cost-efficient performance
Establish naming conventions, workspace governance, and CI/CD deployment strategies across Fabric
Build monitoring dashboards, alerts, and automated testing for pipelines and operations
Leverage AI coding agents and AI-assisted development tools (e.g., GitHub Copilot, Windsurf, or similar) to accelerate data engineering workflows, automate repetitive tasks, and improve code quality across the Fabric ecosystem
Requirements
5+ years of experience working on complex data integration and pipeline development across variety of systems
Proficient in SnowSQL, stored procedures, tasks, and data loading/unloading (COPY INTO)
Experience with Data Factory pipelines, Dataflow Gen2, and OneLake integration
Expertise in Spark/Python (PySpark) for data transformation, or ELT tools
Advanced SQL knowledge is essential for complex transformations
Ability to design and orchestrate complex data integrations, leveraging Data Factory, REST APIs, and other enterprise data sources
Leadership in defining and executing scalable ELT strategies using Spark notebooks, Data Factory, and Synapse pipelines
Advanced knowledge of data pipeline optimization, including performance tuning and workload configuration
Experience establishing naming conventions, workspace governance, and CI/CD deployment strategies
Leadership in data governance, including sensitivity classifications, security models, and access control frameworks
Ability to build and maintain monitoring, alerting, and automated testing for ADF pipelines and data assets
Hands-on experience using AI coding agents and AI-assisted development tools in a data engineering context
Benefits
Flexibility: Plan your workdays in a way that suits you best
Professional development opportunities
Award-Winning Workplace: Proudly recognized as a Great Place to Work for 20 consecutive years
Inclusive Culture: We are committed to an inclusive culture where every team member can be their authentic self
Solution Architect designing enterprise automation solutions at UiPath. Collaborating with clients to translate complex business requirements into architectural designs.
Senior AI Engineer providing technical leadership for AI - powered systems at TYLin. Designing AI - driven applications and guiding the development of scalable, secure AI applications.
Solutions Architect at Skywise, delivering integrated digital solutions for operations. Collaborating to align technical solutions with business needs and fostering architectural excellence.
Solutions Architecture Advisor collaborating with stakeholders on projects such as cloud migrations and system implementations. Engage in technical leadership and support across multiple business sectors.
Consult with large manufacturing customers to improve natural gas efficiency in their facilities. Collaborate across various industries, leveraging technical expertise for optimal energy efficiency solutions.
Team Manager leading high performing IT professionals at Alberta Blue Cross. Responsible for operations management and service delivery excellence with a focus on professional development and optimization.
Martech Solution/Enterprise Architect at Tiger Analytics enabling data - driven business value through hands - on architecture and integration. Focused on simplifying the Martech estate and improving tool interoperability.
Client Service Manager II enhancing pharmacy operations and supporting pharmacy clients at TELUS Health. Collaborating with internal teams and delivering innovative pharmacy solutions for better patient care.
Experienced regulatory architect developing architecture blueprints and application roadmaps at RBC. Collaborating with business leaders to drive delivery in regulatory initiatives.
Senior Customer Success Specialist responsible for leading client onboarding and implementation at a SaaS company. Creating exceptional client experiences and facilitating successful software adoption for various organizations.