Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
AG
Data Engineer – MS Fabric Developer
Posted 4 months ago
About the role
- Data Engineer role focused on building and optimizing data pipelines within Microsoft Fabric at AIM. Collaborating closely with analysts and developers to deliver scalable data solutions.
Responsibilities
- Design, develop, and maintain data pipelines using Microsoft Fabric
- Develop and optimize Spark Notebooks (PySpark / Spark SQL) for data transformation and processing
- Build scalable ETL/ELT workflows for structured and unstructured data
- Work within Microsoft Fabric ecosystem (Data Factory, Lakehouse, Warehousing)
- Design and manage data models and storage layers (Bronze, Silver, Gold architecture)
- Ensure performance optimization and efficient data processing
- Integrate data from multiple sources, including: APIs, Databases, Cloud storage systems
- Ensure data quality, validation, and governance best practices
- Collaborate with Power BI developers and analysts to support reporting requirements
- Enable clean, structured datasets for reporting and visualization
- Support business teams with data insights and troubleshooting
- Monitor and optimize data pipelines and Spark workloads
- Troubleshoot data issues and ensure reliability and performance
- Support deployment and CI/CD processes for data solutions
- Maintain technical documentation for data pipelines and workflows
- Support standardization of data engineering processes and best practices
Requirements
- Bachelor’s degree in Computer Science, Data Engineering, IT, or a related field
- 4–6+ years of experience in data engineering or data platform development
- Hands-on experience with Microsoft Fabric or Azure Data Platform
- Strong experience working with Spark Notebooks (PySpark / Spark SQL)
- Expertise in: Microsoft Fabric, Spark / PySpark / Spark SQL, Data pipelines (ETL/ELT)
- Experience with: Azure Data Factory / Synapse / Fabric pipelines, Data Lake / Lakehouse architecture, SQL and relational databases
- Understanding of: Data modeling concepts, Data governance and quality frameworks
Benefits
- 100% remote work environment
- Opportunity to work on modern cloud and data platforms (Microsoft Fabric)
- Exposure to enterprise-scale data and analytics projects
- Collaborative and growth-focused culture
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.
Senior SQL Developer building SQL warehouses, ETL pipelines, and reporting solutions for TD Bank’s treasury technology team. Supporting cloud modernization and business - critical financial analytics.
Data Migration Consultant managing CRM data imports, validation, and onboarding for Neon One, a nonprofit software company. Coordinating clients, engineers, and cross - functional teams.
Data Migration Specialist defining mappings and validating migrations for ClearRisk’s cloud - based claims and risk management solutions. Ensuring customer data is accurate, clean, and business - ready.
Senior Data Engineer building scalable data platforms and pipelines for Confluence’s investment data business. Collaborating on architecture while mentoring engineers and solving complex data challenges.