Data Engineer role focused on building and optimizing data pipelines within Microsoft Fabric at AIM. Collaborating closely with analysts and developers to deliver scalable data solutions.
Responsibilities
Design, develop, and maintain data pipelines using Microsoft Fabric
Develop and optimize Spark Notebooks (PySpark / Spark SQL) for data transformation and processing
Build scalable ETL/ELT workflows for structured and unstructured data
Work within Microsoft Fabric ecosystem (Data Factory, Lakehouse, Warehousing)
Design and manage data models and storage layers (Bronze, Silver, Gold architecture)
Ensure performance optimization and efficient data processing
Integrate data from multiple sources, including: APIs, Databases, Cloud storage systems
Ensure data quality, validation, and governance best practices
Collaborate with Power BI developers and analysts to support reporting requirements
Enable clean, structured datasets for reporting and visualization
Support business teams with data insights and troubleshooting
Monitor and optimize data pipelines and Spark workloads
Troubleshoot data issues and ensure reliability and performance
Support deployment and CI/CD processes for data solutions
Maintain technical documentation for data pipelines and workflows
Support standardization of data engineering processes and best practices
Requirements
Bachelor’s degree in Computer Science, Data Engineering, IT, or a related field
4–6+ years of experience in data engineering or data platform development
Hands-on experience with Microsoft Fabric or Azure Data Platform
Strong experience working with Spark Notebooks (PySpark / Spark SQL)
Expertise in: Microsoft Fabric, Spark / PySpark / Spark SQL, Data pipelines (ETL/ELT)
Experience with: Azure Data Factory / Synapse / Fabric pipelines, Data Lake / Lakehouse architecture, SQL and relational databases
Understanding of: Data modeling concepts, Data governance and quality frameworks
Benefits
100% remote work environment
Opportunity to work on modern cloud and data platforms (Microsoft Fabric)
Exposure to enterprise-scale data and analytics projects
Data Engineer developing scalable data pipelines for Bitcoin mining software, supporting compute infrastructure, and influencing company - wide strategy.
Senior Data Engineer at JLL leveraging advanced technical expertise for AI - powered solutions. Designing frameworks and mentoring engineers to achieve strategic business outcomes.
Principal Data Architect at HostPapa focusing on shaping data architecture and insights for CloudBlue’s platform. Collaborating across teams to build AI - driven solutions in a cloud - native environment.
Data Warehouse Tester/Developer needed in Toronto, ON (hybrid). 6 - 8 years exp. with Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Senior Data Engineer leading scalable data infrastructure design at Spellbook. Collaborating with distributed teams to transform contract data into actionable insights.
Senior Software Engineer focusing on data engineering and machine learning for Workday. Involves data ingestion, governance, and collaboration using modern technologies.
Hiring Data Warehouse Tester/Developer in Toronto, ON (Hybrid). Requires 6 - 8 years exp in Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Lead Data Engineering and Analytics team to oversee data infrastructure design and governance for robotic deliveries. Collaborate cross - functionally to enable data - driven decision - making across departments.
Senior Data Architect delivering enterprise - scale data and analytics solutions at 3Pillar. Leading design and delivery of analytics platforms in mixed prem and cloud environments.