Junior-to-intermediate developer building PySpark and Databricks data pipelines for financial services and wealth management platforms. Debugging transformations, validating data, and maintaining cloud-based environments.
Responsibilities
Write and maintain hand-written PySpark transforms for silver and gold layer tables, including customer, account, and transaction data models
Work with Lakeflow Declarative Pipelines and Auto CDC / SCD Type 2 patterns for change-data-capture merges
Query and validate data in Unity Catalog across dev/qa/uat environments using SQL warehouses
Debug failed pipeline runs by reading event logs, tracing bad records, and fixing schema drift or data quality issues
Maintain reference/lookup tables and PowerShell/Python utility scripts used to operate the platform
Write and update unit and integration tests for transform logic
Participate in code reviews using Git feature branches and GitLab merge requests
Keep documentation current when system behavior changes
Build and maintain Databricks data pipelines for a financial services/wealth management data platform
Help ingest, transform, and publish data through bronze, silver, and gold layers, file exports, and Kafka
Work alongside a senior engineer and help keep environments healthy across dev/qa/uat
In the first 90 days, independently handle small transform bugs or enhancements, test changes, open merge requests, run operational scripts, query tables, diagnose failures, and begin taking ownership of Databricks environments
Requirements
Solid Python fundamentals; ability to write clean, readable code using functions, modules, and basic OOP
Some exposure to Apache Spark / PySpark, or strong SQL skills plus willingness to learn Spark quickly
Working knowledge of SQL, including joins, aggregations, and window functions
Basic Git workflow knowledge: branches, commits, and pull/merge requests
Ability to read other people's code and stack traces and debug methodically
Direct Databricks experience is nice to have
Familiarity with Delta Lake, medallion architecture, or CDC/SCD concepts is nice to have
Azure exposure is nice to have
Kafka or other streaming/event systems experience is nice to have
CI/CD pipeline experience is nice to have
Prior financial services or regulated data environment experience is nice to have
Benefits
Inclusive employer committed to diversity
Accommodation provided during the recruitment and selection process
Opportunity to grow fast and collaborate with exceptional teammates
Exposure to high-impact projects for scaling startups and global enterprises
Opportunity to learn and grow into a data engineering specialist
Associate IT Developer building and supporting RQ web and mobile products. Developing APIs, integrations, front - end features, bug fixes, and customer technical solutions.
Développeur MuleSoft concevant des API et intégrations pour iA Financial Group, assureur et gestionnaire de patrimoine. Soutien de plateformes Anypoint, CI/CD et solutions sécurisées.
Senior R Programmer developing R Shiny applications and statistical tools for Premier Research’s clinical - trial and biopharma services. Supporting validated workflows, data visualization, and regulatory submissions.
SharePoint and Power Platform Developer building Power Apps, workflows, and Microsoft 365 solutions for Calgary’s primary care network. Supporting secure, reliable applications for doctors and patients.
Director of Engineering scaling FLiiP’s fitness management SaaS platform. Leading web, mobile, data, and AI engineering while driving reliability, security, and team growth.
Senior MuleSoft Developer building secure Salesforce, Entra ID, and backend integrations. Delivering API - led solutions for Verndale’s digital experience and ecommerce clients.
Engineering graduate supporting CANDU nuclear technology projects at AtkinsRéalis. Assisting multidisciplinary teams across new nuclear, plant support, refurbishment, site engineering, and R&D.
Mining engineering co - op student supporting survey, drill - and - blast, planning, and data management at Hudbay Minerals’ open - pit mine. Hands - on role with a 7 - on - 7 - off, 12 - hour day - shift rotation.
Headless CMS Developer configuring bilingual content structures, editorial tools and APIs. Supporting migration, media integration and editor training for a nonprofit digital platform.