Databricks Lead/Architect role focusing on GCP integration, scalable data platform architecture, and technical leadership for data engineering teams.
Responsibilities
Architect and implement scalable Lakehouse data platforms using Databricks and Delta Lake. Design robust batch and streaming data pipelines leveraging Apache Spark, structured streaming, and modern ELT patterns. Lead migration of Jobs from other cloud data platform to Databricks. Implement secure data governance, access control, and lineage using Unity Catalog. Architect integrations with cloud platforms such as Google Cloud Platform. Optimize performance and manage compute costs through efficient cluster configuration and Spark workload tuning. Collaborate with data engineers, analytics teams, and ML engineers to enable scalable data products and analytics. Define best practices for data quality, reliability, and observability across the data platform. Provide technical leadership, architecture guidance, and mentorship to data engineering teams.
Requirements
10+ years of experience in data engineering or data architecture in Big Data platforms. 3+ years of hands-on experience with Databricks platform architecture. Strong expertise in Apache Spark, Delta Lake, Databricks SQL, Python, SQL, and GCP Platform services.
Analyste des données clients chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Modernisation des pipelines, tableaux de bord et solutions analytiques marketing.
Customer Data Analyst modernizing EDC’s customer data ecosystem at Canada’s export - finance Crown corporation. Building Microsoft Fabric pipelines, Power BI assets, and marketing analytics solutions.
Senior Data Analyst building trusted financial metrics, dbt models, and Looker dashboards for Jane’s clinic - management SaaS platform. Partnering with Finance and Payments to guide critical decisions.
Digital media specialist improving campaign tracking, reporting and analytics at a Toronto marketing technology lab. Automating insights with AI while maintaining data quality and measurement accuracy.
Data Analytics Intern analyzing new features and updates for Montreal - based mobile gaming studio Ludia. Building data modules, dashboards, and insights to optimize game operations.
Senior Data Analyst transforming Sun Life insurance and financial - services data into actionable marketing insights. Building SQL, Python, AWS, Adobe Analytics, reporting, and dashboard solutions.
Student Data Analyst supporting Sun Life’s financial security mission through stakeholder insights and Tableau KPI reporting. Building data analysis skills during a four - month hybrid campus placement.
Analyste de données principal modernisant les plateformes et pipelines de données d’EDC, société financière publique canadienne. Traduction des besoins opérationnels en modèles, règles de transformation et récits utilisateurs.
Senior Data Analyst modernizing enterprise data capabilities at Export Development Canada. Translating business requirements into data models, mappings, pipelines and Agile delivery artifacts.