Databricks Lead/Architect role focusing on GCP integration, scalable data platform architecture, and technical leadership for data engineering teams.
Responsibilities
Architect and implement scalable Lakehouse data platforms using Databricks and Delta Lake. Design robust batch and streaming data pipelines leveraging Apache Spark, structured streaming, and modern ELT patterns. Lead migration of Jobs from other cloud data platform to Databricks. Implement secure data governance, access control, and lineage using Unity Catalog. Architect integrations with cloud platforms such as Google Cloud Platform. Optimize performance and manage compute costs through efficient cluster configuration and Spark workload tuning. Collaborate with data engineers, analytics teams, and ML engineers to enable scalable data products and analytics. Define best practices for data quality, reliability, and observability across the data platform. Provide technical leadership, architecture guidance, and mentorship to data engineering teams.
Requirements
10+ years of experience in data engineering or data architecture in Big Data platforms. 3+ years of hands-on experience with Databricks platform architecture. Strong expertise in Apache Spark, Delta Lake, Databricks SQL, Python, SQL, and GCP Platform services.
Senior Data Architect/Modeller needed for 8 - month contract in Toronto. Must have expertise in conceptual/logical data modeling and migration strategies.
Senior Manager leading product performance analytics and data systems at Pratt & Whitney Canada. Enhancing reliability and maintainability of propulsion systems worldwide with advanced data analytics.
Data Analyst diving deep into data for player behavior insights to shape future games at Hyper Hippo Entertainment. Creating predictive models, dashboards, and reports for business strategies.
Senior Manager leading Supply Finance & Analytics for Sodexo in Canada. Driving financial performance, data analysis, and collaboration with supply chain and procurement functions.
Senior Data Analyst at Chess.com uncovering insights from data to drive product innovation and business growth. Collaborating with cross - functional teams and utilizing modern analytical tools.
Senior Data Analyst driving Next Best Action strategies using advanced analytics for banking products. Collaborating to enhance customer engagement, onboarding, and financial performance in a fintech environment.
Transformational Business Analyst handling data integrations and process transformations for Canadian benefits operations at General Motors. Collaborating with teams to improve efficiencies and support ongoing projects in a hybrid role.