Databricks Lead/Architect with GCP

Posted via LinkedIn Recruiter (not a company profile)

Posted 5 days ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Databricks Lead/Architect role focusing on GCP integration, scalable data platform architecture, and technical leadership for data engineering teams.

Responsibilities

  • Architect and implement scalable Lakehouse data platforms using Databricks and Delta Lake. Design robust batch and streaming data pipelines leveraging Apache Spark, structured streaming, and modern ELT patterns. Lead migration of Jobs from other cloud data platform to Databricks. Implement secure data governance, access control, and lineage using Unity Catalog. Architect integrations with cloud platforms such as Google Cloud Platform. Optimize performance and manage compute costs through efficient cluster configuration and Spark workload tuning. Collaborate with data engineers, analytics teams, and ML engineers to enable scalable data products and analytics. Define best practices for data quality, reliability, and observability across the data platform. Provide technical leadership, architecture guidance, and mentorship to data engineering teams.

Requirements

  • 10+ years of experience in data engineering or data architecture in Big Data platforms. 3+ years of hands-on experience with Databricks platform architecture. Strong expertise in Apache Spark, Delta Lake, Databricks SQL, Python, SQL, and GCP Platform services.

Job title

Job type

Contractor

Experience level

SeniorLead

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

DatabricksDelta LakeApache SparkGoogle Cloud PlatformPythonSQLUnity Catalog

Location requirements

Linkedin Recruiter PostOntario

Report this job

Found something wrong with the page? Please let us know by submitting a report below.