Data Architect designing enterprise - level data storage solutions for Servus Credit Union. Collaborating with teams to enhance data practices supporting the organization's goals.
LP
Databricks Engineer
Posted via LinkedIn Recruiter (not a company profile)
Posted 3 months ago
About the role
- Architect and implement scalable Lakehouse data platforms using Databricks and Delta Lake. Design robust batch and streaming data pipelines.
Responsibilities
- Architect and implement scalable Lakehouse data platforms using Databricks and Delta Lake. Design robust batch and streaming data pipelines leveraging Apache Spark, structured streaming, and modern ELT patterns. Lead migration of Jobs from other cloud data platform to Databricks. Implement secure data governance, access control, and lineage using Unity Catalog. Architect integrations with cloud platforms such as Google Cloud Platform. Optimize performance and manage compute costs through efficient cluster configuration and Spark workload tuning. Collaborate with data engineers, analytics teams, and ML engineers to enable scalable data products and analytics. Define best practices for data quality, reliability, and observability across the data platform. Provide technical leadership, architecture guidance, and mentorship to data engineering teams.
Requirements
- 10+ years of experience in data engineering or data architecture in Big Data platforms. 3+ years of hands-on experience with Databricks platform architecture Strong expertise in Apache Spark, Delta Lake, Databricks SQL, Python, SQL, and GCP Platform services
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Data Migration Engineer at gaiia owning the technical execution of data migrations for telecom service providers. Focusing on transforming customer data from legacy systems into gaiia's platform.
Product Manager responsible for the Data Platform at SandboxAQ, enhancing scientific discovery capabilities. Leading product management for data lifecycle in advanced materials and drug discovery.
Associate Data Engineer working with a global team to build reliable data pipelines. Collaborating on meaningful projects that support real business decisions within a hybrid work environment.
LP
Python Developer – Databricks
LinkedIn Recruiter Post
Seeking Python developers for remote contract roles to build scalable data pipelines with Databricks and PySpark for a financial client.
Commissioning Program & Data Engineer working on controlled, data - driven commissioning programs at Bird. Responsible for tracking tests, issue logs, and analyzing commissioning data.
Deals Senior Associate working in Data Engineering & Digital Solutions at PwC. Delivering innovative deal solutions and building digital tools for clients.
LP
Data Migration Specialist / Developer (ETL)
LinkedIn Recruiter Post
Hiring Data Migration Specialist / Developer (ETL) for contract hybrid role in Oakville, ON. 6+ years experience in data migration, engineering, and cloud.
Senior Data Engineer designing data infrastructure at Vanta to support analytics functions. Collaborating closely with engineering and business teams to ensure data - driven decision - making solutions.
Senior Data Engineer for Vena, focused on building a robust data platform to support business strategies. Overseeing the data engineering processes and promoting a data - driven culture across the organization.