Sr. Data Engineer – Databricks

Posted via LinkedIn Recruiter (not a company profile)

Posted 2 months ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Sr. Data Engineer needed to lead Databricks-based data platform modernization for a top financial client, migrating trading and market data from legacy systems.

Responsibilities

  • Design and develop data ingestion pipelines (batch and real-time) leveraging Databricks. Build and optimize Spark/Scala-based data processing workflows. Implement streaming ingestion using Kafka or APIs. Develop medallion architecture models (bronze, silver, gold). Create and maintain materialized views. Ensure data quality through validation, deduplication, and reconciliation. Contribute to reusable frameworks and collaborate with internal teams to deliver scalable solutions. Support BAU tasks and platform buildout.

Requirements

  • Extensive hands-on experience with Databricks as SME. Advanced proficiency in Apache Spark and Scala. Proven ability to develop data pipelines (batch and streaming). Knowledge of real-time ingestion frameworks such as Kafka or APIs. Strong understanding of data architecture, pipeline design, and data modeling best practices. Experience with data quality, validation, and reconciliation workflows. Ability to interpret complex technical requirements. Effective communication skills. Delivery-focused mindset.

Job title

Job type

Contractor

Experience level

Senior

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

DatabricksApache SparkScalaKafka

Location requirements

Linkedin Recruiter PostTorontoOntario Toronto

Report this job

Found something wrong with the page? Please let us know by submitting a report below.