Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
LP
Sr. Data Engineer – Databricks
Posted via LinkedIn Recruiter (not a company profile)
Posted 4 months ago
About the role
- Sr. Data Engineer needed to lead Databricks-based data platform modernization for a top financial client, migrating trading and market data from legacy systems.
Responsibilities
- Design and develop data ingestion pipelines (batch and real-time) leveraging Databricks. Build and optimize Spark/Scala-based data processing workflows. Implement streaming ingestion using Kafka or APIs. Develop medallion architecture models (bronze, silver, gold). Create and maintain materialized views. Ensure data quality through validation, deduplication, and reconciliation. Contribute to reusable frameworks and collaborate with internal teams to deliver scalable solutions. Support BAU tasks and platform buildout.
Requirements
- Extensive hands-on experience with Databricks as SME. Advanced proficiency in Apache Spark and Scala. Proven ability to develop data pipelines (batch and streaming). Knowledge of real-time ingestion frameworks such as Kafka or APIs. Strong understanding of data architecture, pipeline design, and data modeling best practices. Experience with data quality, validation, and reconciliation workflows. Ability to interpret complex technical requirements. Effective communication skills. Delivery-focused mindset.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.