Sr. Databricks Spark Developer role designing and optimizing data pipelines for banking. Requires Databricks/Spark experience in financial services with strong communication skills.
Responsibilities
Design, develop, and optimize data pipelines utilizing Databricks and Apache Spark. Manage and process large-scale datasets in a distributed computing environment. Collaborate with cross-functional teams including business and technical stakeholders. Participate in solution design discussions and provide insightful technical recommendations. Ensure data quality, performance optimization, and solution scalability. Troubleshoot and resolve data pipeline issues efficiently. Contribute to documentation and best practices for data engineering processes.
Requirements
Proven hands-on experience with Databricks and Apache Spark development. Familiarity with enterprise environments, preferably in banking or financial services. Strong understanding of distributed computing and data architecture. Excellent verbal and written communication skills. Ability to work independently in a dynamic, fast-paced environment. Experience working on large-scale data projects with multiple stakeholders.
Staff Data Engineer building pipelines, models, and infrastructure for exacare ai’s post - acute care AI platform. Turning healthcare data into reliable foundations for product, analytics, and ML workflows.
Senior Data Engineer architecting cloud data platforms and pipelines for Arc’teryx supply chain analytics. Leading migrations, governance, observability, and engineering mentorship.
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.