Senior Data Engineer role requiring Python & PySpark expertise. Design scalable data solutions, build data processing programs, and work with HBase/Hive datasets.
Responsibilities
Design, develop, and maintain scalable data solutions. Build Python & PySpark programs for data processing and analytics. Develop custom frameworks (rules engine). Work with HBase, Hive, and large datasets. Optimize performance, security, and reliability. Troubleshoot and resolve issues.
Requirements
Strong expertise in Python and Apache Spark/PySpark (must-have). Experience with HBase, Hive, DataFrames/RDDs, Backend APIs & Data Integration. Must be currently in Canada with valid work authorization (Open Work Permit, PR, or Canadian Citizenship).
Data Architecture Advisor designing robust data management solutions. Involved in data integration, analytics, and architecture implementation for diverse business sectors.
Data Engineer with 6+ years experience needed in Mississauga, ON. Must have strong Python and Spark skills for designing software solutions and data analysis.
Sr. IFRS17 Data Engineer contract role in Toronto (hybrid). Must have IFRS17 experience, insurance domain knowledge, and expertise in Python, PySpark, SQL, and data analysis.
Senior Software Engineer developing data - heavy services and data security solutions for Coinbase. Building and maintaining scalable data integration tools and self - service applications.
Data Engineer Intern/Co - op working on TD’s big data platform. Engage in software development and project management methodologies while collaborating with technical teams.
Geospatial Data Engineer building data processing systems for autonomous flight decisions alongside the CTO. Architecting systems evolution from initial implementation to production - grade infrastructure.
Engineer building scalable data platforms for a telematics startup tackling complex backend challenges. Designing and optimizing data platforms for API, managing large - scale data processing.
Engineer building scalable data platforms for commercial trucking API company. Designing and optimizing the data platform to tackle complex backend challenges.
Data Engineer at RAVL designing, building, and operating data pipelines for decision - making. Transforming raw data into reliable assets for analytics and machine learning.
Principal Data Engineer at RAVL designing secure and scalable data and AI platforms. Leading architectural guidance and building capabilities across the organization to enhance data operations.