Data Architecture Advisor designing robust data management solutions. Involved in data integration, analytics, and architecture implementation for diverse business sectors.
About the role
- Data Engineer with 6+ years experience needed in Mississauga, ON. Must have strong Python and Spark skills for designing software solutions and data analysis.
Responsibilities
- Design, develop, and maintain software solutions using Python. Develop Python and pyspark programs for data analysis. Create Custom Framework for generating rules (like rules engine). Develop Python code to gather data from HBase and implement solutions using Pyspark. Use Apache Spark DataFrames/RDD's for business transformations and Hive Context objects for read/write operations. Develop back-end services, APIs, and integrate databases. Optimize applications for performance, security, and maintainability. Troubleshoot and resolve software defects and issues.
Requirements
- Strong proficiency in Python and Spark. Must be residing in Canada (PR & Citizen only).
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
Sr. IFRS17 Data Engineer
LinkedIn Recruiter Post
Sr. IFRS17 Data Engineer contract role in Toronto (hybrid). Must have IFRS17 experience, insurance domain knowledge, and expertise in Python, PySpark, SQL, and data analysis.
Senior Software Engineer developing data - heavy services and data security solutions for Coinbase. Building and maintaining scalable data integration tools and self - service applications.
LP
Senior Data Engineer
LinkedIn Recruiter Post
Senior Data Engineer role requiring Python & PySpark expertise. Design scalable data solutions, build data processing programs, and work with HBase/Hive datasets.
Data Engineer Intern/Co - op working on TD’s big data platform. Engage in software development and project management methodologies while collaborating with technical teams.
Geospatial Data Engineer building data processing systems for autonomous flight decisions alongside the CTO. Architecting systems evolution from initial implementation to production - grade infrastructure.
Engineer building scalable data platforms for a telematics startup tackling complex backend challenges. Designing and optimizing data platforms for API, managing large - scale data processing.
Engineer building scalable data platforms for commercial trucking API company. Designing and optimizing the data platform to tackle complex backend challenges.
Data Engineer at RAVL designing, building, and operating data pipelines for decision - making. Transforming raw data into reliable assets for analytics and machine learning.
Principal Data Engineer at RAVL designing secure and scalable data and AI platforms. Leading architectural guidance and building capabilities across the organization to enhance data operations.