Data Engineer (Python + Spark)

Posted via LinkedIn Recruiter (not a company profile)

Posted 2 months ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Hiring Data Engineer (Python + Spark) for full-time hybrid role in Mississauga, Canada. Must have strong Python and Spark skills.

Responsibilities

  • Design, develop, and maintain software solutions using Python. Develop Python and PySpark programs for data analysis. Create custom frameworks for rule generation. Gather data from HBase and implement solutions using PySpark. Apply business transformations using Apache Spark DataFrames/RDDs and perform read/write operations with Hive Context. Develop back-end services, APIs, and integrate databases. Optimize applications for performance, security, and maintainability. Troubleshoot and resolve software defects and issues.

Requirements

  • Strong proficiency in Python and Spark. Candidates must be currently in Canada with valid work authorization.

Job title

Job type

Permanent

Experience level

Not specified

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

PythonSparkPySparkHBaseApache SparkHive

Location requirements

Linkedin Recruiter PostMississaugaOntario Mississauga

Report this job

Found something wrong with the page? Please let us know by submitting a report below.