Data Engineer (Python + Spark)

Posted via LinkedIn Recruiter (not a company profile)

Posted 2 months ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • #Hiring Data Engineer (Python + Spark) | Fulltime | Mississauga, Canada Hybrid Mandatory Skills: Python, Spark Pyspark Must Responsibilities: Design, develop, a

Responsibilities

  • #Hiring Data Engineer (Python + Spark) | Fulltime | Mississauga, Canada Hybrid Mandatory Skills: Python, Spark Pyspark Must Responsibilities: Design, develop, and maintain software solutions using Python. Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine). Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD’s were used to apply business transformations and utilized Hive Context objects to perform read/write operations.. Develop back-end services, APIs, and integrate databases. Optimize applications for performance, security, and maintainability. Troubleshoot and resolve software defects and issues. Required Skills: Strong proficiency in Python and Spark. If interested, please send your updated resume to [email protected] Only for candidates who are currently in Canada and with valid work authorization.

Requirements

  • No requirements provided

Job title

Job type

Permanent

Experience level

Not specified

Salary

Not specified

Degree requirement

No Education Requirement

Location requirements

Linkedin Recruiter PostMississaugaOntario Mississauga

Report this job

Found something wrong with the page? Please let us know by submitting a report below.