Streaming Data Engineer

Posted yesterday

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Streaming Data Engineer building scalable Bronze, Silver, and Gold data pipelines for PLATO’s public sector clients. Managing real-time ingestion, processing, security, and data quality.

Responsibilities

  • Design, develop, and maintain scalable streaming data pipelines for Bronze, Silver, and Gold data layers
  • Implement data ingestion processes from various sources
  • Ensure data quality and integrity
  • Collaborate with data scientists, analysts, and stakeholders to define data requirements and deliver data solutions
  • Monitor and optimize streaming data solution performance
  • Ensure compliance with data governance and security standards
  • Manage enhanced security clearance protocols
  • Participate in code reviews
  • Mentor junior team members
  • Document data engineering processes and workflows
  • Stay current with streaming data engineering trends and emerging technologies

Requirements

  • Minimum of 5 years of experience in data engineering, with a focus on streaming data technologies
  • Proficiency in Python, Java, or Scala
  • Experience with Apache Kafka, Apache Flink, or similar data streaming technologies
  • Strong understanding of data modeling and ETL processes
  • Familiarity with AWS, Azure, or GCP is an asset
  • Familiarity with Hadoop and Spark is an asset
  • Enhanced security clearance is required
  • Ability to work remotely from Canada

Benefits

  • Collaborative work culture
  • Professional growth opportunities
  • Mentorship and knowledge-sharing
  • Accommodation support during the recruitment process
  • Inclusive hiring practices

Job title

Job type

Full Time

Experience level

Mid levelSenior

Salary

CA$75 - CA$95 per hour

Degree requirement

No Education Requirement

Tech skills

ApacheAWSAzureETLGoogle Cloud PlatformHadoopJavaKafkaPythonScalaSpark

Location requirements

RemoteCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.