Data Platform QA Engineer, Data Quality, Observability

Posted 1 hour ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Data Platform QA Engineer ensuring quality, reliability, and integrity for Tecsys's cloud-based data platform built on Databricks and AWS. Collaborating closely with Data Platform Developers and Product Owners in Agile environments.

Responsibilities

  • Design and develop automated tests for Databricks data pipelines and transformations.
  • Validate end-to-end data movement across Bronze, Silver, and Gold data layers.
  • Create SQL and Python-based validation scripts to verify data quality and business rules.
  • Build and maintain automated regression test suites for data pipelines.
  • Integrate automated testing into CI/CD pipelines.
  • Implement data observability checks, including schema validation, data freshness, volume monitoring, and anomaly detection.
  • Investigate data quality issues, perform root cause analysis, and support production releases.
  • Collaborate with Data Platform Developers, Product Owners, and business stakeholders in an Agile environment to ensure high-quality data products.

Requirements

  • Hands-on experience with Databricks (mandatory).
  • Experience testing data platforms, ETL/ELT pipelines, data lakes, or data warehouses.
  • Strong SQL skills for data validation, analysis, and troubleshooting.
  • Experience developing test automation using Python.
  • Experience with test automation frameworks and CI/CD pipelines.
  • Understanding of data quality, business rule validation, and data observability concepts.
  • Experience working in Agile teams alongside Data Platform Developers and Product Owners.
  • Strong analytical, problem-solving, and communication skills.

Job title

Job type

Full Time

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

ETLPythonSQL

Location requirements

HybridMontrealCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.