Data Engineer developing scalable data pipelines for Bitcoin mining software, supporting compute infrastructure, and influencing company - wide strategy.
About the role
- Software Developer in Test working on cloud-based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Responsibilities
- Actively participate as a member of an agile data platform team
- Collaborate with Data Engineers and Product Owners to define test strategies alongside feature development
- Design and implement automated test cases upfront for new pipelines and transformations
- Build and maintain automated regression testing frameworks for data pipelines
- Ensure automated tests are reusable across development cycles and integrated into regression suites
- Validate end-to-end data pipelines from Bronze to Silver and Gold
- Integrate automated tests into CI/CD pipelines to enable continuous validation
- Design and implement data observability checks, including:
- Data freshness
- Schema drift detection
- Volume validation
- Metric anomaly detection
- Ensure downstream semantic layers, metrics, and BI dashboards remain consistent after changes
- Perform impact analysis when transformation logic evolves
- Write SQL and Python-based validation scripts
- Identify data quality issues, root causes, and gaps in transformation logic
- Contribute to best practices for test automation, data quality, and observability
- Complement automated testing with manual testing for edge cases, exploratory scenarios, and creative validation.
- Support release validation and production verification
Requirements
- 5+ years of experience as a Software Developer in Test or QA Engineer
- Strong experience with automated testing frameworks and regression testing
- Experience testing data pipelines, transformations, or analytics platforms
- Advanced SQL skills and strong understanding of data modeling
- Experience with Databricks (DLT, streaming, batch processing)
- Experience translating business requirements into automated test scenarios
- Experience with Python or similar scripting languages
- Familiarity with CI/CD pipelines and automated test execution
- Strong analytical and problem-solving skills
- Excellent collaboration and communication skills.
- Strong English communication skills, both written and spoken, are essential for effective correspondence with customers, business partners and colleagues beyond the province of Quebec.
- **Nice to Have**
- Experience with CDC and streaming validation
- Experience with data quality or observability frameworks
- Experience validating BI dashboards (Cognos, Power BI, etc.)
- Knowledge of supply chain or healthcare data domains
- Experience working in cloud environments (AWS preferred)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer at JLL leveraging advanced technical expertise for AI - powered solutions. Designing frameworks and mentoring engineers to achieve strategic business outcomes.
Principal Data Architect at HostPapa focusing on shaping data architecture and insights for CloudBlue’s platform. Collaborating across teams to build AI - driven solutions in a cloud - native environment.
LP
Data Engineer – GCP / Python / SQL (Retail / eCommerce)
LinkedIn Recruiter Post
Data Engineer needed for a 6 - month contract in Toronto, ON. Design and maintain scalable data pipelines for retail analytics.
LP
Data Warehouse Tester / Developer
LinkedIn Recruiter Post
Data Warehouse Tester/Developer needed in Toronto, ON (hybrid). 6 - 8 years exp. with Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Senior Data Engineer leading scalable data infrastructure design at Spellbook. Collaborating with distributed teams to transform contract data into actionable insights.
Data Engineer role focused on building and optimizing data pipelines within Microsoft Fabric at AIM. Collaborating closely with analysts and developers to deliver scalable data solutions.
Senior Software Engineer focusing on data engineering and machine learning for Workday. Involves data ingestion, governance, and collaboration using modern technologies.
LP
Data Warehouse Tester / Developer
LinkedIn Recruiter Post
Hiring Data Warehouse Tester/Developer in Toronto, ON (Hybrid). Requires 6 - 8 years exp in Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Lead Data Engineering and Analytics team to oversee data infrastructure design and governance for robotic deliveries. Collaborate cross - functionally to enable data - driven decision - making across departments.