Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
About the role
- Software Developer in Test working on cloud-based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Responsibilities
- Actively participate as a member of an agile data platform team
- Collaborate with Data Engineers and Product Owners to define test strategies alongside feature development
- Design and implement automated test cases upfront for new pipelines and transformations
- Build and maintain automated regression testing frameworks for data pipelines
- Ensure automated tests are reusable across development cycles and integrated into regression suites
- Validate end-to-end data pipelines from Bronze to Silver and Gold
- Integrate automated tests into CI/CD pipelines to enable continuous validation
- Design and implement data observability checks, including:
- Data freshness
- Schema drift detection
- Volume validation
- Metric anomaly detection
- Ensure downstream semantic layers, metrics, and BI dashboards remain consistent after changes
- Perform impact analysis when transformation logic evolves
- Write SQL and Python-based validation scripts
- Identify data quality issues, root causes, and gaps in transformation logic
- Contribute to best practices for test automation, data quality, and observability
- Complement automated testing with manual testing for edge cases, exploratory scenarios, and creative validation.
- Support release validation and production verification
Requirements
- 5+ years of experience as a Software Developer in Test or QA Engineer
- Strong experience with automated testing frameworks and regression testing
- Experience testing data pipelines, transformations, or analytics platforms
- Advanced SQL skills and strong understanding of data modeling
- Experience with Databricks (DLT, streaming, batch processing)
- Experience translating business requirements into automated test scenarios
- Experience with Python or similar scripting languages
- Familiarity with CI/CD pipelines and automated test execution
- Strong analytical and problem-solving skills
- Excellent collaboration and communication skills.
- Strong English communication skills, both written and spoken, are essential for effective correspondence with customers, business partners and colleagues beyond the province of Quebec.
- **Nice to Have**
- Experience with CDC and streaming validation
- Experience with data quality or observability frameworks
- Experience validating BI dashboards (Cognos, Power BI, etc.)
- Knowledge of supply chain or healthcare data domains
- Experience working in cloud environments (AWS preferred)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
Principal Data Engineer
LinkedIn Recruiter Post
Principal Data Engineer with 10+ years experience, strong AWS skills. Design large - scale data platforms in hybrid Toronto role.
Google Cloud Data Engineer implementing data ingestion and analytics frameworks at Fueled. Specializing in Google Cloud Platform and modern data modeling.
Consulting Senior Data Architect specializing in Microsoft Fabric solutions for digital products. Engage in hands - on delivery, architecture, and governance for data engineering in a remote capacity.
Data Engineer at Motive delivering data infrastructure for the AI era. Collaborating with stakeholders, building models, and implementing innovative tooling.
Data Architect designing and governing data foundations for analytics and AI applications at Clio. Collaborating cross - functionally to develop high - quality data models and standards.
LP
IAM / Data Engineer
LinkedIn Recruiter Post
IAM/Data Engineer role in Toronto (Hybrid). Requires 4+ years in ETL, data pipelines, cloud platforms, and skills in Windows IAM, Ansible, Terraform, SQL, Python/Java, Spark/Kafka.
Data Migration Specialist managing client data migrations to gaiia's platform. Collaborating with teams to ensure accurate and timely data transitions.
Senior Data Architect/Strategist at Robots & Pencils blending advanced data knowledge with problem solving to drive intelligent products and smarter business decisions.
Principal Data Architect at PointClickCare ensuring coherent and scalable data architecture. Driving unified data direction while collaborating with Engineering Architecture team for AI enablement.