Senior Software Engineer on Data Platform developing and maintaining infrastructure for data ingestion and processing. Collaborating on projects that drive AI and analytics initiatives at Samsara.
LP
Data Engineer (Azure Data Factory | Databricks | PySpark)
Posted via LinkedIn Recruiter (not a company profile)
Posted 5 days ago
About the role
- Data Engineer needed for 12-month contract in Pickering, ON. Must have Azure Data Factory, Databricks, PySpark, and SQL expertise.
Responsibilities
- Build and productionize scalable ETL/ELT data pipelines; develop and optimize data workflows using Azure Data Factory and Azure Databricks; design and maintain data lakehouse and data warehouse solutions; implement data ingestion pipelines from multiple sources; ensure data quality, lineage, governance, and security standards; work closely with Data Architects, BI teams, and Data Scientists; support production systems and troubleshoot data pipeline issues; build orchestration and automation; participate in Agile ceremonies, code reviews, and CI/CD practices; contribute to metadata management and data catalog initiatives; develop automated testing for data pipelines.
Requirements
- Must-Have: Strong hands-on experience with Azure Data Factory (ADF), expertise in Azure Databricks, strong programming in PySpark and SparkSQL, advanced SQL skills, experience with Azure Data Lake (ADLS) and/or Azure Synapse Analytics, experience building ETL/ELT data pipelines, strong understanding of data structures and data processing frameworks. Nice to Have: Azure Purview or data governance tools, CI/CD for data pipelines, Power BI or data visualization exposure, experience with CI/CD, automation, and infrastructure-as-code concepts, experience working in Agile/SCRUM environments.
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer at Sumsub, developing scalable data integration solutions and maintaining data quality. Collaborating with teams to optimize data processes in a remote - first environment.
Operations Data Engineer at Dotmatics focused on managing cloud architecture and optimizing costs. Collaborating with engineering and leadership to enhance operational health effectively.
Associate Data Engineer joining Confluence to build data pipelines and collaborate in a modern data environment. Solve real data challenges and contribute to meaningful projects supporting business decisions.
Associate Data Engineer building reliable data pipelines and contributing to data solutions at Confluence. Collaborating closely with experienced engineers and analysts in a modern data environment.
Senior Data Engineer designing and delivering scalable data solutions at Confluence. Collaborating cross - functionally and mentoring engineers while managing key components of the data platform.
Senior Data Engineer at Confluence responsible for designing and delivering scalable data solutions. Collaborating with teams and mentoring engineers in modern data engineering practices.
LP
Data Migration Engineer – With Salesforce
LinkedIn Recruiter Post
Data Migration Engineer with Salesforce needed for hybrid contract in Mississauga, ON. Must have GCP Dataproc, Spark, Python, BigQuery, and Salesforce API experience.
Data Engineer enhancing data analytics and reporting capabilities for Silk & Snow. Bridging raw data with actionable insights while contributing to data infrastructure efficiency.
Lead Data Engineer responsible for data architecture, driving data quality, and mentoring the engineering team. Join a high - growth crypto gaming platform with a focus on scalable data solutions.