Senior Data Engineer designing data infrastructure at Vanta to support analytics functions. Collaborating closely with engineering and business teams to ensure data - driven decision - making solutions.
About the role
- Azure/Databricks Data Engineer designing data-driven applications. Build data pipelines, collaborate with cross-functional teams, and work with Azure Stack tools in a hybrid environment.
Responsibilities
- As an Azure and Databricks Data Engineer, the role focuses on designing, building, and supporting data‑driven applications that enable innovative, customer‑centric digital experiences. Work as part of a cross‑discipline agile team, collaborating to solve problems across business areas. Build reliable, supportable, and performant data lake and data warehouse products to support reporting, analytics, applications, and innovation. Apply best practices in development, security, accessibility, and design to deliver high‑quality services. Develop modular and scalable ELT/ETL pipelines and data infrastructure leveraging diverse enterprise data sources. Create curated common data models in collaboration with Data Modelers and Data Architects to support business intelligence, reporting, and downstream systems. Partner with infrastructure, cyber teams, and Senior Data Developers to ensure secure data handling in transit and at rest. Clean, prepare, and optimize datasets with strong lineage and quality controls throughout the integration cycle. Support BI Analysts with dimensional modeling and aggregation optimization for visualization and reporting. Collaborate with Business Analysts, Data Scientists, Senior Data Engineers, Data Analysts, Solution Architects, and Data Modelers. Work with Microsoft Stack tools including Azure Data Factory, ADLS, Azure SQL, Synapse, Databricks, Purview, and Power BI. Operate within an agile SCRUM framework, contributing to backlog development and using Kanban/SCRUM toolsets. Develop performant pipelines and models using Python, Spark, and SQL across XML, CSV, JSON, REST APIs, and other formats. Create tooling to reduce operational toil and support CI/CD and DevOps practices for automated delivery and release management. Monitor in‑production solutions, troubleshoot issues, and provide Tier 2 dataset support. Implement role‑based access control and perform automated unit, regression, UAT, and integration testing.
Requirements
- Completion of a four‑year university program in computer science, engineering, or related data disciplines. Experience designing and building data pipelines, with strong Python, PySpark, SparkSQL, and SQL skills. Experience with Azure Data Factory, ADLS, Synapse, and Databricks, and building pipelines for Data Lakehouses and Warehouses. Strong understanding of data structures, governance, and data quality principles, with effective communication skills for technical and non‑technical audiences.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer for Vena, focused on building a robust data platform to support business strategies. Overseeing the data engineering processes and promoting a data - driven culture across the organization.
Lead Data Engineer designing and optimizing AI - powered data platforms at Brillio. Collaborating with experts to build intelligent workflows and ensuring data security.
LP
Data Migration Specialist / Developer (ETL)
LinkedIn Recruiter Post
Hiring Data Migration Specialist / Developer (ETL) for contract hybrid role in Oakville, ON. Requires 9+ years experience in data migration, data engineering, and cloud.
AI Platform Engineer leading multidisciplinary teams building AI - powered applications and intelligent workflows at Valtech. Shape the future of experience through Data, AI, and emerging solutions.
LP
Datastage ETL
LinkedIn Recruiter Post
Aarorn Technologies seeks a Datastage ETL contractor with 5+ years of experience for a hybrid role in Toronto. Must have IBM InfoSphere DataStage, SQL, Unix scripting, and scheduling skills.
LP
Azure Databricks Developer-HR Platforms
LinkedIn Recruiter Post
Azure Databricks Developer needed for HR tech projects at a top financial client. Design ETL solutions, support data integrations, and modernize HR data platforms.
Senior Software Engineer, Data responsible for building data pipelines and maintaining infrastructure for analytics and ML. Collaborate with teams to optimize data systems at Narvar.
Data Architect leading conversations and decisions on data modeling at a global consulting firm specializing in Data & Analytics. Transforming complex processes into clear, reusable information models.
Senior Data Engineer at Supabase managing data pipelines from source to analysis. Collaborating with growth, finance, and product teams to drive business insights.