Azure Data Engineer role building data pipelines with Azure Data Factory and Databricks. Requires strong programming skills and cloud data ingestion experience.
Responsibilities
Azure Data Engineer responsible for data pipeline development using Azure Data Factory, Azure Databricks with Spark (PySpark or Scala), and SQL. Experience with Azure ingestion from on-prem sources like mainframe, SQL Server, Oracle. Knowledge of Sqoop/Hadoop, Microsoft Excel for metadata files, source-code versioning with Git/Jenkins, and orchestration tools like Autosys or Oozie.
Requirements
Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop / Hadoop • Microsoft Excel (for metadata files with requirements for ingestion) • Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud • Strong Programming skills with at least one of Python, Scala or Java • Strong SQL skills ( T-SQL or PL-SQL) • Data files movement via mailbox • Source-code versioning/promotion tools, e.g. Git/Jenkins • Orchestration tools, e.g. Autosys, Oozie • Source-code versioning with Git.
Senior Product Manager overseeing data platform and intelligence capabilities at Wattpad. Collaborating with cross - functional teams to build systems for smarter product decisions.
Hands - on Manager, Data Architecture leading data analytics and data management for Optiom, a Canadian specialty insurer. Building a governed cloud data platform and analytics function.
Senior Backend Engineer enhancing health data platform at Molecular You. Owning platform quality, driving technology adoption, and ensuring security compliance.
AVP, Enterprise Data Architecture at Sun Life, managing enterprise data architecture and strategy. Collaborating with cross - functional teams to drive client - centric solutions leveraging data and analytics.
Data Architect designing enterprise - level data storage solutions for Servus Credit Union. Collaborating with teams to enhance data practices supporting the organization's goals.
Data Migration Engineer at gaiia owning the technical execution of data migrations for telecom service providers. Focusing on transforming customer data from legacy systems into gaiia's platform.
Product Manager responsible for the Data Platform at SandboxAQ, enhancing scientific discovery capabilities. Leading product management for data lifecycle in advanced materials and drug discovery.
Associate Data Engineer working with a global team to build reliable data pipelines. Collaborating on meaningful projects that support real business decisions within a hybrid work environment.
Commissioning Program & Data Engineer working on controlled, data - driven commissioning programs at Bird. Responsible for tracking tests, issue logs, and analyzing commissioning data.