Azure Data Engineer role building data pipelines with Azure Data Factory and Databricks. Requires strong programming skills and cloud data ingestion experience.
Responsibilities
Azure Data Engineer responsible for data pipeline development using Azure Data Factory, Azure Databricks with Spark (PySpark or Scala), and SQL. Experience with Azure ingestion from on-prem sources like mainframe, SQL Server, Oracle. Knowledge of Sqoop/Hadoop, Microsoft Excel for metadata files, source-code versioning with Git/Jenkins, and orchestration tools like Autosys or Oozie.
Requirements
Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop / Hadoop • Microsoft Excel (for metadata files with requirements for ingestion) • Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud • Strong Programming skills with at least one of Python, Scala or Java • Strong SQL skills ( T-SQL or PL-SQL) • Data files movement via mailbox • Source-code versioning/promotion tools, e.g. Git/Jenkins • Orchestration tools, e.g. Autosys, Oozie • Source-code versioning with Git.
Data Engineer for Manulife developing and maintaining data systems using Azure services. Collaborating with data professionals to enhance data architecture and ensure data quality.
Senior Data Engineer responsible for maturing strategic data assets across cloud analytics in the financial services sector. Collaborating with business stakeholders and data engineering teams to ensure data compliance and readiness.
Senior Data Engineer at IQVIA, developing scalable data pipelines and leading engineering efforts. Collaborating globally to improve healthcare outcomes through advanced analytics and technology.
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high - quality data.
Senior Software Engineer at Abnormal AI building next - gen data platform with experience in data - intensive applications. Collaborates with engineering teams to enhance scalability and operational excellence.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
Google Cloud Data Engineer implementing data ingestion and analytics frameworks at Fueled. Specializing in Google Cloud Platform and modern data modeling.
Consulting Senior Data Architect specializing in Microsoft Fabric solutions for digital products. Engage in hands - on delivery, architecture, and governance for data engineering in a remote capacity.