Staff Data Engineer building pipelines, models, and infrastructure for exacare ai’s post - acute care AI platform. Turning healthcare data into reliable foundations for product, analytics, and ML workflows.
LP
Data Engineer with Apache Iceberg
Posted via LinkedIn Recruiter (not a company profile)
Posted 8 months ago
About the role
- Data Engineer with Apache Iceberg experience needed for hybrid role in Mississauga. Requires big data pipeline skills and Spark proficiency.
Responsibilities
- Data Engineer role building and optimizing big data pipelines, architectures, and datasets. Requires expertise in Apache Spark, Hadoop ecosystem, real-time stream processing with Apache Flink, and data lake table formats specifically Apache Iceberg.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related quantitative field. Proven experience as Data Engineer building big data pipelines. Strong proficiency in Python (with extensive pySpark), Java, or Scala. Expertise in Apache Spark, Spark SQL, DataFrames, RDDs. Hands-on experience with Apache Hadoop ecosystem (HDFS). Experience with real-time stream processing using Apache Flink. Familiarity with Apache Iceberg for managing large datasets. Experience with relational SQL and NoSQL databases. Solid understanding of ETL/ELT processes, data warehousing, data modeling. Good to have: cloud platforms (AWS, Azure, GCP) and their data services. Excellent problem-solving, analytical, and communication skills.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer architecting cloud data platforms and pipelines for Arc’teryx supply chain analytics. Leading migrations, governance, observability, and engineering mentorship.
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.