Data Engineer with Apache Iceberg experience. Hybrid role in Mississauga, ON requiring big data pipeline skills.
Responsibilities
Data Engineer role building and optimizing big data pipelines, architectures, and data sets using technologies like Apache Iceberg, Spark, Hadoop, and Flink.
Requirements
Bachelor’s or Master’s degree in Computer Science, Engineering, or related quantitative field. Proven experience as Data Engineer. Strong proficiency in Python (with extensive pySpark), Java, or Scala. Expertise in Apache Spark, Hadoop HDFS, real-time stream processing with Apache Flink, data lake table formats (Apache Iceberg), relational SQL and NoSQL databases. Understanding of ETL/ELT processes, data warehousing, and data modeling. Cloud platform experience (AWS, Azure, GCP) is good to have.
Cloud Data Engineer responsible for modern Data & AI solutions on Microsoft Azure. Collaborating with clients and teams to develop production - ready data platforms and support analytics.
Senior Data Engineer at Solana Foundation collaborating with blockchain engineers on data indexing and pipeline creation. Ensuring efficient data processing and metrics formulation for decentralized applications.
Senior Engineer on Data Platform team designing and building systems for data flow at Movable Ink. Collaborating with engineering, analytics, and infrastructure teams to power data ingestion and processing.
Senior Data Engineer responsible for designing and maintaining event streaming pipelines at Movable Ink. Working with modern technologies to enhance data availability and reliability.
Senior Data Engineer architecting and owning Snowflake layer for Knak’s Data Infrastructure and AI enablement. Collaborating across departments to ensure data accessibility and governance standards.
Data Engineer designing and implementing cloud - native data ecosystem for sports analytics. Building scalable infrastructure to transform raw data into valuable consent assets.
Data Engineer owning infrastructure that turns raw events from mobile users into trustworthy data. Building scalable data architecture and collaborating with cross - functional teams for data management.
Data Architect engaging with companies on transformational data programs to enhance AI and data capabilities. Leading architectural frameworks and mentoring data teams against industry best practices.
ML Data Engineer responsible for designing and developing AI platforms at Newfold Digital. Collaborating across teams to integrate and optimize data sources for AI - driven applications.