Data Engineer developing scalable data pipelines for Bitcoin mining software, supporting compute infrastructure, and influencing company - wide strategy.
LP
Data Engineer with Apache Iceberg
Posted via LinkedIn Recruiter (not a company profile)
Posted 3 months ago
About the role
- Data Engineer with Apache Iceberg experience needed for hybrid role in Mississauga. Requires big data pipeline skills and Spark proficiency.
Responsibilities
- Data Engineer role building and optimizing big data pipelines, architectures, and datasets. Requires expertise in Apache Spark, Hadoop ecosystem, real-time stream processing with Apache Flink, and data lake table formats specifically Apache Iceberg.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related quantitative field. Proven experience as Data Engineer building big data pipelines. Strong proficiency in Python (with extensive pySpark), Java, or Scala. Expertise in Apache Spark, Spark SQL, DataFrames, RDDs. Hands-on experience with Apache Hadoop ecosystem (HDFS). Experience with real-time stream processing using Apache Flink. Familiarity with Apache Iceberg for managing large datasets. Experience with relational SQL and NoSQL databases. Solid understanding of ETL/ELT processes, data warehousing, data modeling. Good to have: cloud platforms (AWS, Azure, GCP) and their data services. Excellent problem-solving, analytical, and communication skills.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer at JLL leveraging advanced technical expertise for AI - powered solutions. Designing frameworks and mentoring engineers to achieve strategic business outcomes.
Principal Data Architect at HostPapa focusing on shaping data architecture and insights for CloudBlue’s platform. Collaborating across teams to build AI - driven solutions in a cloud - native environment.
LP
Data Warehouse Tester / Developer
LinkedIn Recruiter Post
Data Warehouse Tester/Developer needed in Toronto, ON (hybrid). 6 - 8 years exp. with Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
LP
Data Engineer – GCP / Python / SQL (Retail / eCommerce)
LinkedIn Recruiter Post
Data Engineer needed for a 6 - month contract in Toronto, ON. Design and maintain scalable data pipelines for retail analytics.
Senior Data Engineer leading scalable data infrastructure design at Spellbook. Collaborating with distributed teams to transform contract data into actionable insights.
Data Engineer role focused on building and optimizing data pipelines within Microsoft Fabric at AIM. Collaborating closely with analysts and developers to deliver scalable data solutions.
Senior Software Engineer focusing on data engineering and machine learning for Workday. Involves data ingestion, governance, and collaboration using modern technologies.
LP
Data Warehouse Tester / Developer
LinkedIn Recruiter Post
Hiring Data Warehouse Tester/Developer in Toronto, ON (Hybrid). Requires 6 - 8 years exp in Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Lead Data Engineering and Analytics team to oversee data infrastructure design and governance for robotic deliveries. Collaborate cross - functionally to enable data - driven decision - making across departments.