Data Engineer designing and optimizing Big Data solutions for a marketing platform. Collaborating with data scientists and software engineers to enhance data management and analysis.
Responsibilities
Design, develop and maintain robust ingestion, processing and transformation pipelines for large-scale data
Build and maintain reliable ETL processes powering decision-support systems and BI platforms
Implement data validation and cleansing processes
Monitor and optimize data processing workflows, storage systems and cloud resources
Apply data security measures to protect sensitive information
Write and maintain clear documentation for pipelines, systems and processes
Collaborate with cross-functional teams to understand data needs
Requirements
Bachelor’s or Master’s degree in Computer Science, Computer Engineering or a related field
5+ years of experience as a Data Engineer in a Big Data environment, including 3–5 years with Apache Spark
Strong expertise in Databricks, Delta Lake, Data Lake architecture and distributed computing
Proficiency in Python
Solid experience with cloud platforms (AWS, GCP or Azure), including cloud cost optimization
Excellent problem-solving skills and ability to communicate complex technical concepts to non-technical stakeholders
Fluency in French and English
Benefits
Corporate social responsibility (CSR)
Practices for purchasing refurbished computers
Partnership with Noos and Ecotree
Energy-efficient offices
Donations and engagement with nonprofit organizations
International DE&I Committee (Diversity, Equity & Inclusion)
Data Engineer optimizing data estate and monitoring ETL processes for digital marketing sector. Collaborating on architecture migration and data analytics projects to enhance performance.
Hiring a Principal Databricks Data Engineer in Toronto, ON for a full - time permanent role. Requires 12 - 18 years of data engineering experience and expertise in Databricks and Spark.
Senior Graph Database Architect focused on designing graph database architecture for AI platform in Canada. Collaborating with AI/ML teams and mentoring engineering staff.
Data Engineer responsible for building data pipelines and supporting analytics for an energy transition platform. Collaborate with diverse teams to drive insights in a dynamic, impactful environment.
Product Manager for PointClickCare’s Data Platform, enabling trusted and well - defined data. Collaborate across teams to operationalize datasets and enhance product analytics.
Senior Applied Research Engineer developing AI model systems and gold data layers for healthcare providers at PointClickCare. Fostering innovation and collaboration with AI experts to enhance healthcare delivery.
Aarorn Technologies seeks a Datastage ETL contractor with 5+ years experience for a hybrid role in Toronto. Must have IBM DataStage, SQL, Unix scripting, and scheduling skills.