Data Engineer building streaming pipelines and analytical databases for Movable Ink’s data-activated marketing personalization platform. Developing Elixir/Python services and reliable event-data products at billions-event scale.
Responsibilities
Design, build, and maintain event streaming pipelines ingesting data from client systems, internal services, and third-party sources
Develop and operate analytical databases and data models optimized for high-volume event queries and low-latency access
Write production Elixir and Python services for event processing, transformation, and routing
Integrate legacy event pipelines with modern streaming infrastructure and design low-risk migration paths
Build and maintain monitoring, alerting, and observability tooling to ensure pipeline health, data freshness, and SLA compliance
Define and enforce event schemas, data contracts, and quality standards with producing and consuming teams
Collaborate with data platform, product engineering, and analytics teams to deliver reliable event data products
Participate in system design reviews and establish best practices for the Events Data team
Requirements
Strong proficiency in Elixir and/or Python
Advanced SQL skills for data modeling, query optimization, and analytical workloads
Hands-on production-scale experience with columnar/OLAP databases
Experience with stream processing frameworks and message brokers such as Apache Flink, Kafka, Pulsar, or Kinesis; Flink is a strong plus
Ability to integrate and migrate legacy and modern systems
Experience operationalizing production data pipelines, including monitoring, alerting, SLA dashboards, and runbooks
Experience designing and operating data systems on AWS; GCP experience is a plus
Strong collaboration and communication skills, including leading design discussions and writing technical specifications
Experience with Infrastructure-as-Code tools such as Terraform, CloudFormation, or similar
Retail events data experience is a plus
Experience with Databricks, Flink, and message brokers such as Kafka, Pulsar, or Kinesis is a plus
Benefits
Additional bonus depending on the position ultimately offered
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.