Data Engineering Lead building critical data foundations for AI systems in an operational AI firm. Collaborate with architects and engineers to drive logistics data insights.
Responsibilities
Data Ingestion & Structuring: Lead the extraction, ingestion, and harmonization of historical freight, order, inventory, and complex carrier rate card data from diverse legacy sources.
Schema Design: Define "Minimum Viable Attributes" and architect a unified, canonical data schema that normalizes client data for downstream consumption.
Pipeline Development: Build robust, reusable ETL/ELT pipelines to facilitate rapid and structured analysis in a highly regulated environment.
Quality Assurance for Modelling: Ensure data quality, completeness, and readiness are sufficient to train predictive machine learning models and run optimization simulations.
Infrastructure Collaboration: Work alongside the Solutions Architect to stand up and operate within a secure, single-tenant sandbox environment ensuring strict data isolation.
Hypothesis Validation: Support the Operations Strategy team by providing the necessary data structures to decompose current allocation logic, enabling the identification of wrong-node, mode-mix, and escalation drivers.
Requirements
5+ years of senior-level data engineering experience with a proven track record of designing data architecture, data lakes/warehouses, and complex ETL/ELT pipelines.
Technical Mastery: Deep proficiency in Python, advanced SQL, and modern data processing libraries
Cloud Expertise: Hands-on experience working within cloud environments to deploy secure, high-performance data infrastructure (e.g., PostgreSQL).
Domain Knowledge: Previous experience working with supply chain, logistics, or ERP data (shipment histories, inventory levels, freight billing) is highly preferred.
Agile Execution: Ability to thrive in rapid, hypothesis-driven sprint cycles (12-week models) where the focus is on validation experiments rather than traditional, slow IT delivery.
AI-Native Workflow: Comfort utilizing LLM code assistants (e.g., Cursor, Copilot) and agentic engineering to multiply your productivity and enhance code quality.
Benefits
Work from anywhere, forever - We are a fully remote and global team. We trust you to manage your time and energy to deliver exceptional results.
Connect deeply - We gather for immersive, all-expenses-paid company retreats in unique locations to connect, learn, and grow together.
Share in the upside - A competitive compensation package including equity, bonuses, substantial participation in company profits with a clear growth path to C-Level leadership based on performance.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.