Data Engineering Lead building critical data foundations for AI systems in an operational AI firm. Collaborate with architects and engineers to drive logistics data insights.
Responsibilities
Data Ingestion & Structuring: Lead the extraction, ingestion, and harmonization of historical freight, order, inventory, and complex carrier rate card data from diverse legacy sources.
Schema Design: Define "Minimum Viable Attributes" and architect a unified, canonical data schema that normalizes client data for downstream consumption.
Pipeline Development: Build robust, reusable ETL/ELT pipelines to facilitate rapid and structured analysis in a highly regulated environment.
Quality Assurance for Modelling: Ensure data quality, completeness, and readiness are sufficient to train predictive machine learning models and run optimization simulations.
Infrastructure Collaboration: Work alongside the Solutions Architect to stand up and operate within a secure, single-tenant sandbox environment ensuring strict data isolation.
Hypothesis Validation: Support the Operations Strategy team by providing the necessary data structures to decompose current allocation logic, enabling the identification of wrong-node, mode-mix, and escalation drivers.
Requirements
5+ years of senior-level data engineering experience with a proven track record of designing data architecture, data lakes/warehouses, and complex ETL/ELT pipelines.
Technical Mastery: Deep proficiency in Python, advanced SQL, and modern data processing libraries
Cloud Expertise: Hands-on experience working within cloud environments to deploy secure, high-performance data infrastructure (e.g., PostgreSQL).
Domain Knowledge: Previous experience working with supply chain, logistics, or ERP data (shipment histories, inventory levels, freight billing) is highly preferred.
Agile Execution: Ability to thrive in rapid, hypothesis-driven sprint cycles (12-week models) where the focus is on validation experiments rather than traditional, slow IT delivery.
AI-Native Workflow: Comfort utilizing LLM code assistants (e.g., Cursor, Copilot) and agentic engineering to multiply your productivity and enhance code quality.
Benefits
Work from anywhere, forever - We are a fully remote and global team. We trust you to manage your time and energy to deliver exceptional results.
Connect deeply - We gather for immersive, all-expenses-paid company retreats in unique locations to connect, learn, and grow together.
Share in the upside - A competitive compensation package including equity, bonuses, substantial participation in company profits with a clear growth path to C-Level leadership based on performance.
Azure Data Engineer role building data pipelines with Azure Data Factory and Databricks. Requires strong programming skills and cloud data ingestion experience.
Data Engineer for Manulife developing and maintaining data systems using Azure services. Collaborating with data professionals to enhance data architecture and ensure data quality.
Senior Data Engineer responsible for maturing strategic data assets across cloud analytics in the financial services sector. Collaborating with business stakeholders and data engineering teams to ensure data compliance and readiness.
Senior Data Engineer at IQVIA, developing scalable data pipelines and leading engineering efforts. Collaborating globally to improve healthcare outcomes through advanced analytics and technology.
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high - quality data.
Senior Software Engineer at Abnormal AI building next - gen data platform with experience in data - intensive applications. Collaborates with engineering teams to enhance scalability and operational excellence.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
Google Cloud Data Engineer implementing data ingestion and analytics frameworks at Fueled. Specializing in Google Cloud Platform and modern data modeling.