Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Responsibilities
Own the Databricks data lake end to end, including dbt models, medallion layers, incremental and backfill strategy, partitioning, freshness, and quality monitoring
Stand up CDC and streaming ingestion from HubSpot, Langfuse, Postgres, and DynamoDB into the data lake, handling idempotency and deduplication
Own data services, schema and migration strategy, versioned APIs, provenance and audit trails, tests, and observability
Build AI data infrastructure, embedding pipelines, vector stores, retrieval knowledge bases, feature stores, and LLM observability
Develop and maintain cloud databases with the Infrastructure team
Improve data retrieval and optimize analytics dashboards
Maintain data management and security policies
Collaborate with software, AI/ML, and data engineers, data scientists, product, and business units to align requirements
Communicate technical concepts clearly to non-technical stakeholders
Guide and mentor engineers in data best practices
Requirements
At least 4 to 6 years of professional data engineering experience
Demonstrated experience owning the maintenance and implementation of databases, data pipelines and backends, with a focus on efficient data management and integration of system components
Proficiency in Python (preferred) and SQL
Experience designing multi-tenant data systems with hard isolation requirements and handling PII or other regulated data
Proficiency in data modeling, medallion architecture, star schema, or Snowflake schema
Hands-on experience with cloud platforms such as AWS, Azure, or GCP
Experience with dbt, Databricks Workflows, Apache Airflow, Prefect, Dagster or equivalent, change-data-capture tooling, or AWS Step Functions
Proficiency in data visualization tools such as Databricks SQL dashboards, Tableau, or Power BI equivalent
Experience building or supporting AI products
Proficiency in data governance
Bachelor's or Master's degree in Computer Science, Data Engineering, Computer Engineering, or related technical discipline, or equivalent experience (bonus)
Benefits
Employee stock options, granted based off experience level upon hire and subject to a standard vesting schedule
Employee stock options based on experience level
Comprehensive health benefits, including $500 Lifestyle Spending Account
Four weeks of paid vacation per year
Work anywhere in the world for 60 calendar days of the year
Parental leave top-ups: 6 months for birthing parents, 8 weeks for non-birthing parents (up to $100,000 annual salary)
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.
Senior SQL Developer building SQL warehouses, ETL pipelines, and reporting solutions for TD Bank’s treasury technology team. Supporting cloud modernization and business - critical financial analytics.
Data Migration Consultant managing CRM data imports, validation, and onboarding for Neon One, a nonprofit software company. Coordinating clients, engineers, and cross - functional teams.
Data Migration Specialist defining mappings and validating migrations for ClearRisk’s cloud - based claims and risk management solutions. Ensuring customer data is accurate, clean, and business - ready.
Senior Data Engineer building scalable data platforms and pipelines for Confluence’s investment data business. Collaborating on architecture while mentoring engineers and solving complex data challenges.
Senior Data Engineer building Dandy’s data infrastructure for its technology - powered dental operating system. Developing pipelines, governed data products, and AI - ready platform capabilities.