Senior Data Engineer building Azure, Databricks, and Snowflake pipelines for 73 Strings’ private-capital data platform. Owning ingestion, transformation, quality, CI/CD, and production delivery.
Responsibilities
Build and operate pipelines, integrations and warehouse supporting valuation and monitoring
Own production pipelines from source capture through transformation, reconciliation and client delivery
Put pipelines under GitHub, automated testing and CI/CD
Help redefine platform architecture across ingestion, processing and delivery
Build and operate batch and streaming pipelines from databases, APIs, event streams and semi-structured sources
Implement change data capture and incremental loading, including ordering, deletes, replay and slowly changing dimensions
Build medallion datasets and dimensional models for Snowflake, Microsoft SQL Server and Databricks
Apply data contracts, reconciliation and row-level quarantine before publication
Own GitHub workflow and CI/CD, including tests, review, environment promotion and deployment as code
Investigate production data failures
Translate requirements from product, valuation and client-facing teams into operable pipelines
Requirements
10+ years in data engineering on production systems
Snowflake or Databricks as a primary platform, including modelling, performance tuning and cost management
Python and SQL for pipeline development and testing
Change data capture and event processing, including ordering, replay and schema change
Azure, including Databricks, ADLS and private network connectivity
GitHub and CI/CD for data workloads, using GitHub Actions or an equivalent system
Data quality, reconciliation, monitoring and production incident response
Experience building multi-tenant, secure data platforms, including tenant isolation, access control and data protection
Desirable: Databricks Lakeflow, Auto CDC, Declarative Automation Bundles and DQX, or Snowflake equivalents including Dynamic Tables, Streams and Tasks, Snowpark, Snowflake CLI deployments and Data Metric Functions
Debezium, Kafka Connect or Confluent Kafka
Apache Airflow or an equivalent workflow orchestrator
Kafka or Spark Structured Streaming, Apache Iceberg or Delta Sharing, and dbt for analytical models on curated data
Private markets data: valuations, funds, portfolio companies or capital activity
Comfortable working directly with client technical teams and collaborating across field engineering, product and other stakeholders
Benefits
Supportive culture of innovation and collaboration
Opportunities to take initiative and learn continuously
Senior Data Engineer building and migrating enterprise data platforms on Google Cloud. Designing BigQuery pipelines and architectures for consulting clients through production hand - off.
Full Stack Data Engineer migrating legacy insurance licensing and compensation systems. Building ETL pipelines, data models, reconciliations, reporting, and downstream feeds for Manulife.
Senior Data Engineer building Azure Synapse big data pipelines for Quantiphi, an AI - first digital engineering company. Supporting healthcare cloud migrations, large - scale processing, and data platforms.
Senior Developer building C#, SQL, and cloud tooling to migrate legal, billing, and trust - accounting data. Supporting complex client migrations for a technology company serving financial services firms.
Data Migration Lead moving legal, billing, and trust accounting data into a legal technology platform. Leading analysts, conversion tooling, customer migrations, and compliance controls.
Senior Software Engineer building scalable AWS microservices and APIs for Morningstar's global investment data platform. Modernizing distributed systems and enabling reliable financial data delivery.
Data infrastructure engineer building searchable robotics datasets and quality pipelines at Mecka AI. Managing distributed robot fleet infrastructure, deployments, monitoring, governance, and cloud costs.
Senior Data Migration Engineer leading PACS, RIS, VNA, and cloud migrations for INFINITT’s healthcare IT business. Ensuring secure data integrity across clinical imaging environments.
Data Engineering Advisor building Azure data pipelines and analytics solutions for Desjardins. Designing ingestion, transformation, and data management systems for business needs.
Staff Software Engineer building Instacart’s advertising data platform for grocery delivery and household goods. Designing compliant, scalable systems for advertisers, data scientists, and sales teams.