Senior Data Engineer building and migrating enterprise data platforms on Google Cloud. Designing BigQuery pipelines and architectures for consulting clients through production hand-off.
Responsibilities
Assess the customer's current data estate and produce a target-state GCP data architecture and migration plan
Build ingestion, transformation, and orchestration pipelines, including batch and streaming pipelines, into BigQuery
Deploy data infrastructure entirely through Terraform and CI/CD
Migrate historical data and workloads with documented reconciliation proving row- and aggregate-level parity
Tune BigQuery models and queries for cost and performance
Leave the customer with monitoring and alerting on pipeline health
Deliver runbooks and architecture documentation
Conduct knowledge-transfer sessions so the customer team can own the platform after hand-off
Work directly with customer engineering and analytics teams from discovery through hand-off
Requirements
6+ years in data engineering, including 3+ years delivering production workloads on Google Cloud Platform
Deep hands-on BigQuery experience: data modeling, partitioning and clustering, cost and performance tuning, and ELT in SQL
Experience building and operating batch and streaming pipelines with Dataflow (Apache Beam) and/or Dataproc (Spark / PySpark), with Pub/Sub as a streaming source
Experience orchestrating production workflows with Cloud Composer (Apache Airflow), including dependency management, retries, and alerting
Strong Python and advanced SQL
Experience provisioning GCP data infrastructure with Terraform and deploying through Git-based CI/CD
Delivered at least one migration into BigQuery from an on-prem or legacy platform, including data validation and cut-over
Client-facing experience: running requirements sessions, presenting designs, and handing off documented solutions to customer teams
Google Cloud Professional Data Engineer certification, or a current Associate Cloud Engineer / Professional Cloud Architect certification (useful qualification)
Databricks certification or production Databricks-on-GCP experience (useful qualification)
Looker / LookML modeling, or Looker Studio dashboard delivery (useful qualification)
Serverless integration work on Cloud Run or Cloud Functions (useful qualification)
Data governance on GCP: Dataplex, Data Catalog, IAM and column-level security, DLP (useful qualification)
Experience feeding GenAI use cases from the warehouse: BigQuery ML, Vertex AI, embeddings or RAG data preparation (useful qualification)
Experience using BigQuery Migration Service / SQL translation, Datastream, or Database Migration Service on a real migration (useful qualification)
Prior experience at a Google Cloud partner or in Google Cloud Professional Services (useful qualification)
No sponsorship available
Benefits
Fully remote engagement from anywhere in the United States or Canada
Possible contract extension beyond the initial 6-month duration
Full Stack Data Engineer migrating legacy insurance licensing and compensation systems. Building ETL pipelines, data models, reconciliations, reporting, and downstream feeds for Manulife.
Senior Data Engineer building Azure Synapse big data pipelines for Quantiphi, an AI - first digital engineering company. Supporting healthcare cloud migrations, large - scale processing, and data platforms.
Senior Data Engineer building Azure, Databricks, and Snowflake pipelines for 73 Strings’ private - capital data platform. Owning ingestion, transformation, quality, CI/CD, and production delivery.
Senior Developer building C#, SQL, and cloud tooling to migrate legal, billing, and trust - accounting data. Supporting complex client migrations for a technology company serving financial services firms.
Data Migration Lead moving legal, billing, and trust accounting data into a legal technology platform. Leading analysts, conversion tooling, customer migrations, and compliance controls.
Senior Software Engineer building scalable AWS microservices and APIs for Morningstar's global investment data platform. Modernizing distributed systems and enabling reliable financial data delivery.
Data infrastructure engineer building searchable robotics datasets and quality pipelines at Mecka AI. Managing distributed robot fleet infrastructure, deployments, monitoring, governance, and cloud costs.
Senior Data Migration Engineer leading PACS, RIS, VNA, and cloud migrations for INFINITT’s healthcare IT business. Ensuring secure data integrity across clinical imaging environments.
Data Engineering Advisor building Azure data pipelines and analytics solutions for Desjardins. Designing ingestion, transformation, and data management systems for business needs.
Staff Software Engineer building Instacart’s advertising data platform for grocery delivery and household goods. Designing compliant, scalable systems for advertisers, data scientists, and sales teams.