Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company. Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.
About the role
- GCP Data Platform Engineer maintaining and optimizing production data platforms for Innodata, a global data engineering and AI services company. Supporting Airflow pipelines, GCP infrastructure, reliability, and troubleshooting.
Responsibilities
- Support and maintain production GCP data platforms, pipelines, and workflows across batch and streaming workloads
- Troubleshoot and optimize Cloud Composer / Apache Airflow workflows, including DAG failures, dependencies, scheduling, retries, latency, and SLA issues
- Troubleshoot pipeline failures, data latency, performance degradation, configuration problems, and infrastructure issues
- Monitor platform health and improve reliability, scalability, performance, and operational efficiency
- Optimize existing pipelines and workloads to improve refresh times, throughput, query performance, and platform stability
- Support platform, infrastructure, configuration, and dependency upgrades while maintaining production stability and compliance
- Perform root-cause analysis and implement sustainable fixes for recurring production issues
- Support IAM, access controls, monitoring, alerting, logging, and operational governance
- Collaborate with client and cross-functional Data Engineering, BI/Analytics, Application Engineering, Infrastructure, and Platform teams
- Review existing architectures and recommend incremental improvements
- Create and maintain technical documentation, operational runbooks, troubleshooting guides, and platform support procedures
Requirements
- 3–7 years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a related role
- Strong hands-on experience building, supporting, or maintaining production workloads on Google Cloud Platform
- Strong experience with BigQuery and Cloud Spanner
- Hands-on experience with Dataflow, Pub/Sub, batch/streaming data pipelines, and Cloud Composer / Apache Airflow
- Strong Python and SQL skills
- Understanding of GCP IAM, service accounts, permissions, monitoring, logging, alerting, and production operations
- Experience troubleshooting complex production environments and performing root-cause analysis
- Understanding of data ingestion, transformation, orchestration, data quality, performance optimization, and reliability
- Ability to understand existing systems, codebases, pipelines, configurations, and client-specific tools and workflows
- Strong communication and collaboration skills
- Preferred: App Engine, Cloud Run, GKE, CI/CD and DevOps on GCP, Terraform, data observability, automated data-quality monitoring, Vertex AI, and enterprise analytics tooling
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Fabric Data Engineer modernizing learning - platform data for Cornerstone Galaxy. Building Microsoft Fabric pipelines, curated datasets, governance, and analytics - ready integrations.
Senior Data Engineer building finance data pipelines and models for Instacart’s grocery delivery platform. Owning financial data infrastructure supporting accounting, billing, invoicing, and reporting.
Senior Data Architect modernizing Alberta justice data marts into an integrated enterprise data warehouse. Designing ETL, Power BI testing, data models, governance, and reporting architecture.
Senior Data Architect integrating Alberta court data marts into an enterprise data warehouse. Designing ETL, data models, governance practices, and Power BI validation reports.
LP
Senior Data Engineer
LinkedIn Recruiter Post
Senior Data Engineer contract role: design/build ETL/ELT pipelines using Azure stack, primarily remote in Canada, occasional onsite in Edmonton.
Data & Analytics Engineer building scalable data platforms for Ledgebrook, an insurance company. Designing pipelines, governance, and cloud data systems while partnering with technical and insurance teams.
Data Engineer building scalable pipelines for SumerSports’ football intelligence platform. Supporting deep learning, video, LLM, analytics, and AI - driven products across sports.
Data Platform Engineer building ingestion pipelines, storage, governance, and observability systems for Movable Ink’s AI - driven marketing personalization platform. Supporting scalable, secure, multi - tenant data services.
Senior Data Engineer building AWS and dbt data pipelines for Tango’s cloud real - estate and facilities SaaS platform. Managing databases, warehouses, data quality, and analytics - ready datasets.