Product Manager owning Spotify’s data catalogue, metadata, and lineage roadmap. Improving how engineers, analysts, and AI agents discover and safely use data.
About the role
- Senior Data Engineer building scalable data platforms for Alpaca’s global brokerage infrastructure. Operating Kubernetes, streaming, lakehouse, and cloud data systems at scale.
Responsibilities
- Design, build, and evolve the core data platform infrastructure, including distributed query engines, orchestration, warehousing, and cataloging
- Own lakehouse infrastructure as code, managing deployments through Terraform and Ansible on Kubernetes
- Build and maintain low-latency streaming and CDC ingestion pipelines, as well as batch ingestion paths landing in Iceberg
- Develop and scale the BI landscape for performant, self-serve access to lakehouse data
- Enforce platform reliability best practices, including monitoring and alerting, on-call rotations, incident response, maintenance windows, runbooks, and SLAs
- Partner with DevOps, Analytics Engineering, and other stakeholders to close infrastructure gaps and support new data requirements
Requirements
- 5+ years of experience in Data Engineering, including 2+ years building and operating scalable, low-latency data platforms handling > 100M events/day
- Strong hands-on experience running data infrastructure on Kubernetes, with cloud-native tooling like Docker and Helm
- Production experience with IaC: Terraform, Ansible, and ArgoCD (or equivalents)
- Deep knowledge of distributed systems (storage, transactions, and query processing) with hands-on experience operating open-source query engines like Trino or Presto
- Strong experience with object storage and open table formats, specifically Apache Iceberg
- Experience with streaming and CDC systems: Kafka, Redpanda, and Debezium
- Hands-on experience with orchestration frameworks (Airflow) and ELT tools (Airbyte)
- Strong working knowledge of Python and SQL for building pipelines and platform tooling
- Experience with Google Cloud Platform and its data services (GCS, Cloud Build, Cloud SQL, Dataproc, etc); or related experience with other cloud services
- Ability to thrive in a fast-paced startup environment and adapt infrastructure to rapidly changing needs
Benefits
- Competitive Salary & Stock Options
- Health Benefits
- New Hire Home-Office Setup: One-time USD $500
- Monthly Stipend: USD $150 per month via a Brex Card
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Platform Engineer building scalable data platforms for Mistplay, a mobile gaming loyalty app. Owning ingestion, lakehouse, pipelines, observability, and low - latency data access.
Azure data platform administrator operating Desjardins’ cloud data platform. Supporting DevOps teams through infrastructure automation, security, deployments and production operations.
Data Engineering Analyst optimizing Servus Credit Union’s data warehouse, pipelines, integrations, and analytics infrastructure. Supporting data - driven financial services for Alberta members.
Endpoint Engineer building Ent’s endpoint data - protection layer for enterprise workspace security. Classifying sensitive data, controlling exfiltration channels, and integrating on - device intent intelligence.
Azure Data Platform Administrator supporting Desjardins’ hybrid DevOps infrastructure. Automating tasks, stabilizing environments, and advising on IT solutions and change management.
Senior Data Engineer building secure, scalable data platforms for Assent’s product compliance intelligence network. Driving architecture, hands - on implementation, governance, and technical mentorship.
Staff Data Engineer building scalable data platforms for Penn Entertainment’s gaming, sports betting, and media products. Leading architecture, data quality, analytics engineering, and technical mentorship.
Senior Data Engineer designing scalable Databricks lakehouse architectures for Bits In Glass, an AI and automation consulting firm. Leading pipelines, governance, cloud modernization, and client data solutions.
Senior Data Engineer designing scalable Databricks Lakehouse architectures for Bits In Glass, an AI and automation consulting firm. Building governed pipelines, streaming solutions, and cloud data platforms for client modernization.