Senior Software Engineer building scalable Python and AWS infrastructure for d1g1t’s institutional wealth management platform. Driving implementation, deployment, troubleshooting, and large - dataset performance.
About the role
- Senior Data Engineer designing and implementing scalable data lakehouse infrastructure at TRM Labs. Collaborating across teams to optimize data workflows and ETL processes.
Responsibilities
- Architect and scale a high-performance data lakehouse on GCP, leveraging technologies like StarRocks, Apache Iceberg, GCS, BigQuery, Dataproc, and Kafka.
- Design, build, and optimize distributed query engines such as Trino, Spark, or Snowflake to support complex analytical workloads.
- Implement metadata management in open table formats like Iceberg and data discovery frameworks for governance and observability using Iceberg compatible catalogs.
- Develop and orchestrate robust ETL/ELT pipelines using Apache Airflow, Spark, and GCP-native tools (e.g., Dataflow, Composer).
- Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement
Requirements
- 5+ years of experience in data or software engineering, with a focus on distributed data systems and cloud-native architectures.
- Proven experience building and scaling data platforms on GCP, including storage, compute, orchestration, and monitoring.
- Strong command of one or more query engines such as Trino, Presto, Spark, or Snowflake.
- Experience with modern table formats like Apache Hudi, Iceberg, or Delta Lake.
- Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
- Hands-on experience orchestrating workflows with Airflow and building streaming/batch pipelines using GCP-native services.
Benefits
- participate in TRM’s equity plan
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Infrastructure Engineer owning managed PostgreSQL for Laravel Cloud, Laravel’s developer - focused infrastructure platform. Building Kubernetes automation, AWS infrastructure, and database reliability from the ground up.
Senior Platform Engineer building resilient Go and Kubernetes platforms for Virtasant’s cloud - native products. Owning reliability, infrastructure as code, observability, and developer delivery tools.
Sr. Engineer position focusing on vulnerability remediation and cyber security for Genpact in Canada. Collaborating with teams and leading the cyber security team to meet business objectives.
Director of Infrastructure Engineering at Outschool leading infrastructure and platform team towards innovation and stability. Fostering a culture of technical excellence and ownership in a remote setup across U.S. and Canada.
LP
Sr. Consultant, Infrastructure Risk Management
LinkedIn Recruiter Post
Hiring Sr. Consultant, Infrastructure Risk Management in Toronto, ON. Full - time permanent role requiring 8+ years in IT Risk, Audit & GRC.
IT Engineer responsible for IT infrastructure design and support in automotive software. Collaborating with teams to ensure efficient technology operations.
Senior Infrastructure Engineer leading infrastructure operations and stability for Buffer's social media tools. Focusing on modernization and developer tooling within a fully remote team.
LP
Infrastructure Engineer – Dynatrace
LinkedIn Recruiter Post
Contract IaC Engineer role in Calgary, AB requiring Azure Bicep, Terraform, and Dynatrace/Splunk skills.