Senior Data Engineer designing and implementing scalable data lakehouse infrastructure at TRM Labs. Collaborating across teams to optimize data workflows and ETL processes.
Responsibilities
Architect and scale a high-performance data lakehouse on GCP, leveraging technologies like StarRocks, Apache Iceberg, GCS, BigQuery, Dataproc, and Kafka.
Design, build, and optimize distributed query engines such as Trino, Spark, or Snowflake to support complex analytical workloads.
Implement metadata management in open table formats like Iceberg and data discovery frameworks for governance and observability using Iceberg compatible catalogs.
Develop and orchestrate robust ETL/ELT pipelines using Apache Airflow, Spark, and GCP-native tools (e.g., Dataflow, Composer).
Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement
Requirements
5+ years of experience in data or software engineering, with a focus on distributed data systems and cloud-native architectures.
Proven experience building and scaling data platforms on GCP, including storage, compute, orchestration, and monitoring.
Strong command of one or more query engines such as Trino, Presto, Spark, or Snowflake.
Experience with modern table formats like Apache Hudi, Iceberg, or Delta Lake.
Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
Hands-on experience orchestrating workflows with Airflow and building streaming/batch pipelines using GCP-native services.
Senior infrastructure developer owning AWS environments, internal applications, and enterprise integrations. Supporting Benevity’s technology platform that enables companies and employees to take social action.
Senior developer owning AWS infrastructure, security, and integrations for Benevity’s technology platform. Supporting internal applications that help companies and employees take social action.
Infrastructure Engineer building secure, automated Azure environments for PLATO, Canada’s largest Indigenous - owned software testing and technology services company. Applying Terraform, IaC, and DevOps practices across cloud infrastructure.
Infrastructure support engineer handling incidents, troubleshooting, monitoring, and service requests for Genpact’s enterprise technology services. Supporting hybrid operations on rotational night shifts in Montreal.
Senior Infrastructure Engineer rebuilding Stream’s real - time platform as it migrates from AWS to GCP. Owning Kubernetes, PostgreSQL scaling, cloud efficiency, and reliability.
Senior Infrastructure Engineer designing and delivering customer infrastructure solutions for Redesign Group, a technology and cybersecurity provider. Leading implementations, documentation, technical reviews, and engineer mentorship in Toronto.
Security and Infrastructure Engineer securing Nexxa’s AI systems for heavy industries. Owning cloud infrastructure, security operations, and SOC 2/ISO 27001 compliance.
Senior infrastructure engineer building scalable AWS platforms for Kindred’s members - only home - swapping service. Leading DevOps, automation, architecture, and developer productivity initiatives.