Lead Data Engineer designing streaming architectures and data warehouses at Two Circles. Collaborate with clients and integrate streaming data from GCP into AWS environments.
Responsibilities
Own the architectural direction for streaming data ingestion from GCP into AWS
Design resilient ingestion frameworks including error handling, retry strategies, monitoring, and failure isolation
Implement distributed processing pipelines using Spark / PySpark or similar frameworks
Create and maintain scalable data warehouses and associated ETL/ELT processes using DBT models in Amazon Redshift
Design and implement DBT projects including macros, tests, documentation, and reusable modeling patterns
Conduct Redshift query and DBT performance tuning to optimize warehouse efficiency and cost
Define and enforce best practices for:
Data modeling
Version control (Git-based workflows)
CI/CD pipelines for DBT deployments
Automated testing at model, transformation, and pipeline levels
Ensure robust testing is embedded into every DBT model (schema tests, custom tests, data validation checks)
Lead code reviews and architectural design reviews
Work with AWS services including Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, and EMR
Requirements
6+ years of data engineering experience in big data environments
Proven experience designing and implementing streaming architectures
Water resource engineer - in - training supporting flood, river, stormwater, and watercourse projects at Onterris. Assisting modelling, design, field investigations, and regulatory work.
Senior Process Engineer delivering mineral - processing design and improvements for Sedgman’s global resources business. Supporting mining projects from feasibility through detailed engineering in Montreal’s hybrid office.
Lead threat intelligence for Clio’s legal AI platform, tracking adversaries, fraud, and abuse. Building intelligence capabilities that protect law firms and Clio Payments.
Quantum Engineer improving T - centre qubit quality and scalability at Photonic, a quantum computing company. Collaborating across nanofabrication, hardware, software, and modelling teams.
Co - op ASIC Digital Verification Engineer contributing to verification of SiTime’s mixed - signal PLL integrated circuits. Learning testbench and test - case development within the ASIC verification team.
Co - op engineer validating SiTime’s MEMS timing ASIC devices through PCB debugging, lab characterization, and Python test automation. Supporting pre - silicon drivers and production - readiness verification.
Traffic signal and roadway lighting engineer designing transportation infrastructure for Arcadis. Preparing compliant drawings, specifications, photometrics, reports and field deliverables.
Staff Forward Deployed Engineer building AI - powered client integrations for OpenLoop’s telehealth infrastructure. Creating reusable SDKs, agents, API tooling, and deployment practices across U.S. virtual care.
Principal Geotechnical Engineer leading geotechnical infrastructure projects for AtkinsRéalis, an engineering and nuclear services organization. Mentoring teams and expanding transportation, tunnel, rail, and municipal geotechnics capability.