Lead Data Engineer designing streaming architectures and data warehouses at Two Circles. Collaborate with clients and integrate streaming data from GCP into AWS environments.
Responsibilities
Own the architectural direction for streaming data ingestion from GCP into AWS
Design resilient ingestion frameworks including error handling, retry strategies, monitoring, and failure isolation
Implement distributed processing pipelines using Spark / PySpark or similar frameworks
Create and maintain scalable data warehouses and associated ETL/ELT processes using DBT models in Amazon Redshift
Design and implement DBT projects including macros, tests, documentation, and reusable modeling patterns
Conduct Redshift query and DBT performance tuning to optimize warehouse efficiency and cost
Define and enforce best practices for:
Data modeling
Version control (Git-based workflows)
CI/CD pipelines for DBT deployments
Automated testing at model, transformation, and pipeline levels
Ensure robust testing is embedded into every DBT model (schema tests, custom tests, data validation checks)
Lead code reviews and architectural design reviews
Work with AWS services including Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, and EMR
Requirements
6+ years of data engineering experience in big data environments
Proven experience designing and implementing streaming architectures
Intermediate Municipal Engineer managing civil engineering projects at GEMTEC. Collaborating with teams and ensuring project delivery within budget and scope.
Control Plane Engineer at Supabase designing and maintaining APIs for backend solutions. Collaborating with teams for smooth integration and enhancing public API experience.
Transportation Engineer at Arcadis supporting planning, design, and delivery of highway and utility infrastructure projects. Collaborating with a multidisciplinary team for impactful project outcomes.
Senior Java Engineer / Technical Lead needed for hybrid role in Toronto. Build high - performance distributed systems with Java 17+, Spring Boot, and cloud technologies.
Business Value Engineer quantifying CoLab's value and converting customer insights into business cases. Working closely with account teams to present financial arguments and drive enterprise decisions.
Intermediate Engineer in building electricity within Energy sector at EXP. Collaborate on multidisciplinary projects in energy production and distribution.