Lead Data Engineer designing streaming architectures and data warehouses at Two Circles. Collaborate with clients and integrate streaming data from GCP into AWS environments.
Responsibilities
Own the architectural direction for streaming data ingestion from GCP into AWS
Design resilient ingestion frameworks including error handling, retry strategies, monitoring, and failure isolation
Implement distributed processing pipelines using Spark / PySpark or similar frameworks
Create and maintain scalable data warehouses and associated ETL/ELT processes using DBT models in Amazon Redshift
Design and implement DBT projects including macros, tests, documentation, and reusable modeling patterns
Conduct Redshift query and DBT performance tuning to optimize warehouse efficiency and cost
Define and enforce best practices for:
Data modeling
Version control (Git-based workflows)
CI/CD pipelines for DBT deployments
Automated testing at model, transformation, and pipeline levels
Ensure robust testing is embedded into every DBT model (schema tests, custom tests, data validation checks)
Lead code reviews and architectural design reviews
Work with AWS services including Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, and EMR
Requirements
6+ years of data engineering experience in big data environments
Proven experience designing and implementing streaming architectures
Junior Engineer supporting mining project studies and site planning at Norda Stelo. Contributing to environmental safety and technical design under senior engineers' guidance.
Project Engineer providing engineering consultancy and project oversight in the electric utility sector. Leading project teams and ensuring compliant designs with local standards.
Design Verification Engineer with 7 - 13 years experience in SystemVerilog & UVM for verifying display IPs in graphics cards. Onsite role in Markham, ON.
OpenStack Engineer for VEXXHOST designing and supporting large scale IT environments. Collaborating with clients and teams to ensure performance and reliability in OpenStack deployments.
OpenStack Engineer at VEXXHOST, responsible for designing and deploying large - scale cloud environments. Collaborating with clients and internal teams to ensure reliable cloud service delivery.
Forensic Fire Engineer providing in - house consulting services for electrical fire origin and cause investigations. Collaborating with claims professionals to enhance risk evaluation and prevention strategies.
Transportation Design Engineer in Arcadis focused on transportation design, delivering sustainable solutions. Join a collaborative team in Ottawa shaping impactful infrastructure projects.
Documentation Engineer focused on improving documentation site and APIs for Supabase. Engaging with community and contributors for better user experience.
Chief Engineer responsible for maintaining vessel equipment and ensuring crew safety. Collaborates with management to operate in compliance with all regulations and standards.
Senior Environmental Engineer or Scientist managing contaminated sites with a focus on project management and mentoring. Join AtkinsRéalis' expert team in British Columbia's diverse sectors.