Engineer building scalable data platforms for commercial trucking API company. Designing and optimizing the data platform to tackle complex backend challenges.
Responsibilities
Own projects aimed at enhancing data storage, replication, enrichment, and reporting capabilities.
Build and optimize efficient streaming and batch data pipelines that support our core product and API.
Design scalable storage solutions for handling petabytes of IoT and time-series data.
Develop and maintain real-time data systems to ingest growing data volumes.
Implement distributed tracing, data lineage and observability patterns to improve monitoring and troubleshooting.
Manage infrastructure that powers the current and future services, ensuring scalability, reliability, and zero downtime for HA services.
Write clean, maintainable code in Java and Python for various platform components.
Shape architectural decisions to ensure scalability and reliability throughout the data platform.
Requirements
6+ years of experience in platform engineering or data engineering.
4+ years of experience designing and optimizing data pipelines at TB to PB scale.
Proficient in Java, with a focus on clean, maintainable code.
Strong system design skills with a focus on big data and real-time workflows.
Experience with lake-house architectures (e.g., Iceberg, Delta, Paimon).
Experience with real-time data processing tools like Kafka, Flink and Spark.
Knowledge of distributed systems and large-scale data challenges.
Strong problem-solving skills and a collaborative mindset.
Benefits
Strong compensation and equity packages
Brand new MacBook and computer equipment
Top-tier health/dental benefits and a flexible healthcare spending account
Personal spending account for professional development, fitness and wellness
Four weeks paid time off + statutory holidays
In-person culture with an office located in downtown Toronto
Senior Software Engineer on Data Platform developing and maintaining infrastructure for data ingestion and processing. Collaborating on projects that drive AI and analytics initiatives at Samsara.
Senior Data Engineer at Sumsub, developing scalable data integration solutions and maintaining data quality. Collaborating with teams to optimize data processes in a remote - first environment.
Operations Data Engineer at Dotmatics focused on managing cloud architecture and optimizing costs. Collaborating with engineering and leadership to enhance operational health effectively.
Associate Data Engineer joining Confluence to build data pipelines and collaborate in a modern data environment. Solve real data challenges and contribute to meaningful projects supporting business decisions.
Associate Data Engineer building reliable data pipelines and contributing to data solutions at Confluence. Collaborating closely with experienced engineers and analysts in a modern data environment.
Senior Data Engineer designing and delivering scalable data solutions at Confluence. Collaborating cross - functionally and mentoring engineers while managing key components of the data platform.
Senior Data Engineer at Confluence responsible for designing and delivering scalable data solutions. Collaborating with teams and mentoring engineers in modern data engineering practices.
Data Migration Engineer with Salesforce needed for hybrid contract in Mississauga, ON. Must have GCP Dataproc, Spark, Python, BigQuery, and Salesforce API experience.
Data Engineer enhancing data analytics and reporting capabilities for Silk & Snow. Bridging raw data with actionable insights while contributing to data infrastructure efficiency.
Lead Data Engineer responsible for data architecture, driving data quality, and mentoring the engineering team. Join a high - growth crypto gaming platform with a focus on scalable data solutions.