Senior/Staff Software Engineer building data pipelines for Waabi's autonomous driving platform. Collaborating with scientists and engineers to solve complex data challenges in autonomous technology.
Responsibilities
Design and implement data pipelines using real-world driving data and Waabi World (our high-fidelity simulator) to train and evaluate deep learning models.
Optimize data formats, caching, and dataloading to drive highly efficient ML training and evaluation at scale.
Improve data sampling and composition for deep data introspection to track model performance and uncover critical edge-case scenarios.
Champion engineering excellence by writing high-quality, well-structured, and rigorously tested code.
Help drive project roadmap planning, prioritization, and delivery.
Requirements
BS or MS in Computer Science, Machine Learning, or a related technical field, with 4+ years of industry experience.
Proficiency in Python and strong software engineering fundamentals, including experience with deep learning frameworks such as PyTorch, TensorFlow, or JAX.
Hands-on experience building distributed ETL and data processing pipelines.
Direct experience managing ML pipelines, including dataset management, dataloading, and optimization.
Strong understanding of cloud job orchestration, monitoring, and instrumentation best practices.
A collaborative, open-minded approach with a passion for tackling hard problems in autonomous technology and a strong willingness to mentor others.
Experience with optimizing large scale distributed training pipelines and/or highly optimized ML inference pipelines.
Experience with MapReduce (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow, Apache Beam, Google Cloud Dataflow, AWS Step Functions).
Experience solving data challenges specific to autonomous driving.
Familiarity with linear algebra (projections, transforms) and 3D geometry.
Experience working with multimodal sensor data (e.g., LiDAR, RADAR, camera).
Benefits
Competitive compensation and equity awards.
Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
Unlimited Vacation.
Flexible hours and Work from Home support.
Daily drinks, snacks and catered meals (when in office).
Regularly scheduled team building activities and social events both on-site, off-site & virtually.
Aarorn Technologies seeks a Datastage ETL contractor with 5+ years of experience for a hybrid role in Toronto. Must have IBM InfoSphere DataStage, SQL, Unix scripting, and scheduling skills.
Azure Databricks Developer needed for HR tech projects at a top financial client. Design ETL solutions, support data integrations, and modernize HR data platforms.
Senior Software Engineer, Data responsible for building data pipelines and maintaining infrastructure for analytics and ML. Collaborate with teams to optimize data systems at Narvar.
Data Architect leading conversations and decisions on data modeling at a global consulting firm specializing in Data & Analytics. Transforming complex processes into clear, reusable information models.
Senior Data Engineer at Supabase managing data pipelines from source to analysis. Collaborating with growth, finance, and product teams to drive business insights.
Associate Data Architect collaborating with stakeholders to design scalable data architecture for AXIS Capital. Maximizing profit through data - driven decision making and implementing effective data governance strategies.
Data Engineer II at Finning supporting production data platforms and integrations using Snowflake, Databricks, Azure services. Collaborating with teams to ensure operational stability and reliability.