LP
Senior Databricks Architect
LinkedIn Recruiter Post
Senior Databricks Architect needed for contract role in Winnipeg, MB. Must have Azure Databricks, PySpark, and Azure DevOps expertise; onsite mandatory.
About the role
- Senior/Staff Software Engineer building data pipelines for Waabi's autonomous driving platform. Collaborating with scientists and engineers to solve complex data challenges in autonomous technology.
Responsibilities
- Design and implement data pipelines using real-world driving data and Waabi World (our high-fidelity simulator) to train and evaluate deep learning models.
- Optimize data formats, caching, and dataloading to drive highly efficient ML training and evaluation at scale.
- Improve data sampling and composition for deep data introspection to track model performance and uncover critical edge-case scenarios.
- Champion engineering excellence by writing high-quality, well-structured, and rigorously tested code.
- Help drive project roadmap planning, prioritization, and delivery.
Requirements
- BS or MS in Computer Science, Machine Learning, or a related technical field, with 4+ years of industry experience.
- Proficiency in Python and strong software engineering fundamentals, including experience with deep learning frameworks such as PyTorch, TensorFlow, or JAX.
- Hands-on experience building distributed ETL and data processing pipelines.
- Direct experience managing ML pipelines, including dataset management, dataloading, and optimization.
- Strong understanding of cloud job orchestration, monitoring, and instrumentation best practices.
- A collaborative, open-minded approach with a passion for tackling hard problems in autonomous technology and a strong willingness to mentor others.
- Experience with optimizing large scale distributed training pipelines and/or highly optimized ML inference pipelines.
- Experience with MapReduce (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow, Apache Beam, Google Cloud Dataflow, AWS Step Functions).
- Experience solving data challenges specific to autonomous driving.
- Familiarity with linear algebra (projections, transforms) and 3D geometry.
- Experience working with multimodal sensor data (e.g., LiDAR, RADAR, camera).
Benefits
- Competitive compensation and equity awards.
- Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
- Unlimited Vacation.
- Flexible hours and Work from Home support.
- Daily drinks, snacks and catered meals (when in office).
- Regularly scheduled team building activities and social events both on-site, off-site & virtually.
- As we grow, this list continues to evolve!
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
Technology Lead – Data Services
LinkedIn Recruiter Post
Lead SAP Data Services (BODS) architecture and ETL delivery in Toronto. Optimize data jobs and mentor developers.
Data Engineering Developer building scalable Azure data pipelines for an agile tech development firm. Advising clients, implementing governance, and improving cloud data engineering standards.
Ingénieur(e) données concevant des pipelines et architectures analytiques Azure. Collaboration client et amélioration des standards de gouvernance, qualité et performance des données.
Junior Data Engineer building reliable ETL pipelines and data solutions for PLATO, Canada’s Indigenous - owned technology services company. Improving data quality, accessibility, governance, and pipeline performance.
Senior Data Engineer building scalable, AI - powered data infrastructure for CloudBlue, HostPapa’s cloud commerce platform. Developing real - time pipelines, APIs, and production analytics systems.
Senior Fabric Data Engineer modernizing enterprise data for Canadian IT consulting clients. Building Microsoft Fabric pipelines, curated datasets, security controls, and analytics - ready models.
Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company. Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.
Senior Fabric Data Engineer modernizing learning - platform data for Cornerstone Galaxy. Building Microsoft Fabric pipelines, curated datasets, governance, and analytics - ready integrations.
GCP Data Platform Engineer maintaining and optimizing production data platforms for Innodata, a global data engineering and AI services company. Supporting Airflow pipelines, GCP infrastructure, reliability, and troubleshooting.