Engineer building scalable data platforms for commercial trucking API company. Designing and optimizing the data platform to tackle complex backend challenges.
About the role
- Sr. Data Engineer at Luxury Presence building AI growth platform for real estate. Shaping platform architecture and driving AI-powered product delivery for innovative solutions.
Responsibilities
- Build and scale high-throughput streaming pipelines. Design, implement, and operate pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg—ensuring reliability, performance, and data correctness.
- Model and deliver high-quality, production-grade real estate datasets. Develop and maintain datasets that power core product experiences, with a focus on data modeling, transformation logic, and balancing freshness, accuracy, and cost.
- Strengthen data quality and observability. Implement and improve data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact.
- Leverage AI to improve data operations. Contribute to AI-driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention.
Requirements
- 6+ years of professional data engineering or software engineering experience
- Strong experience with distributed data processing and streaming systems (Spark / PySpark, Kafka)
- Proficiency in Python (Pydantic preferred) and familiarity with Node/TypeScript is a plus
- Experience building and maintaining data pipelines on AWS using tools like Airflow, Spark Streaming, and Iceberg
- Solid understanding of data modeling and working with large-scale datasets
- Familiarity with event-driven systems and ingestion patterns (Kafka, SQS)
- Experience implementing data quality checks, monitoring, and debugging data issues
- Interest in applying AI/ML or automation to improve data workflows is a plus
- Proven track record leading high-impact initiatives from concept through production in a SaaS environment
- Expert-level grasp of software design principles and experience with multi-tenant platform architectures
Benefits
- Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Engineer building scalable data platforms for a telematics startup tackling complex backend challenges. Designing and optimizing data platforms for API, managing large - scale data processing.
Principal Data Engineer at RAVL designing secure and scalable data and AI platforms. Leading architectural guidance and building capabilities across the organization to enhance data operations.
Data Engineer at RAVL designing, building, and operating data pipelines for decision - making. Transforming raw data into reliable assets for analytics and machine learning.
LP
Snowflake Data Engineers
LinkedIn Recruiter Post
Snowflake Data Engineer contract for 6 months, hybrid in Vancouver. Open to intermediate/senior candidates with 4 - 8 years experience.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
MLOps Data Engineer bridging data science and production systems at Triton Digital. Designing CI/CD pipelines and optimizing data processing with Apache Spark for advertising systems.
Senior Data Engineer optimizing data pipelines for AI - driven insights at Homebase. Involves collaboration with product and analytics teams to drive data architecture transformation.
Lead Data Engineer / Snowflake Engineer at Brillio in Montreal focusing on Snowflake and Generative AI data solutions. Responsibilities include architecting data platforms and collaborating with AI teams.
Data Engineer at The Fedcap Group architecting and leading enterprise data warehouse solutions. Focused on enabling scalable growth and operational excellence across the organization.