Sr. Data Engineer at Luxury Presence building AI growth platform for real estate. Shaping platform architecture and driving AI-powered product delivery for innovative solutions.
Responsibilities
Build and scale high-throughput streaming pipelines. Design, implement, and operate pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg—ensuring reliability, performance, and data correctness.
Model and deliver high-quality, production-grade real estate datasets. Develop and maintain datasets that power core product experiences, with a focus on data modeling, transformation logic, and balancing freshness, accuracy, and cost.
Strengthen data quality and observability. Implement and improve data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact.
Leverage AI to improve data operations. Contribute to AI-driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention.
Requirements
6+ years of professional data engineering or software engineering experience
Strong experience with distributed data processing and streaming systems (Spark / PySpark, Kafka)
Proficiency in Python (Pydantic preferred) and familiarity with Node/TypeScript is a plus
Experience building and maintaining data pipelines on AWS using tools like Airflow, Spark Streaming, and Iceberg
Solid understanding of data modeling and working with large-scale datasets
Familiarity with event-driven systems and ingestion patterns (Kafka, SQS)
Experience implementing data quality checks, monitoring, and debugging data issues
Interest in applying AI/ML or automation to improve data workflows is a plus
Proven track record leading high-impact initiatives from concept through production in a SaaS environment
Expert-level grasp of software design principles and experience with multi-tenant platform architectures
Benefits
Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.
Data Engineer building scalable Databricks ingestion pipelines for Irth Solutions’ infrastructure - protection SaaS. Supporting stakeholder - engagement analytics, LLM/NLP pipelines, and downstream data models.
Senior Databricks Architect needed for contract role in Winnipeg, MB. Must have Azure Databricks, PySpark, and Azure DevOps expertise; onsite mandatory.
Data Engineering Developer building scalable Azure data pipelines for an agile tech development firm. Advising clients, implementing governance, and improving cloud data engineering standards.
Ingénieur(e) données concevant des pipelines et architectures analytiques Azure. Collaboration client et amélioration des standards de gouvernance, qualité et performance des données.
Junior Data Engineer building reliable ETL pipelines and data solutions for PLATO, Canada’s Indigenous - owned technology services company. Improving data quality, accessibility, governance, and pipeline performance.
Senior Data Engineer building scalable, AI - powered data infrastructure for CloudBlue, HostPapa’s cloud commerce platform. Developing real - time pipelines, APIs, and production analytics systems.
Senior Fabric Data Engineer modernizing enterprise data for Canadian IT consulting clients. Building Microsoft Fabric pipelines, curated datasets, security controls, and analytics - ready models.
Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company. Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.