Databricks Architect designing and deploying enterprise cloud data platforms for Cuesta Partners’ consulting clients. Leading pipelines, governance, CI/CD, and client-facing technical delivery.
Responsibilities
Design and architect scalable Databricks-based solutions for enterprise clients
Lead end-to-end cloud data platform implementations across AWS and/or Azure
Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines
Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows
Partner directly with client stakeholders, including C-level executives, to understand business needs and translate them into technical solutions
Provide technical leadership and guidance to data engineering teams
Implement CI/CD pipelines and infrastructure-as-code for Databricks resources
Drive collaborative development through Git workflows, pull requests, and code reviews
Collaborate with analytics, engineering, and business teams
Serve as the primary technical point of contact for clients
Requirements
6+ years of experience in Data Engineering, Cloud Architecture, or related roles
3+ years of hands-on experience with Databricks
Strong proficiency in PySpark, Spark SQL, Python, and SQL
Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs
Proven experience delivering Databricks projects in a consulting or professional services environment
Strong understanding of data lake concepts and formats, including Delta, Iceberg, and Parquet
Experience designing and managing Unity Catalog for governance, access control, and lineage
Familiarity with medallion architecture patterns
Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows
CI/CD and infrastructure-as-code experience for Databricks resources, including Terraform, Asset Bundles, and GitHub Actions
MLflow experience in experiment tracking, model registry, deployment, and observability
Cloud platform experience
Experience working in client-facing, consulting, or cross-functional environments
Experience leading technical projects or mentoring engineering teams
Databricks certifications are nice to have
Experience with agentic AI workflows, Agentbricks, LangChain, and Claude agentic workflows is nice to have
Benefits
Constant opportunities for exposure & learning
Flexible working location and enabling personal-life harmony with work
Agency and influence in the company’s total strategy and direction
Naval Architecture co - op student supporting Thales Canada’s Royal Canadian Navy ship programs. Conducting technical investigations, documentation, audits, and compliance activities across hybrid sites.
Knowledge Graph Architect modernizing insurance data for an IT consulting firm. Designing semantic models, graph databases, Duck Creek integrations, and GraphRAG - powered AI solutions.
Architectural facilities assessor conducting building - condition inspections and cost estimates for Gordian’s facility data and asset - management services. Remote Canada role with 40 - 50% travel.
Product Architect guiding SaaS, third - party application and enterprise platform modernization at FCC, a Canadian agriculture financier. Shaping secure roadmaps, integrations and technology decisions.
Purview Architect designing Microsoft Purview governance solutions for PLATO, Canada’s Indigenous - owned software testing and technology services company. Managing cataloging, lineage, classification, and data quality across Dynamics and Azure.
Senior Business Architect leading Salesforce CRM implementations for enterprise clients. Managing requirements, solution design, roadmaps, and Business Analyst teams across strategic transformations.
Architecte de solutions chez Fresche Solutions, concevant et modernisant des systèmes Java, IBM i et DB2. Optimisation de performance, architecture technique et escalade senior sur des projets de transformation numérique.
Senior Guidewire Solution Architect supporting technology solutions for insurance sector. Consulting on design, architecture, and best practices in a fully remote setup based in Canada.
D365 Architect responsible for shaping the architecture of business applications within a medical device company. Collaborate with IT and leadership to optimize technology solutions for growth and compliance.
Senior Cybersecurity Architect ensuring compliance with security contract requirements and providing strategic cybersecurity guidance in Canada. Collaborating with internal teams to enhance cybersecurity measures across services.