Databricks Architect designing and deploying enterprise cloud data platforms for Cuesta Partners’ consulting clients. Leading pipelines, governance, CI/CD, and client-facing technical delivery.
Responsibilities
Design and architect scalable Databricks-based solutions for enterprise clients
Lead end-to-end cloud data platform implementations across AWS and/or Azure
Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines
Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows
Partner directly with client stakeholders, including C-level executives, to understand business needs and translate them into technical solutions
Provide technical leadership and guidance to data engineering teams
Implement CI/CD pipelines and infrastructure-as-code for Databricks resources
Drive collaborative development through Git workflows, pull requests, and code reviews
Collaborate with analytics, engineering, and business teams
Serve as the primary technical point of contact for clients
Requirements
6+ years of experience in Data Engineering, Cloud Architecture, or related roles
3+ years of hands-on experience with Databricks
Strong proficiency in PySpark, Spark SQL, Python, and SQL
Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs
Proven experience delivering Databricks projects in a consulting or professional services environment
Strong understanding of data lake concepts and formats, including Delta, Iceberg, and Parquet
Experience designing and managing Unity Catalog for governance, access control, and lineage
Familiarity with medallion architecture patterns
Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows
CI/CD and infrastructure-as-code experience for Databricks resources, including Terraform, Asset Bundles, and GitHub Actions
MLflow experience in experiment tracking, model registry, deployment, and observability
Cloud platform experience
Experience working in client-facing, consulting, or cross-functional environments
Experience leading technical projects or mentoring engineering teams
Databricks certifications are nice to have
Experience with agentic AI workflows, Agentbricks, LangChain, and Claude agentic workflows is nice to have
Benefits
Constant opportunities for exposure & learning
Flexible working location and enabling personal-life harmony with work
Agency and influence in the company’s total strategy and direction
WordPress Architect designing scalable, accessible websites and applications for organizations through Evolving Web’s high - impact digital solutions. Advising technical teams and owning complex project delivery.
Senior IT architect designing enterprise solutions for Desjardins, a financial services cooperative. Advising stakeholders on complex architecture, infrastructure, security and strategic initiatives.
System Architect defining Brake and Thermal HIL architecture for General Motors vehicle controls. Leading real - time simulation, embedded - controller integration, and cross - functional engineering initiatives.
Principal Architect leading architecture for Granum’s software ecosystem serving landscapers and arborists. Driving .NET modernization, platform strategy, security, CI/CD, and AI - native development.
Lead enterprise architect shaping domain strategy, cloud modernization, and governance for Manulife’s global financial services business. Guiding technology investments and architecture standards across strategic initiatives.
Senior IT architecture advisor designing complex enterprise solutions for Desjardins, a financial services cooperative. Guiding strategic initiatives across data, applications, security and infrastructure.
Conseiller en architecture bureautique pour Solution SFT et un projet public à Québec. Conception d’infrastructures bureautiques et accompagnement de projets en mode hybride.
GCP FHIR Architect designing GCP healthcare data architectures and FHIR interoperability pipelines. Building compliant clinical data workflows across healthcare formats and APIs.
Senior IT architecture advisor designing complex technology solutions for Desjardins, a cooperative financial services group. Guiding architecture, standards, stakeholders, and delivery teams across strategic initiatives.