Databricks Platform Engineer responsible for owning and optimizing the Databricks platform. Collaborating with various teams to support workflows and ensuring performance and security.
Responsibilities
Administer, configure, and maintain Azure Databricks workspaces, including user management, cluster setup, resource allocation, provisioning cloud services, and backup and recovery strategy
Own and evolve platform automation, including Infrastructure as Code (Terraform) and Azure DevOps CI/CD pipelines for Databricks and dependent cloud resources
Monitor system performance and troubleshoot issues related to Databricks clusters, jobs, and data pipelines
Implement best practices for security, compliance, and cost management within Azure Databricks environments
Collaborate with data engineers, data scientists, and other stakeholders to support their workflows and optimize platform usage
Partner with cloud networking and security teams to design and operate secure connectivity patterns
Integrate Databricks with various SaaS products and services
Administer and maintain Power BI workspaces, datasets, and reports
Automate routine administrative tasks using scripting (Python and/or Bash) and Databricks REST APIs
Manage data access controls, auditing, and monitoring to maintain data integrity and privacy
Stay current with new features, updates, and best practices in Databricks, Azure, and relevant SaaS platforms
Document procedures, configurations, and troubleshooting steps for internal knowledge sharing.
Requirements
Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience)
Staff Platform Engineer defining cloud and DevSecOps strategy for Robots & Pencils’ enterprise AI systems. Leading Kubernetes, AI/ML infrastructure, migrations, reliability, security, and platform standards remotely in Canada.
Principal platform developer designing AWS - native integrations, CI/CD pipelines, and developer tooling for Autodesk’s design software. Leading architecture, reliability, and cross - team engineering initiatives.
Senior MLOps Developer operationalizing machine learning models and scalable AI/ML infrastructure for Autodesk’s design and entertainment software. Building deployment, monitoring, governance, and recovery systems.
Senior SRE/Platform Engineer needed for global company. 6+ years SRE experience, AWS/Azure, Kubernetes, Terraform, observability tools. Contract - to - hire in Mississauga.
Senior Full Stack Engineer building GraphQL, React, and TypeScript platforms for PENN Entertainment’s online gaming and sports media products. Improving shared client tooling, server - driven UI, performance, observability, and release workflows.
Senior platform engineering lead shaping compute and virtualization strategy for BMO, a major bank. Driving modernization, architecture standards, automation and hybrid - cloud infrastructure transformation.
Staff Platform Software Engineer building reusable infrastructure for Cantina Labs’ social AI platform. Improving search, AWS operations, Go services, observability, and developer productivity.