Databricks Platform Engineer responsible for owning and optimizing the Databricks platform. Collaborating with various teams to support workflows and ensuring performance and security.
Responsibilities
Administer, configure, and maintain Azure Databricks workspaces, including user management, cluster setup, resource allocation, provisioning cloud services, and backup and recovery strategy
Own and evolve platform automation, including Infrastructure as Code (Terraform) and Azure DevOps CI/CD pipelines for Databricks and dependent cloud resources
Monitor system performance and troubleshoot issues related to Databricks clusters, jobs, and data pipelines
Implement best practices for security, compliance, and cost management within Azure Databricks environments
Collaborate with data engineers, data scientists, and other stakeholders to support their workflows and optimize platform usage
Partner with cloud networking and security teams to design and operate secure connectivity patterns
Integrate Databricks with various SaaS products and services
Administer and maintain Power BI workspaces, datasets, and reports
Automate routine administrative tasks using scripting (Python and/or Bash) and Databricks REST APIs
Manage data access controls, auditing, and monitoring to maintain data integrity and privacy
Stay current with new features, updates, and best practices in Databricks, Azure, and relevant SaaS platforms
Document procedures, configurations, and troubleshooting steps for internal knowledge sharing.
Requirements
Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience)
Senior Platform Engineer building scalable backend and cloud infrastructure for ExaCare’s AI - powered post - acute care platform. Improving reliability, developer velocity, and healthcare admission workflows.
Principal Platform Engineer leading SkyWatch’s satellite - data platform and AI agent infrastructure. Owning architecture, customer - driven roadmap delivery, and platform engineering leadership.
Platform Engineer securing Just Eat Takeaway.com’s global food - delivery edge infrastructure. Building gateways, automation, and resilient traffic routing across production environments.
Director leading Blackpoint Cyber’s cloud - based Unified Security Posture data platform for cybersecurity solutions. Driving platform roadmap, reliability, APIs, data engineering, and team growth.
Ingénieur logiciel principal intégrant des plateformes, API et solutions IA chez EDC. Gouvernance technique, sécurité, résilience et mentorat dans une société canadienne de financement du commerce.
Senior AI Platform Developer building scalable AI services and LLM workflows for MaintainX’s industrial work execution platform. Improving reliability, observability, performance, and cost efficiency.
Infrastructure team lead building and operating Spare’s GCP and Kubernetes platform for on - demand transit. Leading developers while improving reliability, security, AI SRE, and cloud cost efficiency.
AI Platform Developer building Azure - based agent infrastructure for Petal, a Canadian healthcare orchestration and billing company. Creating secure, observable, governed AI services for product teams.
Senior AI Platform Developer building reusable, secure AI - agent infrastructure for Petal, a Canadian healthcare orchestration and billing company. Driving Azure - based platform capabilities across orchestration, evaluation, observability, and governance.