Senior Data Engineer building Databricks, Spark, Python, and MongoDB data systems. Supporting Flagler Health’s clinical operating system for modern musculoskeletal care.
Responsibilities
Develop, manage, and optimize data pipelines on the Databricks platform
Debug and troubleshoot Spark applications to ensure reliability and performance
Implement best practices for Spark compute and optimize workloads
Write clean, efficient, and reusable Python code using object-oriented programming principles
Design and build APIs to support data integration and application needs
Develop scripts and tools to automate data processing and workflows
Integrate, query, and manage data within MongoDB
Ensure efficient MongoDB storage and retrieval tailored to application requirements
Optimize MongoDB performance for large-scale data handling
Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions
Proactively identify and address technical challenges related to data processing and system design
Requirements
Proven experience working with Databricks and Spark compute
Proficient in Python, including object-oriented programming and API development
Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization
Strong problem-solving skills and ability to debug and optimize data processing tasks
Experience with large-scale data processing and distributed systems
Strong understanding of data architecture, ETL processes, and data warehousing concepts
Knowledge of other big data technologies like Delta Lake, Hadoop, or Kafka
Experience with cloud platforms (e.g., AWS, Azure, or GCP)
Familiarity with CI/CD pipelines and version control systems like Git
Drupal Developer building, testing, and supporting applications for Alithya’s digital consulting network. Analyzing incidents, documenting solutions, and supporting user training.
Staff Backend Engineer building Go - based PostgreSQL automation for GitLab’s DevSecOps orchestration platform. Operating scalable database - as - a - service capabilities across remote teams.
Backend engineer building scalable partner and merchant APIs for Affirm's buy - now - pay - later platform. Developing distributed systems with Python or Kotlin, AWS, MySQL, and Kubernetes.
Back - end Software Engineer building Ruby on Rails products and features for Kin Insurance. Delivering software with Ruby, TypeScript, PostgreSQL, Agile development, and collaborative engineering teams.
Senior C#/.NET developer building scalable Azure enterprise applications for a global technology consulting network. Supporting cloud transformation, workflow automation, and high - volume transaction systems.
Développeur backend Java/Spring chez Maplr, startup canadienne reliant talents internationaux aux projets technologiques du Canada. Conception d’architectures microservices et développement agile avec accompagnement à la relocalisation.
Associate Technical Architect designing scalable AWS platforms and integrations for Quantiphi, an AI - first digital engineering company. Leading secure cloud architecture, pipelines, APIs, and DevSecOps.
Senior Backend Engineer scaling APIs and consumer - facing systems at Tilt. Building machine - learning - powered credit products that expand access to fair financial services.
Student software engineer developing and testing APIs for Sun Life’s Group Benefits and Retirement Services technology. Supporting Agile Scrum delivery, documentation, and modern cloud development tools.