Senior Data Engineer developing and optimizing data pipelines on Databricks for healthtech company. Collaborating with stakeholders and ensuring data integrity through efficient processing.
Responsibilities
Develop, manage, and optimize data pipelines on the Databricks platform.
Debug and troubleshoot Spark applications to ensure reliability and performance.
Implement best practices for Spark compute and optimize workloads.
Write clean, efficient, and reusable Python code using object-oriented programming principles.
Design and build APIs to support data integration and application needs.
Develop scripts and tools to automate data processing and workflows.
Integrate, query, and manage data within MongoDB.
Ensure efficient storage and retrieval processes tailored to application requirements.
Optimize MongoDB performance for large-scale data handling.
Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
Proactively identify and address technical challenges related to data processing and system design.
Requirements
Proven experience working with Databricks and Spark compute.
Proficient in Python, including object-oriented programming and API development.
Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
Strong problem-solving skills and ability to debug and optimize data processing tasks.
Experience with large-scale data processing and distributed systems.
IT Integration/Middleware Developer responsible for architectural decisions and integration platforms, enhancing communication between Equisoft products. Working collaboratively in a hybrid environment in Canada.
Contract Python Developer role requiring 5+ years of experience with Python, SQL/MySQL, API development, AWS, Docker, and RabbitMQ. Must have cloud and microservices experience.
Ruby on Rails Engineer developing production applications for a venture - backed startup simplifying real estate law. Designing complex features and contributing to the development of client - facing products.
Developer working within a machine learning team to create AI solutions for various clients. Engagement in python development and prompt engineering are key aspects of this role.
Senior Software Engineer at 3Pillar collaborating on transformative projects using Angular and .NET Core. Leading teams to architect innovative solutions for enterprise applications.
Back - End Developer at Datmos designing and maintaining scalable eCommerce solutions powered by Adobe Commerce. Collaborating within Agile teams for high - quality digital commerce experiences.
Software Engineer, Backend Co - op responsible for evolving serverless infrastructure at Bree's finance platform. Utilizing AI tools while ensuring clean, maintainable systems for user credit services.
Java Developer with React skills for an IT solutions company. Responsible for full - stack application development and collaboration in an agile environment.