Senior Data Engineer developing and optimizing data pipelines on Databricks for healthtech company. Collaborating with stakeholders and ensuring data integrity through efficient processing.
Responsibilities
Develop, manage, and optimize data pipelines on the Databricks platform.
Debug and troubleshoot Spark applications to ensure reliability and performance.
Implement best practices for Spark compute and optimize workloads.
Write clean, efficient, and reusable Python code using object-oriented programming principles.
Design and build APIs to support data integration and application needs.
Develop scripts and tools to automate data processing and workflows.
Integrate, query, and manage data within MongoDB.
Ensure efficient storage and retrieval processes tailored to application requirements.
Optimize MongoDB performance for large-scale data handling.
Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
Proactively identify and address technical challenges related to data processing and system design.
Requirements
Proven experience working with Databricks and Spark compute.
Proficient in Python, including object-oriented programming and API development.
Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
Strong problem-solving skills and ability to debug and optimize data processing tasks.
Experience with large-scale data processing and distributed systems.
Backend Software Developer for Atimi, providing software solutions remotely. Collaborate in product development and ensure code quality with a focus on AWS and Java.
Staff Backend Engineer developing scalable backend systems for Glider.fi, an innovative crypto trading platform. Designing data models and optimizing trading strategies in a dynamic environment.
Senior Software Engineer leading complex projects for Vanta's monetization platform. Responsible for technical direction, system architecture, and collaboration with finance and sales teams in a remote setup.
Full Stack Engineer at Xsolla developing cloud - native live streaming production technology for gaming industry. Working with advanced technology to empower users to tell their stories and grow their communities.
Rust and WebAssembly Developer at Partisia Blockchain, building applications within the blockchain ecosystem. Join a cutting - edge company and influence its growth during startup phase.
Sr. Python Developer for banking technology. Develop core banking applications, build automated tests, and collaborate with teams in a regulated financial environment.
AWS Backend Developer role designing and maintaining scalable backend services on AWS for banking applications. Involves microservices, APIs, and serverless architectures.
Lead Backend AEM Developer at Valtech focused on creating digital solutions and transforming industries. Join a collaborative environment fostering growth and innovation.
Backend Engineer working with Go to build reliable and scalable backend systems for Xsolla. Collaborating with cross - functional teams to ensure quality and performance in deployment.
Senior .NET Engineer developing scalable backend services using C# and ASP.NET Core for clients. Collaborating with engineering teams to implement robust solutions.