Senior backend engineer building scalable services for Ground News, a platform comparing news sources and media bias. Owning backend features, reliability, and safe production rollouts.
About the role
- Senior Data Engineer developing and optimizing data pipelines on Databricks for healthtech company. Collaborating with stakeholders and ensuring data integrity through efficient processing.
Responsibilities
- Develop, manage, and optimize data pipelines on the Databricks platform.
- Debug and troubleshoot Spark applications to ensure reliability and performance.
- Implement best practices for Spark compute and optimize workloads.
- Write clean, efficient, and reusable Python code using object-oriented programming principles.
- Design and build APIs to support data integration and application needs.
- Develop scripts and tools to automate data processing and workflows.
- Integrate, query, and manage data within MongoDB.
- Ensure efficient storage and retrieval processes tailored to application requirements.
- Optimize MongoDB performance for large-scale data handling.
- Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
- Proactively identify and address technical challenges related to data processing and system design.
Requirements
- Proven experience working with Databricks and Spark compute.
- Proficient in Python, including object-oriented programming and API development.
- Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
- Strong problem-solving skills and ability to debug and optimize data processing tasks.
- Experience with large-scale data processing and distributed systems.
Benefits
- Offers Equity
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Node.js Engineer building distributed backend services and APIs for Wordly’s real - time translation platform. Extending Node.js modules, integrations, and event - driven systems for translation in 50+ languages.
Fullstack engineer evolving memodio’s prescribed digital health app with Flutter and Node.js. Building accessible features and regulated medical software for older users worldwide.
Senior Python engineer building reliable web - scraping and data - extraction workflows for Mindrift’s AI technology projects. Processing dynamic websites into accurate, validated structured datasets.
Backend Engineer designing APIs and integration architecture for EvenUp's AI - powered legal - tech platform. Improving client portal experiences and application performance from Toronto or San Francisco hubs.
Staff Backend Engineer building search and recommendation systems for Affirm’s pay - over - time marketplace. Setting technical strategy and scaling distributed backend systems across Affirm’s shopping platform.
Senior backend engineer building reliable MySQL and distributed SQL infrastructure for Affirm’s transparent buy - now - pay - later financial products. Automating databases, migrations, networking, and operations at scale.
Senior backend engineer building and operating distributed database infrastructure for Affirm’s buy - now - pay - later platform. Automating provisioning, migrations, failover, and Kubernetes storage networking.
Backend Engineer building Resend’s SMTP and email transport infrastructure. Designing reliable delivery, throttling, routing, and reputation - aware systems for developers.
Salesforce director leading MuleSoft and enterprise data foundation architecture for customer engagements. Advising CxOs and delivering governed, AI - ready platforms across complex technology environments.