Senior Software Engineer specializing in Python and data ecosystems, building critical integrations for ClickHouse. Work at the intersection of high - performance database engineering and developer experience.
About the role
- Senior Data Engineer developing and optimizing data pipelines on Databricks for healthtech company. Collaborating with stakeholders and ensuring data integrity through efficient processing.
Responsibilities
- Develop, manage, and optimize data pipelines on the Databricks platform.
- Debug and troubleshoot Spark applications to ensure reliability and performance.
- Implement best practices for Spark compute and optimize workloads.
- Write clean, efficient, and reusable Python code using object-oriented programming principles.
- Design and build APIs to support data integration and application needs.
- Develop scripts and tools to automate data processing and workflows.
- Integrate, query, and manage data within MongoDB.
- Ensure efficient storage and retrieval processes tailored to application requirements.
- Optimize MongoDB performance for large-scale data handling.
- Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
- Proactively identify and address technical challenges related to data processing and system design.
Requirements
- Proven experience working with Databricks and Spark compute.
- Proficient in Python, including object-oriented programming and API development.
- Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
- Strong problem-solving skills and ability to debug and optimize data processing tasks.
- Experience with large-scale data processing and distributed systems.
Benefits
- Offers Equity
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
Python SQL AKS Developer
LinkedIn Recruiter Post
Python SQL AKS Developer role in Toronto for Capital Markets at $100/hr. Contractor position in software development.
Application Engineer in Payments Workflow Technology team delivering solutions aligned with technology strategy. Engaging in project delivery and collaboration for technology solutions at TD.
Senior Backend Engineer joining cross - functional teams to develop tools, APIs, and integrations at Remote. Work revolves around Elixir, Phoenix, React, and Next.js architectures.
Oracle Cloud Solutions Technical Architect at Argano proposing and delivering state - of - the - art solutions. Collaborating with clients to address technical needs and implement Oracle Cloud solutions.
Senior Backend Developer at Clir Renewables building AI - powered features for sustainable energy management. Collaborating with product teams to enhance client - facing systems and support renewable energy intelligence.
LP
Java Backend Developer
LinkedIn Recruiter Post
Java Backend Developer in Mississauga (Hybrid). Requires Core Java, Spring Boot, Microservices, REST APIs, SQL/NoSQL databases. Cloud experience (AWS/Azure) a plus.
Intermediate Backend Software Developer at Ava Industries. Assist in transferring patient health data using Ruby on Rails for a cloud - based EMR system.
LP
Backend NodeJS Developer with MSSQL
LinkedIn Recruiter Post
Backend NodeJS Developer with MSSQL needed for hybrid role in Mississauga. 5+ years experience, $45 - $50/hr contractor position.
LP
Senior Python Developer
LinkedIn Recruiter Post
Senior Python Developer contract role in Toronto. Requires 8+ years development experience, 3+ years Python, GCP services, data tools, and workflow orchestration.