Staff Software Engineer specializing in data infrastructure for Instacart's data governance and compute systems. Collaborating with engineering teams to enhance the platform's reliability and performance.
About the role
- Data Engineer working at the intersection of food waste and large-scale data processing. Joining Afresh's mission to enhance fresh food accessibility through innovative data pipelines and AI.
Responsibilities
- Build and maintain robust data pipelines that ingest, transform, and validate complex customer data using PySpark, Python, and dbt to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
- Help improve integrations with new customers, making the process faster and more repeatable through thoughtful tooling.
- Contribute to the adoption of cutting-edge AI tooling (e.g., LLM-assisted data cleaning, semantic validation, and anomaly detection).
- Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
- Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
- Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
- Learn and grow by pairing with other engineers, participating in design reviews, and taking on bigger and bigger projects.
Requirements
- 2+ years of experience building ETLs or data workflows with Python, PySpark, SQL, or similar tools.
- Comfortable working with messy, incomplete, or inconsistent datasets—and turning them into something structured and usable.
- Experience in identifying areas where tooling or automation can simplify workflows and reduce manual effort.
- Experience or strong interest in platforms like Databricks, Snowflake, and dbt.
- Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
- Attention to detail and pride in delivering robust, maintainable solutions.
- Collaborative and communicative — you work well across teams and aren't afraid to ask questions.
- Learning mindset — hungry to grow your skills and move fast.
Benefits
- Softwares like LLM-assisted data cleaning and anomaly detection
- Working with collaborative and communicative teams
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Software Engineer focused on Docker Desktop's OS layer. Designing and maintaining key components for installation and system integration.
Principal Engineer designing mixed - signal IPs for Microchip Technology. Collaborating with SoC architects and managing IP intake processes for advanced analog solutions.
Principal Engineer for Mixed - Signal and analog IPs at Microchip, leading IP development and support with 10+ years experience required.
Principal Software Architecture Director overseeing software architecture and technology strategy at SGI. Providing guidance and mentorship while aligning with business goals in the insurance sector.
Senior Engineer leading design and implementation of protective relaying systems for BWRX - 300 Nuclear Reactor. Engaging in grid interface projects and customer technical assessments.
Overseeing SAP AMS operations and leading SAP support teams remotely from Canada. Ensuring adherence to SLAs and managing vendor relationships for outsourced SAP support.
Software Engineer (No - Code) at All Gen Tech developing applications by collaborating with teams. A role that emphasizes problem solving and adaption to new technologies in a remote environment.
Technical Lead providing hands - on leadership for Canadian payment systems at Servus Credit Union. Driving integrations, technical oversight, and modernization of payment services in a cooperative environment.
Software Engineer building and expanding internal and external platforms for SecondMuse's mission - driven work. Focusing on full - stack development, systems integration, and practical AI solutions.