Data Engineer working at the intersection of food waste and large-scale data processing. Joining Afresh's mission to enhance fresh food accessibility through innovative data pipelines and AI.
Responsibilities
Build and maintain robust data pipelines that ingest, transform, and validate complex customer data using PySpark, Python, and dbt to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
Help improve integrations with new customers, making the process faster and more repeatable through thoughtful tooling.
Contribute to the adoption of cutting-edge AI tooling (e.g., LLM-assisted data cleaning, semantic validation, and anomaly detection).
Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
Learn and grow by pairing with other engineers, participating in design reviews, and taking on bigger and bigger projects.
Requirements
2+ years of experience building ETLs or data workflows with Python, PySpark, SQL, or similar tools.
Comfortable working with messy, incomplete, or inconsistent datasets—and turning them into something structured and usable.
Experience in identifying areas where tooling or automation can simplify workflows and reduce manual effort.
Experience or strong interest in platforms like Databricks, Snowflake, and dbt.
Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
Attention to detail and pride in delivering robust, maintainable solutions.
Collaborative and communicative — you work well across teams and aren't afraid to ask questions.
Learning mindset — hungry to grow your skills and move fast.
Benefits
Softwares like LLM-assisted data cleaning and anomaly detection
Working with collaborative and communicative teams
Senior embedded engineer developing safety - critical ECU firmware for Hexagon Mining’s digital mining and vehicle - control technologies. Designing, testing, and commissioning embedded systems.
Staff Software Engineer building full - stack AI - powered healthcare workflows for exacare ai, whose platform transforms referral packets into clinical insights and placement decisions.
Senior Software Engineer building scalable TypeScript and AWS systems for exacare ai’s AI operating system for post - acute care. Owning healthcare workflow features from design through production.
Senior Full Stack Engineer expanding Infisical’s open source security infrastructure platform. Building secrets management, PKI, PAM, and KMS products with the engineering team.
Full Stack Engineer expanding Infisical’s open source security platform for secrets management, PKI, PAM, and KMS. Building secure developer infrastructure and AI - enabled security capabilities.
Full - Stack Digital Strategist developing multi - channel campaigns for luxury hotels, resorts, and experiential travel brands. Optimizing paid media, SEO, tracking, funnels, and client performance.
Principal Software Developer building Solace Agent Mesh, an event - driven platform connecting and orchestrating AI agents. Leading AI integration architecture, platform development, and technical innovation.
Guidewire technical lead shaping insurance digital transformation at Alithya. Designing scalable architectures, integrations, cloud migrations, and modernization solutions.
Senior Software Engineer building AlphaSense’s AI - powered Excel plugin for financial professionals. Optimizing Office integrations used by analysts at leading financial institutions.