Data Engineer working at the intersection of food waste and large-scale data processing. Joining Afresh's mission to enhance fresh food accessibility through innovative data pipelines and AI.
Responsibilities
Build and maintain robust data pipelines that ingest, transform, and validate complex customer data using PySpark, Python, and dbt to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
Help improve integrations with new customers, making the process faster and more repeatable through thoughtful tooling.
Contribute to the adoption of cutting-edge AI tooling (e.g., LLM-assisted data cleaning, semantic validation, and anomaly detection).
Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
Learn and grow by pairing with other engineers, participating in design reviews, and taking on bigger and bigger projects.
Requirements
2+ years of experience building ETLs or data workflows with Python, PySpark, SQL, or similar tools.
Comfortable working with messy, incomplete, or inconsistent datasets—and turning them into something structured and usable.
Experience in identifying areas where tooling or automation can simplify workflows and reduce manual effort.
Experience or strong interest in platforms like Databricks, Snowflake, and dbt.
Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
Attention to detail and pride in delivering robust, maintainable solutions.
Collaborative and communicative — you work well across teams and aren't afraid to ask questions.
Learning mindset — hungry to grow your skills and move fast.
Benefits
Softwares like LLM-assisted data cleaning and anomaly detection
Working with collaborative and communicative teams
Junior Software Developer contributing to full - stack development of web - based applications in a geospatial intelligence company. Collaborating in an agile team with exposure to innovative projects.
Software Developer involved in web application development for a geospatial intelligence company. Focusing on full - stack development and collaborating in a small, agile team environment.
Senior Tag Management/MarTech Engineer responsible for client - side tagging in a remote role at Northern. Collaborating with teams to ensure data governance in a regulated fintech environment.
Senior Municipal Engineer leading civil engineering projects at GEMTEC. Emphasizing on municipal and transportation infrastructure and site development in a hybrid work environment.
Lead Full Stack Developer providing technical direction and mentoring junior developers at RBC. Collaborating on innovative payment solutions for commercial clients.
Staff Chief Engineer overseeing engineering activities and ensuring safety and compliance on maritime vessels. Leading engineering teams and managing technical operations with compliance to safety standards.
Senior Software Engineer at Affirm's Zero to One labs developing and launching scalable AI - enabled systems. Engaging in rapid prototyping and collaborating with product managers in a fast - paced environment.
Test and Product Engineering Developer at Ford working on hardware testing for Electronic Control Units. Focus on defining test requirements, methodologies, and achieving product quality in mass production.
Full Stack Developer building complex web applications and APIs in Assurance Innovation Lab at BDO. Collaborating with high - performing teams to drive innovation and enhance client service.
Software Developer I developing AI - driven applications within PR Newswire Canada. Collaborating with cross - functional teams to enhance application development and code quality.