Staff Backend Engineer shaping Skillshare’s online learning platform backend architecture. Building TypeScript services, GraphQL contracts, and reliable event - driven systems for millions of learners.
About the role
- Senior Python engineer building reliable web-scraping workflows for Mindrift’s Tendem AI project. Extracting, validating, and scaling structured datasets from complex dynamic websites.
Responsibilities
- Own end-to-end data extraction workflows across complex websites
- Ensure complete coverage, accuracy, and reliable delivery of structured datasets
- Use tools and custom workflows to accelerate data collection, validation, and task execution
- Extract data reliably from dynamic and interactive web sources, adapting to JavaScript-rendered content and changing site behavior
- Enforce data quality through validation checks, cross-source consistency controls, formatting specifications, and systematic verification
- Scale scraping operations for large datasets using efficient batching or parallelization
- Monitor failures and maintain stability against minor site structure changes
- Apply web scraping, data extraction, and data processing expertise to the Tendem project
- Work with tools including Apify, OpenRouter, and other technologies
Requirements
- At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
- Strong experience in Python web scraping, including BeautifulSoup, Selenium or similar, dynamic content, and APIs via proxies
- Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML
- Solid background in data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or Google Sheets
- Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
- Experience with AWS or equivalent cloud infrastructure and Docker containerization
- Hands-on experience with LLM frameworks such as LangChain or OpenRouter applied to automation tasks
- Strong attention to detail and commitment to data accuracy
- Self-directed work ethic with ability to troubleshoot independently
- English proficiency at Upper-intermediate (B2) or above
- Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
- GitHub link is a plus
Benefits
- Freelance opportunity
- Part-time schedule estimated at 10–20 hours per week during active project phases
- Flexible workload based on project requirements
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Développeur backend sénior façonnant la plateforme cloud - native de prêts hypothécaires de Nesto Cloud. Conception de services robustes en Go, Python, Node.js ou C#.
Programmeur·euse - analyste Java senior pour les services numériques du gouvernement canadien. Développement, modernisation et soutien en production d’applications web Java critiques à Ottawa.
Intern backend developer researching architectures and building scalable prototypes. Supporting Kinaxis’s AI - powered supply - chain orchestration platform through cloud and software experimentation.
Associate Backend Engineer building C#/.NET desktop software for Xero’s small - business platform. Developing WPF interfaces, testing features, debugging systems, and improving engineering processes.
Senior Backend Engineer building scalable backend services, data pipelines, and integrations for Apollo.io’s AI - driven go - to - market platform. Owning distributed architecture and high - throughput connections across a global engineering team.
Senior backend engineer building secure, scalable authentication systems for Affirm’s financial products. Leading platform architecture, delivery, reliability, and engineering mentorship.
Backend Software Engineer designing coding tasks and deterministic verifiers for Gramian’s next - generation AI training initiative. Building and reviewing scalable backend solutions across global remote regions.
Back - End Developer building secure accounts, registrations, and dashboard services. Supporting technical delivery of a bilingual nonprofit digital platform with Canadian client systems.
Staff Python engineer architecting distributed data, experimentation, and AI systems. Building scalable marketing intelligence infrastructure for eCommerce brands at Northbeam.