Senior Member of Technical Staff focusing on web data pipelines for AI at Cohere. Transforming raw data into high-quality training data for advanced language models.
Responsibilities
Maintain large-scale pipelines for processing web corpora.
Work on filtering and quality-scoring systems to identify high-value web documents.
Analyze web data composition across domains, languages and time periods.
Develop and maintain highly-performant deduplication pipelines.
Collaborate with cross-functional teams, including researchers and engineers, to ensure data pipelines meet the demands of cutting-edge language models.
Requirements
Strong software engineering skills, with proficiency in Python and experience building data pipelines.
Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
Experience working with large-scale web datasets.
Knowledge of data quality assessment techniques and experimentation with data mixtures.
A passion for bridging research and engineering to solve complex data-related challenges in AI model training.
Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).
Benefits
An open and inclusive culture and work environment
Work closely with a team on the cutting edge of AI research
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits, including a separate budget to take care of your mental health
100% Parental Leave top-up for up to 6 months
Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
Engineering Graduate in Tenaris's Global Trainee role, gaining skills in energy sector with opportunities for training and travel. Collaborating on projects and learning about processes.
ETL Developer responsible for designing and maintaining data pipelines at Clic Santé. Collaborating in a healthcare tech environment focusing on data access improvement.
Developer II on Cloud Infrastructure team building and maintaining cloud solutions for Petal's product teams. Collaborating with engineers for cloud stability and reliability.
Validation Specialist focusing on validation activities for biomanufacturing processes. Collaborating with various departments to ensure compliance with manufacturing standards and protocols.
Senior Generalist Programmer focusing on tool development for video game production at Behaviour Interactive. Collaborating with cross - functional teams to enhance workflows and solve technical challenges.
Team Lead coordinating talented individuals in building agentic features for a cybersecurity platform. Mentoring team members and guiding technical decisions in a growing company.
Senior Mobile Engineer focusing on Android shopper app features for Instacart. Collaborating with cross - functional teams to enhance shopper lifecycle and engagement.
Web developer needed to redesign and develop ICA’s organizational website. The role focuses on enhancing digital presence and accessibility for Indigenous Climate Action.