Data Annotation Specialist evaluating data science and coding tasks for Cohere. Focus on improving model capabilities and accuracy through hands-on evaluation and feedback.
Responsibilities
Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
Prompt models to complete complex data science tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.
Requirements
3+ years of relevant industry experience working on real-world data science problems and pipelines.
Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
Strong understanding of SQL syntax writing and workflows; and a deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
Prior experience re-writing, proofreading, and delivering feedback on code.
Familiarity with code agents (OpenCode, Claude Code, Codex) or evaluating agent trajectories is a plus.
Freelance AI agent developer working to build intelligent automation tools in digital media environment. Involves designing and deploying data - driven agents for editorial and revenue operations.
Senior Data Scientist developing machine - learning models end to end for Flinks' financial platform. Collaborating across teams to drive real financial decisions through deployed models.
Manager of Applied AI/ML engineering leading a multidisciplinary team across different regions. Supporting engineers and data scientists to adapt in a fast - changing technical environment.
Junior Data Scientist in Boeing's Digital Services team, leveraging analytics for tools and services in aviation. Collaborating with cross - functional teams to enhance customer - facing software solutions.
Director leading the Data Science team at RBC focused on AI and analytics innovations. Overseeing model development and ensuring data governance across distribution networks in Canada.
Lead Data Manager responsible for data management in clinical trials for a global organization. Overseeing complex studies and team communication within clinical data management.
Data Manager supervising clinical data management activities for clinical trials. Acting as communication line for project teams and managing documentation tasks.
Data Scientist improving financial solutions for Canadians at Borrowell. Collaborating with teams to analyze data and enhance user experience in financial products.