Data Annotation Specialist, Data Science

Posted 4 days ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Data Annotation Specialist evaluating data science and coding tasks for Cohere. Focus on improving model capabilities and accuracy through hands-on evaluation and feedback.

Responsibilities

  • Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
  • Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
  • Prompt models to complete complex data science tasks and review the accuracy of generated responses.
  • Label, proofread, and improve machine-written and human-written software engineering-related outputs.
  • Report quality and performance trends related to model/agent behaviour and project assignments.

Requirements

  • 3+ years of relevant industry experience working on real-world data science problems and pipelines.
  • Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
  • Strong understanding of SQL syntax writing and workflows; and a deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
  • Prior experience re-writing, proofreading, and delivering feedback on code.
  • Familiarity with code agents (OpenCode, Claude Code, Codex) or evaluating agent trajectories is a plus.

Benefits

  • BYOD 💻 - Bring Your Own Device (laptop)
  • Performance incentives included

Job type

Contract

Experience level

Mid levelSenior

Salary

CA$40 per hour

Degree requirement

Bachelor's Degree

Tech skills

NumpyPandasPythonSQLSQLite

Location requirements

RemoteCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.