Data Annotation Specialist evaluating data science and coding tasks for Cohere. Focus on improving model capabilities and accuracy through hands-on evaluation and feedback.
Responsibilities
Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
Prompt models to complete complex data science tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.
Requirements
3+ years of relevant industry experience working on real-world data science problems and pipelines.
Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
Strong understanding of SQL syntax writing and workflows; and a deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
Prior experience re-writing, proofreading, and delivering feedback on code.
Familiarity with code agents (OpenCode, Claude Code, Codex) or evaluating agent trajectories is a plus.
Data Scientist developing fraud detection solutions for Desjardins, North America's largest cooperative financial group. Applying data science expertise to protect financial products and services from fraud.
Data Scientist II applying SQL, Python, machine learning, and AI to Life & Health insurance products at TD Bank. Developing strategies and insights for better decisions.
Senior Data Scientist developing AI, analytics, and automation solutions for Desjardins, North America’s largest cooperative financial group. Building Finance prototypes, models, and AI agents for production.
Lead Analytics Consultant shaping Adobe Analytics and CJA strategies for Bounteous, a global AI services firm. Advising clients, designing implementations, and translating data into executive action.
Senior Data Scientist developing machine learning, GenAI agents, and analytics solutions for Sun Life’s Canadian financial - services business units. Leading technical delivery, stakeholder recommendations, and mentoring.
Senior Data Scientist needed for 12 - month contract, remote - first with 1 day/month onsite in North York, ON. Must have Python, SQL, GCP (Vertex AI & BigQuery), and forecasting experience.
Delivery Lead driving Prime infrastructure strategy at TD Securities, a capital markets investment bank. Coordinating cross - functional transformation, regulatory delivery, and expansion of TD Arranged Services.
Technical Program Manager driving audit readiness for Kraken’s global crypto and open - finance infrastructure. Coordinating audits, governance, inventories, playbooks, and auditor data access for Payward’s data platform.
Senior Data Scientist driving analytics for Jerry.ai’s AI - powered car and home ownership platform. Defining metrics, experiments, and recommendations across growth, product, automation, and partnerships.