Data Annotation Specialist focusing on evaluating coding tasks for AI model development at Cohere. Conducting assessments, labeling outputs, and reporting performance trends.
Responsibilities
Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation and debugging requests.
Prompt models to complete complex coding tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.
Requirements
Subject matter expertise in software engineering - you have both studied in this field and have 3-5 years of relevant industry experience.
Proficient knowledge and understanding of Python and the following programming languages: Java, JavaScript, Go, and SQL (any dialect).
Prior experience designing, building, and deploying APIs
Prior experience working with code agents (OpenCode, Claude Code, Codex, Cursor) or evaluating agent trajectories is a big plus.
Principal Protection & Control Engineer leading high - voltage substation protection and control projects for Qualus, a power infrastructure solutions firm. Providing technical governance, approvals, commissioning support, and mentorship.
Senior Protection & Control Engineer leading high - voltage substation protection, control, and metering designs. Supporting utilities and renewable energy clients from concept through commissioning.
Early - career full - stack engineer building TypeScript/Node and React systems for Prometheum’s blockchain securities infrastructure. Shipping features, fixes, tests, and technical improvements in a fully remote team.
Full - stack engineer owning features for Prometheum’s blockchain - based securities infrastructure. Building TypeScript/Node.js back ends and React front ends for regulated digital - asset markets.
CMS Technical Lead migrating credit union public websites from Central1 Forge/OpenText to target CMS platforms. Leading architecture, integrations, security, content migration, and launch stabilization.
Junior Software Engineer developing LookDev, Lighting, and rendering tools for Image Engine, a Vancouver VFX studio. Optimizing Arnold, Gaffer, GPU, and production workflows.
GTM Engineer building AI agents, Salesforce automation, and pipeline intelligence for ButterflyMX’s smartphone door - access platform. Improving sales productivity, data integrity, and revenue velocity.
Senior Software Engineer building scalable AWS, Big Data, and ML infrastructure for Genesys’ AI - powered customer - experience platform. Leading distributed systems projects from architecture through production.
Software Developer building full - stack web applications for Intelex’s global EHSQ software platform. Delivering agile features across React, Node.js, Azure, AWS, .NET, and SQL stacks.
Senior backend developer building AI - agent systems for Knak, an enterprise email and landing - page marketing automation platform. Designing APIs and microservices with PHP, Python, Node.js, MySQL, and AWS while mentoring engineers.