Data Annotation Specialist focusing on evaluating coding tasks for AI model development at Cohere. Conducting assessments, labeling outputs, and reporting performance trends.
Responsibilities
Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation and debugging requests.
Prompt models to complete complex coding tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.
Requirements
Subject matter expertise in software engineering - you have both studied in this field and have 3-5 years of relevant industry experience.
Proficient knowledge and understanding of Python and the following programming languages: Java, JavaScript, Go, and SQL (any dialect).
Prior experience designing, building, and deploying APIs
Prior experience working with code agents (OpenCode, Claude Code, Codex, Cursor) or evaluating agent trajectories is a big plus.
Senior Modeling & Simulation Engineer at Kepler Communications developing models and simulations for space systems. Collaborating with experts to enhance systems models and decision - making processes.
Senior Engineer building and owning systems for AI agents in healthcare automation. Driving technical direction and improving operational efficiencies for healthcare workflows.
Senior Fullstack Developer on Stay22's Neuro team designing and building robust backend systems. Focused on AI/ML infrastructure for applications that enhance monetization for digital creators.
Intern supporting AI - based software development for marine engineering research on ice - loads prediction. Collaborating with global teams at ABS HET&DRC in St. John's, NL.
Junior Software Developer contributing to full - stack development of web - based applications in a geospatial intelligence company. Collaborating in an agile team with exposure to innovative projects.
Software Developer involved in web application development for a geospatial intelligence company. Focusing on full - stack development and collaborating in a small, agile team environment.
Senior Tag Management/MarTech Engineer responsible for client - side tagging in a remote role at Northern. Collaborating with teams to ensure data governance in a regulated fintech environment.
Senior Municipal Engineer leading civil engineering projects at GEMTEC. Emphasizing on municipal and transportation infrastructure and site development in a hybrid work environment.
Lead Full Stack Developer providing technical direction and mentoring junior developers at RBC. Collaborating on innovative payment solutions for commercial clients.
Staff Chief Engineer overseeing engineering activities and ensuring safety and compliance on maritime vessels. Leading engineering teams and managing technical operations with compliance to safety standards.