Ingénieur logiciel principal développant la plateforme Web Adobe, les systèmes de conception et l’ingénierie IA pour EDC. Contribution à des expériences numériques sécurisées et performantes pour les exportateurs canadiens.
About the role
- Data Annotation Specialist focusing on evaluating coding tasks for AI model development at Cohere. Conducting assessments, labeling outputs, and reporting performance trends.
Responsibilities
- Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
- Assess agent trajectories and model capabilities for code generation and debugging requests.
- Prompt models to complete complex coding tasks and review the accuracy of generated responses.
- Label, proofread, and improve machine-written and human-written software engineering-related outputs.
- Report quality and performance trends related to model/agent behaviour and project assignments.
Requirements
- Subject matter expertise in software engineering - you have both studied in this field and have 3-5 years of relevant industry experience.
- Proficient knowledge and understanding of Python and the following programming languages: Java, JavaScript, Go, and SQL (any dialect).
- Prior experience designing, building, and deploying APIs
- Prior experience working with code agents (OpenCode, Claude Code, Codex, Cursor) or evaluating agent trajectories is a big plus.
Benefits
- Performance incentives included!
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Software Engineer building Adobe Edge Delivery Services and Design Systems for EDC, Canada’s export finance corporation. Delivering secure, accessible, AI - enabled digital experiences.
Software Engineer improving Mozilla Firefox desktop installs, updates, and OS integrations. Supporting Windows and macOS platform compatibility, debugging, and collaborative browser development.
Senior ETL Engineer building Informatica, SQL, Salesforce, and cloud data pipelines. Supporting enterprise analytics and integration within Manulife’s regulated financial services environment.
Forward Deployed Engineer building AI - enabled products, agentic workflows, and production software for TribalScale’s digital innovation clients. Translating ambiguous business needs into secure, reliable solutions.
Forward Deployed Engineer building AI applications, agentic workflows, and production software for TribalScale’s digital innovation clients. Translating ambiguous business challenges into reliable, scalable solutions.
Forward Deployed Engineer building AI applications, agentic workflows, and production software for TribalScale’s digital innovation clients. Partnering directly with customers from discovery through deployment.
Staff Software Engineer building AI - powered billing systems for Elation Health’s cloud clinical platform. Owning full - stack production features, APIs, observability, and financial workflows.
Senior Android engineer building AI - native growth and monetization experiments for Life360’s family safety platform. Shipping subscription, advertising, and purchase features to tens of millions of users.
Senior full - stack engineer building and operating Grafana data source plugins. Integrating databases, cloud services, and agentic workflows for Grafana Labs’ observability platform.