Generative AI Specialist responsible for evaluating AI models and contributing to language understanding. Flexible remote role for candidates with humanities background and strong language skills.
Responsibilities
Evaluation: Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions.
Annotation Labeling: Labeling elements of a piece of content rather than the content as a whole.
Classification: Assigning predefined categories or labels to items.
Content Quality: Evaluating the perceived quality and/or appropriateness of content.
Content Understanding: Generating labels to advance understanding of a concept, trend etc.
Data Augmentation: Creation of additional training data for machine learning models by applying transformations to the original data.
Grading: Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines.
Identification Labeling: Labeling model outputs to identify if a piece of content is or isn't something.
Preference Ranking: Ordering or ranking items based on a set of preferences or criteria.
Prompt Generation: Creating prompts or questions that will be used to generate responses from a language model or other AI system.
Relevance Evaluation: Projects that evaluate the relevance of content based on a relevancy scale.
Response Generation: Generating responses to prompts or questions using a language model or other AI system.
Response Rewrite: Rewriting existing text while preserving the original meaning.
Response Summarization: Producing concise summaries of longer pieces of text or data.
Similarity Evaluation: Projects where content is compared in order to drive a determination.
Transcription: Converting spoken language or audio content into written text.
Translation: Converting text or spoken language from one language to another.
Data Collection: Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models.
Requirements
A Bachelor’s degree or higher in a humanities specialization
Advanced degrees are strongly preferred (Master’s or PhD)
Professional or Expert level proficiency (C1/C2) in English and Russian
Administrateur IA assurant la gouvernance, la sécurité et les opérations de Microsoft 365 Copilot chez EDC. Soutien de l’IA d’entreprise pour aider les entreprises canadiennes à réussir à l’étranger.
AI Administrator managing Microsoft 365 Copilot, Entra ID, and AI governance for Export Development Canada. Supporting secure enterprise AI adoption across Ottawa, Toronto, or Montreal.
Generative AI Artist creating AI - driven visuals, sequences, and previs for Rodeo FX’s visual - effects and advertising productions. Building ComfyUI workflows and collaborating with compositing, 3D, and art - direction teams.
AI transformation leader selling and delivering enterprise change consulting at Prosci. Building AI prototypes, guiding organizational change, and growing executive client accounts.
Mila AI Safety research intern developing public - safety guardrails, benchmarking, and model evaluations. Collaborating with researchers and compute teams on applied machine - learning research in Montréal.
AI products lead building GenAI - powered communications surveillance and compliance products at RBC Capital Markets. Leading full - stack engineering, AI agents, and production delivery.
UNESCO consultant analyzing learning assessment data with AI - assisted methods. Developing policy insights, reproducible protocols, and national analyst capacity.
AI Enablement Lead building training, curriculum and metrics for Valtech’s AI - native digital experience consultancy. Enabling practitioners, new hires and teams through AI - native SDLC transformation.
Marketing Specialist advancing AI - powered content, automation, SEO, and analytics for EverCommerce’s EMHware and GoodTherapy healthcare platforms. Improving campaign performance and adoption across Canada.
Senior AI sales executive commercializing agentic AI solutions for grocery retailers at Instacart. Building pricing, partnerships, and enterprise deal processes.