Generative AI Specialist at Innodata evaluating and developing large language models. Collaborating with global tech companies on innovative AI projects.
Responsibilities
Evaluation: Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions
Annotation Labeling: Labeling elements of a piece of content rather than the content as a whole
Classification: Assigning predefined categories or labels to items
Content Quality: Evaluating the perceived quality and/or appropriateness of content
Content Understanding: Generating labels to advance understanding of a concept, trend etc.
Data Augmentation: Creation of additional training data for machine learning models by applying transformations to the original data
Grading: Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines
Identification Labeling: Labeling model outputs to identify if a piece of content is or isn't something
Preference Ranking: Ordering or ranking items based on a set of preferences or criteria
Prompt Generation: Creating prompts or questions that will be used to generate responses from a language model or other AI system
Relevance Evaluation: Projects that evaluate the relevance of content based on a relevancy scale
Response Generation: Generating responses to prompts or questions using a language model or other AI system
Response Rewrite: Rewriting existing text while preserving the original meaning
Response Summarization: Producing concise summaries of longer pieces of text or data
Similarity Evaluation: Projects where content is compared in order to drive a determination
Transcription: Converting spoken language or audio content into written text
Translation: Converting text or spoken language from one language to another
Data Collection: Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models
Requirements
A Bachelor’s degree or higher in a humanities specialization is required
Advanced degrees are strongly preferred (Master’s or PhD)
Professional or Expert level proficiency (C1/C2) in English and Italian
Benefits
Flexible work arrangements
Work on cutting-edge AI development
Contribute to AI development while maintaining control over your time
Head of AI Operations building Supabase’s AI - native operating system for its Postgres development platform. Establishing standards, assessments, automated reporting, and company - wide AI - enabled operations.
Administrateur IA assurant la gouvernance, la sécurité et les opérations de Microsoft 365 Copilot chez EDC. Soutien de l’IA d’entreprise pour aider les entreprises canadiennes à réussir à l’étranger.
AI Administrator managing Microsoft 365 Copilot, Entra ID, and AI governance for Export Development Canada. Supporting secure enterprise AI adoption across Ottawa, Toronto, or Montreal.
Generative AI Artist creating AI - driven visuals, sequences, and previs for Rodeo FX’s visual - effects and advertising productions. Building ComfyUI workflows and collaborating with compositing, 3D, and art - direction teams.
AI transformation leader selling and delivering enterprise change consulting at Prosci. Building AI prototypes, guiding organizational change, and growing executive client accounts.
Mila AI Safety research intern developing public - safety guardrails, benchmarking, and model evaluations. Collaborating with researchers and compute teams on applied machine - learning research in Montréal.
AI products lead building GenAI - powered communications surveillance and compliance products at RBC Capital Markets. Leading full - stack engineering, AI agents, and production delivery.
UNESCO consultant analyzing learning assessment data with AI - assisted methods. Developing policy insights, reproducible protocols, and national analyst capacity.
AI Enablement Lead building training, curriculum and metrics for Valtech’s AI - native digital experience consultancy. Enabling practitioners, new hires and teams through AI - native SDLC transformation.
Marketing Specialist advancing AI - powered content, automation, SEO, and analytics for EverCommerce’s EMHware and GoodTherapy healthcare platforms. Improving campaign performance and adoption across Canada.