Generative AI Specialist at Innodata evaluating and developing large language models. Collaborating with global tech companies on innovative AI projects.
Responsibilities
Evaluation: Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions
Annotation Labeling: Labeling elements of a piece of content rather than the content as a whole
Classification: Assigning predefined categories or labels to items
Content Quality: Evaluating the perceived quality and/or appropriateness of content
Content Understanding: Generating labels to advance understanding of a concept, trend etc.
Data Augmentation: Creation of additional training data for machine learning models by applying transformations to the original data
Grading: Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines
Identification Labeling: Labeling model outputs to identify if a piece of content is or isn't something
Preference Ranking: Ordering or ranking items based on a set of preferences or criteria
Prompt Generation: Creating prompts or questions that will be used to generate responses from a language model or other AI system
Relevance Evaluation: Projects that evaluate the relevance of content based on a relevancy scale
Response Generation: Generating responses to prompts or questions using a language model or other AI system
Response Rewrite: Rewriting existing text while preserving the original meaning
Response Summarization: Producing concise summaries of longer pieces of text or data
Similarity Evaluation: Projects where content is compared in order to drive a determination
Transcription: Converting spoken language or audio content into written text
Translation: Converting text or spoken language from one language to another
Data Collection: Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models
Requirements
A Bachelor’s degree or higher in a humanities specialization is required
Advanced degrees are strongly preferred (Master’s or PhD)
Professional or Expert level proficiency (C1/C2) in English and Italian
Benefits
Flexible work arrangements
Work on cutting-edge AI development
Contribute to AI development while maintaining control over your time
Senior AI Tools Engineer building Unreal Engine tools and AI - assisted workflows for BulletFarm, an independent AAA game studio. Automating game production and enabling non - technical creative teams.
GHL and AI automation manager building outbound, nurture, and conversational AI systems. Supporting Jumpfactor’s digital marketing campaigns for MSP and IT clients.
Research Director analyzing integration, API management, and AI - enablement markets for IDC, a global technology intelligence provider. Forecasting growth, advising clients, and presenting insights to technology leaders.
Director shaping Desjardins’ Personal Services data, analytics, and AI strategy. Leading transformation, governance, executive partnerships, and high - impact use cases for a cooperative financial group.
AI solutions lead rebuilding Instacart’s grocery - delivery Marketing processes with agentic workflows. Driving adoption, measurable impact, and cross - functional AI planning.
Director leading Desjardins’ AI, data and analytics strategy for Personal Services. Driving data transformation, executive decisions, advanced analytics and responsible governance.
Senior AI Solutions Analyst guiding Desjardins Group’s financial services sectors in responsible productivity AI adoption. Assessing use cases, value, risks and Microsoft AI solutions.
AI Safety Red Teamer stress - testing Mercor’s frontier AI models. Identifying vulnerabilities, jailbreaks, hallucinations, and policy failures through adversarial evaluation.
AVP leading AI transformation, including fraud detection, for Manulife, a global financial services provider. Driving secure, governed Classical, Generative, and Agentic AI solutions across Corporate Functions.
Generative AI Analyst validating Canadian French translations for Welo Data, a global AI data company. Reviewing and annotating multilingual AI - generated content for training and quality improvement.