AI Evaluation & Annotation Specialist reviewing and annotating AI-generated responses while adhering to project guidelines and maintaining quality standards.
Responsibilities
Review AI-generated responses and rate them for clarity, correctness, and relevance.
Annotate and label content based on project-specific guidelines.
Follow detailed written instructions and apply them consistently.
Generate or evaluate prompts depending on assignment type.
Work with QA Leads to apply feedback and continuously improve task quality.
Report completed work daily and meet productivity and quality standards.
Requirements
Fluency in German, with strong written and verbal communication skills.
Bachelor's degree in Linguistics, Computer Science, or a related field; or equivalent experience.
Experience or interest in AI, Machine Learning, or data annotation preferred.
Strong attention to detail and ability to work with complex data sets.
Familiarity with translation and localization processes is an advantage.
Ability to work independently and collaboratively in a fast-paced environment.
Proficient in using Artificial Intelligence and data annotation tools, with a willingness to learn new technologies.
Video Specialist training SpaceXAI’s Grok AI to interpret and generate video content. Producing annotated, curated video data using editing, motion graphics, and VFX expertise.
Part - time AI workflow consultant evaluating ChatGPT and Claude across realistic business processes. Scoring outputs, documenting model behavior, and providing actionable feedback for 24 - MAG’s AI projects.
AI Evaluation Specialist assessing AI - generated outputs, reasoning, and tool use for 24 - MAG LLC’s remote consulting platform. Providing rubric - based quality evaluations and actionable written feedback.
Freelance AI Visual Artist experimenting with generative image, video, music, and text tools. Creating innovative visual concepts for Paintgun’s performance advertising campaigns.
AI Success Architect helping Meltwater customers transform media, social, and AI signals into actionable workflows. Designing LLM agents, MCP integrations, and repeatable customer deliverables.
AI agent engineer building and managing autonomous agents for Sticker Mule’s software, manufacturing, and AI commerce platform. Connecting agents to tools, measuring results, and advising teams.
Senior AI Analyst prototyping and deploying cloud - based AI solutions for CBC/Radio - Canada media systems. Integrating LLMs, intelligent agents and AI capabilities across digital platforms.
Audit Innovation Principal building AI solutions for Caseware's audit and accounting software platform. Translating live practitioner workflows into reliable tools with engineering and applied science teams.
Strategy and AI operations leader partnering with Parallelz executives on planning, analysis, business operations, and fundraising. Building AI - native systems as Parallelz scales native mobile apps into web experiences.
Global AI and data risk audit leader overseeing RBC's AI governance, model risk, and data controls. Providing regulatory assurance across the bank's global operations.