Part-time AI workflow consultant evaluating ChatGPT and Claude across realistic business processes. Scoring outputs, documenting model behavior, and providing actionable feedback for 24-MAG’s AI projects.
Responsibilities
Run complex, multi-step professional scenarios using AI assistants such as ChatGPT and Claude
Recreate realistic business workflows involving analysis, communication, documentation, research, and operational tasks
Assess AI performance across each stage of a workflow
Evaluate whether AI-generated outputs are useful, complete, and practically actionable
Score AI-generated outputs using defined rubrics, quality criteria, and assessment standards
Review responses for completeness, relevance, accuracy, clarity, and professional usefulness
Identify quality issues, inconsistencies, and recurring model-performance patterns
Write clear, constructive, and actionable feedback
Document workflow steps for transparency and reproducibility
Explain where and why AI performance succeeds or breaks down
Maintain detailed written records for AI research and product teams
Connect AI assistants with workplace platforms such as Google Drive, Gmail, Slack, and Notion
Test connected, multi-tool business processes
Assess realistic professional AI adoption and identify opportunities to improve reliability and usability
Requirements
Minimum of 5 years of professional experience in a business function involving technology-enabled problem solving
Completed Bachelor's degree or higher in any discipline
Consistent, hands-on use of ChatGPT and/or Claude for real professional work
Strong familiarity with AI-assisted workflows, prompt-based work, and practical business use cases
Experience applying, creating, or reviewing evaluation rubrics, QA scorecards, grading criteria, or content-review guidelines
Academic evaluation, quality assurance, hiring assessment, annotation, or similar structured-review experience is advantageous
Comfortable integrating AI tools with workplace software and productivity platforms
Excellent written English
Strong attention to detail, analytical judgement, and process-improvement skills
Ability to work independently within structured remote and asynchronous project environments
Based in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand
Authorised to undertake contract work in the relevant country
No prior formal experience in AI research or model training is required
Benefits
Part-time independent contractor engagement
Fully remote work
Compensation of $30–$90/hour
Flexible project scope, workload, timing, and duration depending on project requirements
Video Specialist training SpaceXAI’s Grok AI to interpret and generate video content. Producing annotated, curated video data using editing, motion graphics, and VFX expertise.
AI Evaluation Specialist assessing AI - generated outputs, reasoning, and tool use for 24 - MAG LLC’s remote consulting platform. Providing rubric - based quality evaluations and actionable written feedback.
Freelance AI Visual Artist experimenting with generative image, video, music, and text tools. Creating innovative visual concepts for Paintgun’s performance advertising campaigns.
AI Success Architect helping Meltwater customers transform media, social, and AI signals into actionable workflows. Designing LLM agents, MCP integrations, and repeatable customer deliverables.
AI agent engineer building and managing autonomous agents for Sticker Mule’s software, manufacturing, and AI commerce platform. Connecting agents to tools, measuring results, and advising teams.
Senior AI Analyst prototyping and deploying cloud - based AI solutions for CBC/Radio - Canada media systems. Integrating LLMs, intelligent agents and AI capabilities across digital platforms.
Audit Innovation Principal building AI solutions for Caseware's audit and accounting software platform. Translating live practitioner workflows into reliable tools with engineering and applied science teams.
Strategy and AI operations leader partnering with Parallelz executives on planning, analysis, business operations, and fundraising. Building AI - native systems as Parallelz scales native mobile apps into web experiences.
Global AI and data risk audit leader overseeing RBC's AI governance, model risk, and data controls. Providing regulatory assurance across the bank's global operations.
Business Decision and AI Consultant helping Fortune 100 companies turn data into business value. Structuring decisions, analyzing data, and prototyping GenAI solutions with specialist teams.