Content Marketing Lead owning strategy, creation, and brand voice for Orchestry’s Microsoft 365 SaaS platform. Scaling content programs and AI workflows to drive demand, SEO, sales, and growth.
About the role
- AI content evaluator reviewing documents, presentations, and spreadsheets for advanced AI training. Comparing outputs and delivering evidence-based quality feedback.
Responsibilities
- Review documents, presentations, spreadsheets, and other professional materials
- Assess outputs for accuracy, clarity, completeness, organisation, and overall quality
- Identify factual errors, inconsistencies, omissions, and weak reasoning
- Evaluate whether materials meet professional standards for real-world use
- Compare and rank AI-generated outputs against defined evaluation criteria
- Determine which response or work product better satisfies task requirements
- Identify meaningful differences in quality, reasoning, structure, and presentation
- Flag incomplete, misleading, or poorly supported outputs
- Review written documents for structure, readability, and accuracy
- Evaluate presentation slides for clarity, coherence, and effective communication
- Assess spreadsheets for logical consistency, organisation, and correctness
- Identify formatting issues that reduce usability or professional quality
- Provide clear, concise, and well-reasoned written feedback
- Explain ratings and preference decisions using specific evidence
- Highlight the most important issues rather than relying on general impressions
- Follow structured rubrics and project guidelines
- Maintain consistent quality standards across diverse evaluation tasks
Requirements
- Bachelor's degree or higher
- Based in the United States or Canada
- Excellent English reading comprehension and written communication
- Strong analytical judgement across varied professional subject matter
- Exceptional attention to detail
- Ability to identify errors, inconsistencies, formatting problems, and gaps in reasoning
- Comfortable working with documents, presentations, spreadsheets, and common productivity tools
- Able to move efficiently between different topics and content formats
- Comfortable working independently within structured evaluation guidelines
- Prior AI, machine learning, or model-evaluation experience is not required
- Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
- H1-B and STEM OPT support is unavailable for this engagement
Benefits
- Part-time independent contractor engagement
- Fully remote within the United States or Canada
- Flexible scheduling based on project requirements
- Project guidelines and evaluation criteria provided
- Projects may be extended, shortened, or concluded based on project needs and performance
Job title
Job type
Experience level
Salary
Degree requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Content Marketing Manager creating multi - channel campaigns and thought leadership for Spektrix, an arts and culture software company. Driving audience engagement, lead generation, and regional editorial quality.
Senior Content Rigger rigging game assets and building animation pipeline tools for Sledgehammer Games, a Call of Duty developer. Remote in Canada or hybrid from its Toronto studio.
Global Digital Product Content Specialist publishing Arc’teryx ecommerce copy, translations, and imagery across global websites. Coordinating launches, workflows, and optimization for the brand’s digital commerce team.
Conseiller principal créant des contenus numériques et multimédias pour PEAK, firme de services financiers. Pilotage de plateformes, intégration de l’IA et production d’événements corporatifs.
Coordonnateur marketing et contenu chez Maître Carré, qui réinvente l’habitation multi - résidentielle durable. Création de contenu, animation des communautés et coordination de campagnes marketing.
Content Integrator creating bilingual digital campaigns for Intact, Canada’s largest property and casualty insurer. Building accessible emails and broker portal experiences across Salesforce Marketing Cloud and Drupal.
Contract Content Migration Specialist migrating bilingual nonprofit content from Drupal to a headless CMS. Preserving metadata, media, relationships and redirects through launch.
EC
Senior UX Content Designer improving content standards, research operations, and design systems. Supporting EDC’s digital experiences for Canadian exporters through accessible, scalable practices.
Live content specialist shipping Fish World promotions, assets, and weekly releases for Canadian gaming company Big Viking Games. Managing QA, documentation, and AI - assisted workflow improvements.