Professional Services Evaluation Consultant

Posted 3 weeks ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Professional evaluator reviewing AI-generated work products across project management, law, accounting, software, or IT. Assessing realism, accuracy, grading, and practitioner-level quality.

Responsibilities

  • Review complete AI-generated work products representing realistic tasks from the consultant’s professional field
  • Examine task instructions, completed deliverables, supporting files, and evaluation results
  • Assess whether work reflects realistic professional practice
  • Identify substantive issues apparent to an experienced practitioner
  • Evaluate whether outputs are usable or acceptable in a real professional setting
  • Assess task descriptions, constraints, expected deliverables, and alignment with normal industry practice
  • Provide concise explanations supporting judgements
  • Review technical, legal, financial, operational, or professional content for accuracy
  • Identify inaccurate standards, figures, regulations, assumptions, terminology, or constraints
  • Detect subtle domain-specific problems
  • Review consistency between instructions, supporting information, and completed outputs
  • Apply current professional judgement when assessing quality and correctness
  • Review existing yes/no grading decisions against completed work
  • Identify unsupported or inconsistent grading decisions and explain disagreements
  • Apply consistent standards across reviewed work products
  • Independently evaluate overall work-product quality and assign an appropriate quality band
  • Compare assessments with reported evaluation scores and identify inaccurate scores
  • Provide short, clear rationales for review decisions in precise business English
  • Distinguish material problems from minor presentation issues
  • Support judgements with relevant professional standards or practical experience
  • Complete approximately one hour of review work per item

Requirements

  • Substantial hands-on experience in one of the following areas: project management, law, accounting and audit, software development, or IT and information systems management
  • Project Management: 5+ years of experience running real project plans, schedules, and budgets
  • Project Management: Experience managing deliverables that teams actively worked against
  • Project Management: Strong understanding of professional project-management documentation and controls
  • PMP certification is advantageous but not required
  • Law: US-qualified lawyer in active practice
  • Law: 4+ years of post-admission experience
  • Law: Hands-on experience drafting legal documents
  • Law: Ability to evaluate legal accuracy, terminology, and professional work product
  • Accounting & Audit: 4+ years of professional experience
  • Accounting & Audit: Hands-on responsibility for financial close processes, audit files, or financial statements
  • Accounting & Audit: Strong knowledge of accounting and audit documentation
  • CPA or CA qualification is strongly preferred
  • Software Development: 3+ years of professional software development experience
  • Software Development: Experience shipping production code subsequently maintained by other engineers
  • Software Development: Ability to assess code quality, implementation decisions, and realistic development practices
  • Software Development: Previous experience conducting substantive code reviews is highly relevant
  • IT & Information Systems Management: 4+ years of professional experience owning an IT function
  • IT & Information Systems Management: Hands-on responsibility for budgets, vendors, systems, and operational decisions
  • IT & Information Systems Management: Experience producing or reviewing professional IT work products
  • IT & Information Systems Management: Strong understanding of real-world technology operations and management
  • Strong delivery history within the chosen profession
  • Experience reviewing junior or peer work is particularly valuable
  • Near-native business English
  • Ability to provide concise written explanations for professional judgements
  • Comfortable reviewing spreadsheets, PDFs, and related professional documents
  • Able to verify figures, calculations, and internal consistency
  • Substantial hands-on delivery experience; certification-based experience alone is less suited
  • Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
  • H1-B and STEM OPT support is unavailable for this engagement

Benefits

  • Part-time independent contractor engagement
  • Fully remote
  • Flexible scheduling based on project requirements
  • Projects may be extended, shortened, or concluded based on project needs and performance

Job title

Job type

Part Time

Experience level

Mid levelSenior

Salary

$60 - $75 per hour

Degree requirement

No Education Requirement

Tech skills

PMP

Location requirements

RemoteUnited States

Report this job

Found something wrong with the page? Please let us know by submitting a report below.