Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • AI conversation evaluator helping Gramian, an IT talent consultancy, improve recommendation quality. Reviewing interpersonal scenarios and identifying missing context through structured qualitative analysis.

Responsibilities

  • Review AI conversations involving real-world interpersonal situations and everyday decision-making
  • Identify missing context and recommend relevant follow-up questions to improve AI responses
  • Evaluate whether additional information would materially change an AI-generated recommendation
  • Distinguish load-bearing information affecting a decision from non-essential or descriptive details
  • Conduct qualitative reviews and document findings using structured evaluation guidelines
  • Assess whether conversations consider relevant personal, psychological, social, financial, practical, and organizational factors
  • Identify missed opportunities for clarification, deeper understanding, and information gathering
  • Review conversations involving relationships, work, education, family, wellbeing, planning, and resource constraints
  • Collaborate with research teams to ensure consistent, evidence-based assessments
  • Maintain accuracy, clarity, and consistency while meeting project deadlines

Requirements

  • At least 3–5 years of relevant direct professional experience in one or more listed domains
  • Licensed Social Work pathway: Master's degree in Social Work (MSW) or an equivalent graduate-level qualification
  • Licensed Social Work pathway: LCSW, LICSW, LMSW, or an equivalent applicable social work license or credential
  • Experience in client assessment, case review, interviewing, counseling, or related social-work practice
  • Counseling, Therapy, or Psychology pathway: Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy license or credential; or PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
  • Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work
  • Qualitative Research, HCI, or Communication pathway: MA, PhD, or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline
  • Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding
  • Ability to analyze conversations systematically and identify missing context, communication patterns, and opportunities for clarification
  • Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: relevant professional qualification, credential, or demonstrated subject-matter expertise
  • At least 5 years of direct advisory or client-facing experience for candidates qualifying through this pathway
  • Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work
  • Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations

Job type

Full Time

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Professional Certificate

Location requirements

RemoteUnited States

Report this job

Found something wrong with the page? Please let us know by submitting a report below.