Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • AI Workflow Analyst at Sophie Society creating test cases and ensuring AI outputs are accurate for Amazon tasks. Responsible for testing and approving AI outputs before they go live.

Responsibilities

  • Create test cases from real Amazon data (search term reports, campaigns, listings)
  • Run AI tools and review the outputs
  • Check for: - Wrong keyword classification - Bad campaign structure decisions - Missing or incorrect insights - Hallucinated data
  • Write simple scoring criteria to evaluate outputs
  • Identify what’s causing issues (prompt, input data, or model)
  • Work with the builder to fix and improve results
  • Approve or block tools before they go live

Requirements

  • Strong hands-on use of ChatGPT and Claude
  • Ability to write clear prompts and improve them through testing
  • Strong attention to detail (you catch errors others miss)
  • Clear, structured writing
  • Comfortable with: - Git, Markdown, YAML - Reading basic Python or TypeScript

Benefits

  • Fully remote, comfortable work environment — work from anywhere

Job type

Full Time

Experience level

Mid levelSenior

Salary

$35,000 - $60,000 per year

Degree requirement

Bachelor's Degree

Tech skills

PythonTypeScript

Location requirements

RemoteNorth America

Report this job

Found something wrong with the page? Please let us know by submitting a report below.