Senior engineer evaluating OpenAI Codex, Claude Code, and Cursor interactions. Providing rigorous written and video feedback on AI-assisted software engineering quality.
Responsibilities
Evaluate AI-generated coding interactions end to end
Judge whether outputs are useful, correct at a high level, and aligned with strong engineering judgment
Assess explanations and reasoning, not just code
Distinguish between different levels of response quality
Provide clear, opinionated written feedback on what worked, failed, or felt misleading
Help define what excellent interaction looks like for Cursor, Codex, and Claude Code
Record short video explanations of evaluations
Work on projects lasting approximately two weeks to a few months
Requirements
Senior, Staff, or Principal-level software engineer, or equivalent experience
Strong background in TypeScript/JavaScript or Python
Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor
Deep familiarity with modern AI-assisted development workflows
Ability to evaluate code without executing it or reviewing every line
Strong written and spoken English at B2 level or above
Comfortable giving direct, opinionated feedback
High standards for engineering quality
Nice to have: prior exposure to prompt design or evaluation workflows
Nice to have: experience mentoring senior engineers or defining engineering standards
Must complete a take-home evaluation exercise with a recorded Loom walkthrough
Simple background check required
Benefits
Flexible hours, 10–20 hours/week
Ongoing project opportunities for evaluators who perform well
Remote work worldwide, subject to regional client eligibility
Start as soon as the take-home is cleared and a project seat is available
Senior Software Developer building scalable, distributed network management software for Auvik, a cloud - based IT infrastructure platform. Designing microservices, Kubernetes deployments, Kafka systems, and reliable collector code.
Software Developer designing, testing, and maintaining secure applications for Multiview, an ERP and financial software company. Collaborating across teams and using AI coding agents to improve client - focused products.
AI Product Engineer building production agents, MCP integrations, and developer tools for ClickHouse’s open - source ClickStack observability platform. Improving incident investigation, telemetry analysis, and agent reliability.
Senior Software Developer delivering compliant multi - region applications and AWS infrastructure. Supporting MaintainX’s mobile - first work - execution platform for industrial and frontline teams.
Senior Software Engineer building Dentrix Ascend, Henry Schein One’s cloud - based dental practice management platform. Developing scalable Java services and improving reliability for US dental practices.
Fullstack developer building web applications, Cloud Native services, and back - end integrations at Mirego. Contributing to architecture, DevOps, AI - assisted development, and client solutions.
Senior CXE Engineer building Amazon Connect, Bedrock, and serverless contact - center solutions for Caylent. Delivering AI agents, migrations, analytics, and customer - facing implementations.
Senior Software Engineer building Snout’s veterinary wellness platform for clinics and pet owners. Developing full - stack features and operating reliable SaaS infrastructure.
Principal Software Engineer shaping Snout’s veterinary wellness platform, payments, and data systems. Leading architecture, full - stack development, DevOps, and cross - team engineering initiatives.
Staff Software Engineer defining architecture and shipping AI - powered products at Senpilot. Building intelligent systems that help utilities improve grid safety, resilience, and efficiency.