Leading North American Supply Chain & Engineering Advisory architecture and growth for Avanade’s Microsoft consulting business. Driving Smart Factory, Factory OS, Azure, data and AI adoption.
About the role
- Senior engineer evaluating AI coding agents for G2i’s AI training projects. Providing rigorous written and video feedback on reasoning, explanations, and engineering judgment.
Responsibilities
- Evaluate AI-generated coding interactions end to end
- Judge whether outputs are useful, correct at a high level, and aligned with strong engineering judgment
- Assess the quality of explanations and reasoning, not just the code
- Distinguish between different levels of response quality
- Provide clear, opinionated written feedback on what worked, what did not, and what felt misleading
- Help define what great looks like for tools such as Cursor, Codex and Claude Code
- Record short video explanations of evaluations
Requirements
- Senior, Staff or Principal-level engineer (or equivalent experience)
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with at least one of OpenAI Codex, Claude Code or Cursor
- Deep familiarity with modern AI-assisted development workflows
- Ability to evaluate code without executing it or reviewing every line
- Strong written and spoken English (B2 or above)
- Comfortable giving direct, opinionated feedback
- High standards for engineering quality
- Prior exposure to prompt design or evaluation workflows (nice to have)
- Experience mentoring senior engineers or defining engineering standards (nice to have)
- Must complete a take-home evaluation exercise with a recorded Loom walkthrough
- Must agree to a simple background check for the project
Benefits
- Flexible hours, 10–20 hours/week
- Ongoing project opportunities for evaluators who perform well
- Projects ranging from about two weeks to a few months
- Start as soon as the take-home is cleared and a project has an open seat
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Backend Engineer building distributed data - ingestion integrations for ClickHouse Cloud. Improving scalable, fault - tolerant pipelines across streaming platforms and cloud storage.
Boomi Integration Architect designing governed enterprise integrations for Argano’s digital consultancy. Leading Boomi architecture, APIs, data transformation, security, and delivery across US and Canadian remote teams.
Senior Staff Engineer architecting Affirm’s EKS and Kubernetes compute platform. Building secure, reliable infrastructure for Affirm’s global buy - now - pay - later financial products.
Backend Engineer designing production - ready APIs, data models, and integrations for Blockvora’s secure Web3 and blockchain products. Building reliable services with Node.js, Rust, Go, Java, Python, or Ruby.
Back - end/DevOps developer building innovative digital products and Cloud Native infrastructure at Mirego. Owning CI/CD, Infrastructure as Code, observability, security, and client - facing technical guidance.
Senior Backend Engineer designing Python APIs, event - driven systems, and microservices for Bespoke Metrics' construction technology platform. Collaborating across engineering teams while improving code quality and technical debt.
Staff Backend Engineer leading telemetry architecture and observability at Affirm, a buy - now - pay - later company. Improving distributed - system reliability, cost efficiency and AI - assisted development practices.
Staff Backend Engineer owning Java and Python backend systems for Hatch’s sleep wellness apps and IoT devices. Leading architecture, reliability, observability, and engineering scale.
Senior software engineer building Python/Golang Kubernetes operators and addons for Canonical, publisher of Ubuntu and open - source software. Remote role serving global enterprise technology markets.