Senior Software Engineer building Homebase’s scheduling, HR, and payroll products for small businesses. Shipping reliable features and leading end - to - end engineering projects.
About the role
- Software Engineering Evaluator assessing AI-generated code for correctness, security, performance, and subtle defects. Remote hourly contract supporting leading AI research organizations.
Responsibilities
- Design task-specific grading criteria for feature implementations, bug fixes, refactors, tests, and code reviews
- Evaluate AI-generated code for correctness, including failures that pass the code's own tests
- Assess edge-case handling, security, performance, and readability in coding deliverables
- Write clear, evidence-based justifications for every evaluation score
- Apply consistent judgment across software engineering evaluation tasks
- Review code that may appear correct and run without failing while identifying subtle defects
- Reason through ambiguity and distinguish clearly between known facts and inferences during evaluations
- Iterate on evaluation work based on feedback from senior reviewers
Requirements
- 2–3 years of professional software engineering experience shipping production code
- Strong command of at least one of Python, JavaScript/TypeScript, Java, Go, C++, C#, or a comparable language
- Solid grounding in data structures, algorithms, testing, debugging, and version control
- Experience reviewing other engineers' code
- Excellent written English
- Ability to follow complex instructions, reason through ambiguity, and spot subtle errors in code that looks correct and runs without failing
- Ability to clearly separate what you know from what you are inferring
- Ability to work independently, learn new tools quickly, and take feedback well
- Based in and working from the US, Canada, or UK
- Available for 10+ hours per week for the full 12 weeks
Benefits
- Paid weekly via Stripe or Wise
- Remote work on your own schedule within the 10+ hour weekly engagement
- Initial 12-week contract with the possibility that projects may be extended based on needs and performance
- Opportunity to evaluate AI systems for leading AI research organizations
- Reasonable accommodations available upon request
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior backend engineer building Instacart’s grocery fulfillment and logistics platform. Designing scalable systems for routing, shopper task allocation, fulfillment tracking, and compensation.
Node.js engineer developing Tether’s peer - to - peer stack and expanding its modular npm ecosystem. Building production - scale software for Tether’s global digital - finance and communications products.
Node.js engineer developing Tether’s P2P stack and expanding its 1,500+ npm - module ecosystem. Building modular software for Tether’s global blockchain and digital - finance products.
Staff engineer shaping agentic software development workflows and shared Go tooling. Building AI - native platforms for CircleCI, the global continuous integration and delivery platform.
Software Engineer building AI agents, lifecycle automation and referral features for Total Life, a telehealth company serving older adults. Improving patient conversion, retention and care workflows.
Full Stack Engineer building Souk’s scalable digital marketplace connecting buyers and sellers worldwide. Developing front - end, back - end, and AI - agent capabilities for seamless user experiences.
VP leading software engineering strategy, AI - enabled development, and large - scale teams at Photonic, a quantum computing company. Driving software - hardware co - development from research to scalable systems.
Full Stack Software Developer building software for GHD’s engineering and environmental specialists. Delivering full - stack solutions, shaping requirements, and collaborating across digital transformation projects.
Fullstack Software Engineer building end - to - end product features for WorkWhile’s AI - powered labor - market platform. Leading projects, shaping systems, and mentoring teammates in a hybrid Toronto team.