Senior software engineers designing and evaluating real-world coding tasks for Mercor’s AI research lab partners. Training frontier models with expert software engineering judgment.
Responsibilities
Design realistic, challenging software engineering tasks based on real-world work
Create tasks involving feature changes, debugging, root-cause analysis, code review, system design, architecture decisions, codebase Q&A, and technical documentation and planning
Write clear task proposals explaining realism, verification, and difficulty for current AI models
Write reference solutions, tests, and precise task-specific criteria covering correctness, architecture, maintainability, style, and scope
Assess AI-generated code and engineering work
Work alongside AI coding agents to evaluate where they succeed and fail
Apply consistent, evidence-based judgment so assessments are reproducible and defensible
Receive structured feedback from senior reviewers and iterate on submitted work
Train and evaluate frontier AI models for real-world software engineering work
Requirements
4+ years of professional software engineering experience in a qualifying technology, quantitative, financial, or high-growth technology company setting
Experience at a leading technology or quantitative firm, top financial institution, or high-growth household-name technology company
Mid-senior or senior-level title where specified
Machine Learning, Infrastructure, Data, Security, or Quant Developer engineering experience may qualify
Strong command of at least one major language such as Python, Java, C++, Go, TypeScript, or Rust
System design, testing, debugging, and code review skills
Experience working in large, complex production codebases
Ability to judge code quality beyond whether tests pass
Excellent written English and ability to explain technical decisions and trade-offs clearly
Bachelor's degree from an English-speaking country
Detail-oriented and consistent approach to evaluating complex work
Comfortable receiving feedback and calibrating judgment against set standards
Must be based in the United States, United Kingdom, Canada, Australia, or New Zealand
H1-B and STEM OPT candidates are not supported
Benefits
Fully remote role
Flexible own schedule
Weekly payments via Stripe or Wise
Competitive pay
Collaboration with leading researchers
Projects may be extended, shortened, or concluded early depending on needs and performance
Senior Staff Software Engineer shaping AI, risk, fraud, and operational systems at Priority Commerce. Defining scalable distributed - systems architecture across engineering domains.
Software Development Engineer in Test II developing automated tests and CI/CD pipelines for Akamai’s Kubernetes cloud platform. Validating scalable cloud - native services and improving reliability, security, and performance.
Senior Full Stack Developer building AI - driven .NET and frontend software for XTM’s enterprise translation platform. Leading automation, MCP, and AI - assisted development practices across the Montréal engineering team.
Full Stack Java Engineer building Java, React, and cloud - native applications for Miratech’s WFM and CX clients. Developing APIs, microservices, integrations, and CI/CD pipelines.
Ingénieure senior concevant et coordonnant des équipements de mécanique lourde pour les projets hydroélectriques d’EXP. Supervision technique, visites de chantier et accompagnement d’équipes multidisciplinaires.
Staff Frontend Engineer shaping Affirm’s buy - now - pay - later checkout experience. Setting technical direction and improving React/Vue - based core checkout flows.
Staff Frontend Engineer setting technical direction for Affirm’s checkout orchestration. Leading React/Vue architecture, operational excellence, and high - quality customer payment experiences.
Full Stack Architect designing scalable, compliant banking technology for TD’s onboarding, customer management, and advice experiences. Driving API - first architecture, integration, reliability, and modernization across digital and branch channels.
Tech Lead developing secure cloud applications and middleware for Genpact’s AI and digital transformation solutions. Managing Python automation, Kubernetes, CI/CD, observability, and cloud platforms.