Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Software Engineer evaluating AI-generated code, architecture, and reasoning for Gramian Consultancy. Creating coding problems and feedback to improve next-generation AI models.

Responsibilities

  • Evaluate AI-generated code for functional correctness, code quality, maintainability, and sound software design.
  • Create challenging coding problems, verified reference solutions, and comprehensive test cases.
  • Review AI reasoning on software architecture, debugging, algorithms, and system design.
  • Identify logical errors, inefficient implementations, edge cases, and architectural weaknesses.
  • Provide detailed technical feedback and explanations to help improve AI model performance.
  • Apply consistent evaluation criteria to ensure accurate and reliable assessments.

Requirements

  • At least 3 years of overall professional experience in Data Science or Software Engineering.
  • At least 1 year of professional experience at a leading technology, finance, or research company.
  • A bachelor’s degree in Data Science, Software Engineering, Computer Science, or a related field from a university in the United States, Canada, Australia, New Zealand, or the United Kingdom.
  • Strong programming and software engineering fundamentals.
  • Ability to evaluate code correctness, identify bugs, and assess software design decisions.
  • Strong analytical thinking and the ability to solve complex technical problems.
  • Excellent written English and the ability to communicate technical feedback clearly.

Job title

Job type

Contract

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

RemoteUnited States

Report this job

Found something wrong with the page? Please let us know by submitting a report below.