Software Engineer evaluating AI-generated code, architecture, and reasoning for Gramian Consultancy. Creating coding problems and feedback to improve next-generation AI models.
Responsibilities
Evaluate AI-generated code for functional correctness, code quality, maintainability, and sound software design.
Create challenging coding problems, verified reference solutions, and comprehensive test cases.
Review AI reasoning on software architecture, debugging, algorithms, and system design.
Identify logical errors, inefficient implementations, edge cases, and architectural weaknesses.
Provide detailed technical feedback and explanations to help improve AI model performance.
Apply consistent evaluation criteria to ensure accurate and reliable assessments.
Requirements
At least 3 years of overall professional experience in Data Science or Software Engineering.
At least 1 year of professional experience at a leading technology, finance, or research company.
A bachelor’s degree in Data Science, Software Engineering, Computer Science, or a related field from a university in the United States, Canada, Australia, New Zealand, or the United Kingdom.
Strong programming and software engineering fundamentals.
Ability to evaluate code correctness, identify bugs, and assess software design decisions.
Strong analytical thinking and the ability to solve complex technical problems.
Excellent written English and the ability to communicate technical feedback clearly.
AI Engineer embedding LLMs, RAG, and automation into KidKare’s configurable childcare SaaS platforms. Accelerating engineering delivery across legacy systems and development teams.
CAD Engineer training and evaluating AI agents inside real CAD environments. Designing simulation - ready geometry and judging long engineering task solutions for a global platform.
Freelance Mechanical CFD Engineer training AI agents through CAD - based fluid simulations. Building verified reference solutions and Python checks for a global technology platform.
Forward Deployed Engineer deploying Scopic’s SOC for AI platform for enterprise security and compliance. Building Python workflows, integrating MCPs, and leading client implementations.
Freelance Mechanical CAD and Simulation Engineer training AI agents in real CAD environments. Designing geometry, building reference solutions, and evaluating engineering tasks for a global platform.
CFD Engineer training and evaluating AI agents on expert - level fluid simulations. Building verified solutions from CAD geometry and writing Python checks for a global technology platform.
VP of AI Engineering guiding Wonderly’s engineering organization and AI - native software factory. Building internal tools and production systems that help Main Street businesses grow profitably.
Data & AI Lead building Regenified’s regenerative agriculture data platform. Developing Snowflake and dbt pipelines, integrations, analytics, and AI tools for food supply chains.
AI Engineer building generative and agentic AI solutions for Trillium Health Partners’ hospital workflows. Connecting intelligent agents to clinical systems and scaling responsible healthcare automation.
Staff AI Developer building generative AI, ML pipelines, and agentic systems for Arctic Wolf’s cybersecurity platform. Shipping secure, production - grade AI features that reduce cyber risk.