AI Safety Red Teamer stress - testing Mercor’s frontier AI models. Identifying vulnerabilities, jailbreaks, hallucinations, and policy failures through adversarial evaluation.
About the role
- Evaluating AI outputs related to automotive engineering and mobility systems. Performing structured evaluation tasks and collaborating with teams to enhance AI models.
Responsibilities
- Evaluate AI outputs related to automotive engineering, vehicles, and mobility topics
- Perform structured scoring, comparison, classification, and judgment tasks
- Assess technical accuracy, safety considerations, clarity, and alignment with automotive standards
- Identify hallucinations, unsafe guidance, incorrect specifications, or misleading automotive information
- Apply domain-specific automotive guidelines consistently across tasks
- Validate and refine evaluation rubrics and edge-case handling
- Perform adjudication where raters disagree
- Conduct error analysis and qualitative reviews of model behavior
- Partner with teams on evaluation design
- Support red-teaming, safety analysis, and model readiness assessments
Requirements
- Automotive engineers, manufacturing specialists, vehicle systems professionals, or mobility practitioners
- Experience with vehicle systems, automotive manufacturing, maintenance, or mobility technologies
- Strong attention to detail and comfort working with structured evaluation criteria
- Native or professional fluency in one or more supported languages is required
- English fluency is required for guidelines, feedback, and collaboration.
Benefits
- .
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
AVP leading AI transformation, including fraud detection, for Manulife, a global financial services provider. Driving secure, governed Classical, Generative, and Agentic AI solutions across Corporate Functions.
Generative AI Analyst validating Canadian French translations for Welo Data, a global AI data company. Reviewing and annotating multilingual AI - generated content for training and quality improvement.
Senior engineers evaluating AI coding - agent interactions for G2i. Assessing reasoning, explanations, outputs, and engineering judgment across Codex, Claude Code, and Cursor.
Manager integrating workforce management with AI transformation at TD, a major North American bank. Connecting financial, operational, and workforce planning across customer operations.
Search +AI Discovery Manager leading enterprise SEO, AI - search strategy, and client advisory for dentsu, a global integrated marketing agency. Mentoring North American SEO teams and shaping innovative search methodologies.
Director leading Homebase’s data engineering, data science, and applied AI teams. Building trusted data infrastructure and AI - powered tools for 150,000+ small businesses.
AI Solution Specialist helping greenhouse growers adopt Source.ag’s AI - powered crop technology. Building dashboards, automations, and custom tools while translating greenhouse insights into product improvements.
Senior Advisor designing and integrating generative AI solutions for Desjardins, North America’s largest cooperative financial group. Driving adoption through training, change management and scalable AI practices.
Strategy and management consultant creating complex business scenarios and evaluating AI outputs. Supporting Gramian Consultancy’s IT talent solutions through rigorous consulting analysis and executive deliverables.