Evaluating AI outputs related to automotive engineering and mobility systems. Performing structured evaluation tasks and collaborating with teams to enhance AI models.
Responsibilities
Evaluate AI outputs related to automotive engineering, vehicles, and mobility topics
Perform structured scoring, comparison, classification, and judgment tasks
Assess technical accuracy, safety considerations, clarity, and alignment with automotive standards
Identify hallucinations, unsafe guidance, incorrect specifications, or misleading automotive information
Apply domain-specific automotive guidelines consistently across tasks
Validate and refine evaluation rubrics and edge-case handling
Perform adjudication where raters disagree
Conduct error analysis and qualitative reviews of model behavior
Partner with teams on evaluation design
Support red-teaming, safety analysis, and model readiness assessments
Requirements
Automotive engineers, manufacturing specialists, vehicle systems professionals, or mobility practitioners
Experience with vehicle systems, automotive manufacturing, maintenance, or mobility technologies
Strong attention to detail and comfort working with structured evaluation criteria
Native or professional fluency in one or more supported languages is required
English fluency is required for guidelines, feedback, and collaboration.
Administrateur IA assurant la gouvernance, la sécurité et les opérations de Microsoft 365 Copilot chez EDC. Soutien de l’IA d’entreprise pour aider les entreprises canadiennes à réussir à l’étranger.
AI Administrator managing Microsoft 365 Copilot, Entra ID, and AI governance for Export Development Canada. Supporting secure enterprise AI adoption across Ottawa, Toronto, or Montreal.
Generative AI Artist creating AI - driven visuals, sequences, and previs for Rodeo FX’s visual - effects and advertising productions. Building ComfyUI workflows and collaborating with compositing, 3D, and art - direction teams.
AI transformation leader selling and delivering enterprise change consulting at Prosci. Building AI prototypes, guiding organizational change, and growing executive client accounts.
Mila AI Safety research intern developing public - safety guardrails, benchmarking, and model evaluations. Collaborating with researchers and compute teams on applied machine - learning research in Montréal.
AI products lead building GenAI - powered communications surveillance and compliance products at RBC Capital Markets. Leading full - stack engineering, AI agents, and production delivery.
UNESCO consultant analyzing learning assessment data with AI - assisted methods. Developing policy insights, reproducible protocols, and national analyst capacity.
AI Enablement Lead building training, curriculum and metrics for Valtech’s AI - native digital experience consultancy. Enabling practitioners, new hires and teams through AI - native SDLC transformation.
Marketing Specialist advancing AI - powered content, automation, SEO, and analytics for EverCommerce’s EMHware and GoodTherapy healthcare platforms. Improving campaign performance and adoption across Canada.
Senior AI sales executive commercializing agentic AI solutions for grocery retailers at Instacart. Building pricing, partnerships, and enterprise deal processes.