Evaluating and optimizing the performance of audio models for customer support scenarios. Create role-play scenarios and evaluate service interactions across various domains.
Responsibilities
Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains
Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
Evaluate model performance across a standardized set of qualitative and quantitative metrics.
Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Requirements
Strong fluency in English
Strong verbal communication skills in a simulated customer support context
Spanish proficiency including fluency across all language skills: reading, listening, writing, and speaking.
Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
Comfort working with structured prompts, evaluation rubrics, and technical guidelines
Device capable of running audio recording software and opening large technical documentation
Benefits
Company-sponsored benefits such as health insurance and PTO do not apply
Operations Manager enhancing operational processes and systems for Big Viking Games, a Canadian gaming company. Focused on improving workflows and implementing AI in daily operations.
Director leading Cint’s enterprise AI transformation office driving measurable business value. Overseeing AI strategy and roadmap while managing high - impact teams and complex workflows.
Director of Enterprise AI Transformation at Cint leading AI - enabled operational change. Focused on measurable business value and managing AI transformation portfolio.
Director of AI Transformation leading enterprise AI initiatives at Cint to drive operational change and measurable business value. Collaborating with global teams to optimize AI workflows and governance frameworks.
AI Governance Advisor at Mila responsible for developing governance training programs and facilitating community of practice. Engaging with executive audiences in workshops and tailored programs.
Senior Cloud & AI Administrator responsible for Azure and Microsoft 365 services, implementing AI solutions. Ensuring security, scalability, modernization, and business outcomes through hands - on delivery.
Executive leader transforming ABC Fitness's Customer Support leveraging AI and new operational strategies. Responsible for driving enterprise - wide change and overseeing customer experience enhancements.
Bilingual AI Training & Business Transformation Specialist teaching AI training sessions for students and employers. Leading facilitation of hands - on AI projects and coaching in a remote setting.
AI Consultant/Freelancer supporting two AI pilots for learning programs at Venture for Canada. Providing strategic AI guidance and implementation support in a nonprofit context.
Senior Business Consultant focusing on AI solutions for digital transformation. Leading consulting projects to optimize business processes and drive adoption of NICE software solutions.