Role Overview

RWS TrainAI is seeking Generative Audio Evaluation Specialists to evaluate AI-generated audio and help identify performance issues. The work involves assessing audio created for short videos and text-to-audio tasks and providing feedback according to project guidelines.

Responsibilities

• Evaluate speech, background music, and sound effects for quality, clarity, and naturalness.

• Assess synchronization between generated audio and video, including lip-sync and timing.

• Check whether generated audio follows provided captions and task requirements.

• Evaluate voice naturalness and, where applicable, similarity to reference audio.

• Assign scores and identify issues according to evaluation guidelines.

Requirements

• Native-level fluency in Russian.

• Strong attention to detail and listening skills.

• Ability to follow detailed evaluation guidelines consistently.

• Good understanding of spoken language, audio quality, and context.

• Access to reliable equipment, including high-quality headphones.

• Ability to complete the evaluation test within 48 hours of receiving the assignment.

Qualification Process

1. Application

2. Screening Survey

3. Language Knowledge Assessments:

   • Russian

   • English

4. RWS Vendor Onboarding

5. Internal project testing, which may include TTS evaluation, audio evaluation, or transcription testing.