Job Description

Productive Playhouse is building a talent pool of Afrikaans speakers for an upcoming project evaluating AI chatbots. Evaluators will interact directly with AI models, assess their responses, and provide feedback that helps improve the quality, safety, and helpfulness of generative AI systems.

This is a talent-pool opportunity, meaning applicants can apply once and may be contacted for this and future projects that match their language skills.

What You’ll Do

• Test and evaluate AI chatbots through structured conversations.
• Follow assigned goals and prompts when interacting with AI models.
• Evaluate AI responses for quality, safety, and helpfulness.
• Participate in voice-based AI evaluation tasks when required.
• Submit ratings, written feedback, screenshots, recordings, or other project deliverables.
• Follow project-specific guidelines and requirements.

Requirements

• Native or expert-level fluency in Afrikaans as spoken in South Africa.
• Strong English reading, writing, and communication skills.
• At least 18 years old.
• Hands-on experience using AI models or large language models.
• Comfortable with written and voice-based conversations.
• Own smartphone and computer with reliable internet access.
• Ability to pass language proficiency and technical literacy assessments.
• Able to start within 48 hours.
• Strong communication and responsiveness.