AI Quality Analyst (Personalization) -Japanese

About the Role

Turing is hiring Japanese-speaking AI Quality Analysts to evaluate a new personalization feature for Gemini.

You’ll design multi-turn prompts based on personal context and evaluate how effectively the model uses information from sources such as previous Gemini conversations, Gmail, Google Search, and YouTube activity.

What You’ll Do

• Design and execute multi-turn conversational prompts, typically 1–5 turns.
• Evaluate personalized AI responses for grounding, integration and helpfulness.
• Compare two model responses side-by-side and determine which performs better.
• Identify incorrect personalization, unsupported assumptions and unnatural use of personal information.
• Write clear rationales explaining your evaluations and rankings.
• Verify whether relevant personal data sources were correctly used.
• Provide detailed annotations and constructive feedback.

Requirements

• Strong Japanese reading and writing proficiency.
• Strong analytical and written communication skills.
• Ability to evaluate nuanced AI-generated responses.
• Excellent attention to detail.
• Comfortable working independently in a remote environment.
• Desktop/laptop and reliable internet connection.
• Willingness to use a primary personal Google account and enable relevant personal data sources for evaluation.
• Bachelor’s degree or equivalent experience in a relevant analytical field.
• Previous experience in AI evaluation, data annotation, content moderation or similar work is strongly preferred.

Time Commitment

• At least 4 hours per day
• Up to 20 hours per week
• Requires 4 hours of overlap with PST

Contract Details

• Contractor role
• 3-month engagement
• $15/hour

Application Process
Shortlisted candidates will receive a Job Interest Form. After profile review, selected applicants will receive an assessment that must be completed within 24 hours. Successful candidates will then be contacted regarding pre-onboarding requirements.