About this opportunity
Job Description
Turing is hiring TV Shows & Movies Domain Experts in the United States to help evaluate and improve Large Language Models (LLMs).
The role is designed for professionals with strong knowledge of movies, television, streaming, actors, directors, genres, awards, franchises, and entertainment history. You’ll create challenging prompts, evaluate AI-generated answers, identify factual and reasoning errors, and provide evidence-backed feedback to improve model performance.
What You’ll Do
- Create challenging prompts covering movies, television, streaming, actors, directors, creators, genres, awards, and entertainment history.
- Evaluate AI responses for factual accuracy, reasoning, completeness, and nuance.
- Compare and rank multiple AI-generated responses.
- Identify hallucinations, outdated information, logical inconsistencies, and knowledge gaps.
- Develop benchmark questions and adversarial test cases.
- Research and provide reliable references to support evaluation decisions.
- Identify ambiguous questions and improve prompt quality.
- Maintain consistent annotation and evaluation standards.
- Collaborate with AI researchers to improve model performance.
Requirements
- Master’s degree or higher in any field.
- Degrees in Film Studies, Television Studies, Media Studies, Journalism, Communications, English/Literature, Screen Studies, or related disciplines are preferred.
- Strong knowledge of movies, TV series, actors, directors, creators, streaming platforms, franchises, genres, awards, and entertainment history.
- 3+ years of relevant professional experience, preferably in entertainment journalism, film/TV criticism, content creation, research, reporting, analysis, or related work.
- Excellent written English and research skills.
- Strong analytical and fact-checking abilities.
- Excellent attention to detail.
Preferred Qualifications
- Experience with LLMs or Generative AI.
- AI evaluation or prompt engineering experience.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to conduct independent research and provide objective, evidence-backed evaluations.
Application Process
Candidates will complete an assessment provided by Turing. Submissions will be evaluated, and selected applicants will be contacted regarding the next steps.