About this opportunity
Job Description
Turing is hiring an experienced Art Domain Expert to help evaluate and improve Large Language Models (LLMs).
You’ll use your expertise across fine arts, visual arts, architecture, design, art history, museums, artists, and cultural traditions to create challenging prompts, evaluate AI-generated responses, identify knowledge gaps, and provide evidence-based feedback.
The role is suited to professionals with backgrounds in art research, academia, museums, galleries, curation, art criticism, education, publishing, or related cultural fields.
What You’ll Do
- Create advanced prompts covering fine arts, visual arts, architecture, design, art history, museums, and artists.
- Evaluate AI-generated answers for factual accuracy, reasoning, completeness, and nuance.
- Compare multiple AI responses and rank them based on quality.
- Identify hallucinations, logical inconsistencies, outdated information, and other errors.
- Explain why AI responses are correct or incorrect using reliable references.
- Develop benchmark datasets and challenging test cases.
- Identify ambiguous questions and improve their prompts.
- Provide structured, evidence-based feedback to help improve model performance.
- Maintain high standards for annotation quality and documentation.
Requirements
- Master’s degree or higher in any field.
- Degrees in Art History, Fine Arts, Visual Arts, Museum Studies, Cultural Studies, Design, Humanities, or related disciplines are preferred.
- Strong knowledge of major artists, artworks, art movements, styles, periods, techniques, museums, and cultural traditions.
- 3+ years of relevant professional experience, preferably in art research, academia, museums, galleries, curation, art criticism or journalism, education, publishing, or related fields.
- Excellent written English.
- Strong research and analytical skills.
- Excellent attention to factual, historical, artistic, and cultural accuracy.
- Ability to work independently and provide objective, evidence-backed evaluations.
Preferred Qualifications
- Experience with LLMs or Generative AI.
- AI evaluation or prompt engineering experience.
- Published research or professional recognition.
- Teaching or academic experience.
Application Process
- Complete the required assessment.
- Turing will review your submission.
- Selected candidates will be contacted regarding the next steps.