Work Type
Remote
Location
France
Compensation
$25/hour
About this opportunity
Overview
iMerit is looking for detail-oriented analysts to evaluate and rank AI-generated responses to text-based prompts. This independent contractor role is part of the Operations team, is fully remote, and is posted for candidates in France. The project duration is 3 weeks, and the language noted for the role is French.
What You'll Do
- Review images together with the prompts and responses attached to them.
- Assess responses using criteria such as accuracy, relevance, clarity, conciseness, safety, localization, and instruction-following.
- Compare multiple responses and rank them against defined evaluation standards.
- Check whether descriptions and claims about an image actually match what is visible.
- Verify factual claims using approved research sources.
- Flag tasks that cannot be evaluated reliably.
- Write clear, written justifications for each ranking you submit.
Requirements
- Strong attention to visual detail and the patience to review material carefully.
- Critical thinking, research skills, and reading comprehension.
- Sound judgment and the ability to make well-supported decisions.
- Professional written English, including the ability to describe visual details precisely.
- Consistency in applying detailed guidelines task after task.
- Experience in image annotation, content review, editing, research, design, or localization is welcome but not required.
- A device and internet connection capable of displaying images comfortably.
- Completion of a paid qualification assessment before live work begins.
Engagement Details
- Independent contractor engagement for the duration of the project.
- Flexible scheduling around agreed deadlines.
- Task volume varies with project demand.
