AI Product Evaluator

Overview

micro1 is seeking AI Product Evaluators for a customer project with 100 openings. This is a contractor role for remote work from India, Japan, or the United Kingdom. The work involves contributing to AI model and agent evaluation efforts within an operationally intensive project environment, including tasks that may need to be completed within strict timeframes and usage limit reset cycles.

Scope of Work

• Evaluate AI models and AI agents against detailed scenarios and project guidelines.
• Carry out operational test tasks to assess model accuracy, reasoning, and responsiveness.
• Write structured reports capturing findings, observations, and anomalies.
• Reset usage limits and repeat evaluations according to project protocols.
• Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
• Maintain strong attention to detail and rigor throughout all evaluation work.

Preferred Qualifications

• Experience evaluating or testing AI products, AI models, or AI agents.
• Ability to follow complex instructions accurately and consistently.
• Strong attention to detail and operational thoroughness.
• Daily use of AI tools is preferred.
• Comfort with repetitive, high-volume tasks under strict time constraints.
• Prior experience in digital product testing, software QA, or AI research is a plus.
• Careful documentation habits and step-by-step execution.