Data Analyst (AI Evaluation)

Overview

micro1 is seeking 30 Data Analysts to support a customer data quality project focused on AI evaluation. This contractor role is remote and US-based. The work involves reviewing data and task outputs, applying evaluation criteria consistently, and helping improve how AI systems learn from real-world input. No prior AI experience is required, but strong domain knowledge and careful analytical judgment are important.

What You'll Do

• Review datasets and detailed task outputs for accuracy, completeness, and alignment with instructions.
• Identify errors, inconsistencies, and outputs that do not follow the provided guidelines.
• Apply structured rubrics and evaluation standards consistently across large sets of data.
• Use sound judgment and document your reasoning when instructions are unclear or incomplete.
• Escalate recurring issues or patterns in the data for further review instead of handling each one individually.
• Provide clear written and verbal feedback that explains issues and suggests practical next steps.
• Maintain a high level of precision while working through repetitive, high-volume review tasks.

Preferred Qualifications

• 3–5+ years of experience in data review, data quality, quality assurance, or analytical work.
• Experience reviewing, validating, and critiquing data or deliverables against explicit criteria.
• Ability to follow detailed written instructions and apply complex evaluation rubrics accurately.
• Comfort making justifiable decisions in ambiguous situations.
• Strong error-spotting skills and close attention to detail in repetitive work.
• Strong written and verbal communication skills for documenting findings and feedback.
• Basic spreadsheet fluency, including sorting, filtering, and simple formulas; SQL or hands-on data querying is a plus.
• Experience with data annotation, labeling, or rubric-based evaluation is a plus.