Role Overview

Welo Data is seeking an AI Data Quality & Annotation Specialist to help develop and evaluate large language models (LLMs). The role involves reviewing English-language content and assessing sentiment accuracy, factual consistency, and reasoning quality using structured guidelines.

Responsibilities

• Review and label content for sentiment, factual accuracy, and reasoning issues.

• Evaluate AI model outputs using structured scoring frameworks.

• Validate automated assessments and identify discrepancies or errors.

• Apply labeling standards consistently across tasks.

Requirements

• Advanced English proficiency in reading and writing.

• Professional-level English fluency.

• Strong comprehension and articulation skills.

• Ability to provide clear, well-reasoned written justifications.

• Previous experience in data annotation, AI training, or related projects.

• Exceptional attention to detail and accuracy.

• Strong analytical reasoning and critical thinking skills.

• Ability to make consistent decisions across high-volume tasks.

• Experience in linguistics, journalism, research, or similar analytical fields is preferred.

• Familiarity with AI systems, LLMs, or evaluation processes is preferred but not required.