English Quality Assurance Lead

Overview

SME Careers, a subsidiary of SuperAnnotate, is looking for an English Quality Assurance Lead (QAL) for an hourly, remote contractor role paying up to $35/hr. The role focuses on quality oversight across AI training projects, with an emphasis on consistency, trainer performance, and clear evaluation standards. Interview language is English. There is no immediate project for this role, but qualified candidates may be among the first contacted for relevant future opportunities through the expert network.

The selection process includes an AI interview, a domain-specific task, and an interview with a recruiter.

What You'll Do

• Review AI-generated English content and trainer/QA work against project guidelines and rubrics.
• Check for accuracy, clarity, reasoning quality, grammar, tone, formatting, and instruction-following.
• Provide precise written feedback and ongoing quality guidance to contributors.
• Identify recurring issues and escalate critical or repeated quality problems.
• Communicate project updates, expectations, and workflow changes to trainers and QAs, especially through Discord.
• Respond to contributor questions and explain instructions, edge cases, and rubric details clearly.
• Support contributor activation by following up with inactive team members and tracking availability issues.
• Maintain project documentation such as style guides, FAQs, trackers, onboarding materials, examples, honeypots, and quality notes.
• Schedule and run onboarding or training calls to align trainers and QAs on project standards.
• Recommend process improvements to strengthen scalable QA workflows for future projects.

Requirements

• Bachelor’s or Master’s degree in English, Linguistics, Communications, Journalism, Education, AI/Data Annotation, Quality Assurance, or a related field.
• Strong command of English, including grammar, clarity, tone, register, structure, and written feedback quality.
• At least 3 years of professional experience in quality assurance, editing, content review, AI training, education, annotation, localization QA, or similar review workflows.
• Experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QAs is strongly preferred.
• Ability to evaluate work against detailed rubrics, identify quality gaps, and explain issues constructively.
• Comfort working in fast-moving remote environments with tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Strong organization skills for managing documentation, onboarding materials, and follow-ups across time zones.
• Reliability and self-direction in handling activations, escalations, and quality checks.

Preferred Experience

• Experience with AI training, data annotation, large language models, prompt/response evaluation, or rubric-based LLM QA.

Skills

• English Quality Assurance
• Content Review
• QA Operations
• Trainer Feedback
• LLM Evaluation
• Documentation
• Onboarding & Training
• Discord Communication