Back to opportunities
Managed by ExpertWoka
ExpertWoka Sourcing
Text Situated Alignment Specialist - High Cost
Posted 2026-11-17
View application options
Work Type
Remote
Location
United States, Canada, United Kingdom, Ireland, Belgium, Netherlands, Luxembourg, Switzerland, Austria, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Australia, New Zealand
Compensation
PPT rate: $155 per task
Number of Openings
100 openings
About this opportunity
Overview
ExpertWoka is sourcing Subject Matter Experts (SMEs) to support AI conversation evaluation research. In this short-term contract assignment, you will review conversations between participants and AI models, assess whether enough context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.
Responsibilities
- Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
- Identify missing context and recommend relevant follow-up questions.
- Evaluate whether additional information would have changed the AI’s recommendations.
- Distinguish between critical and non-essential information.
- Conduct qualitative reviews and document findings using structured evaluation guidelines.
- Collaborate with research teams to ensure consistent, high-quality assessments.
Requirements
- 3–5 years of direct practice experience in a relevant field.
- Experience in at least one of the following areas: social work, counseling, therapy, psychology, qualitative research, HCI, communication, mediation, coaching, student services, organizational consulting, or related advisory work.
- Must be based in the United States, Canada, the United Kingdom, Ireland, Belgium, the Netherlands, Luxembourg, Switzerland, Austria, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Australia, or New Zealand.
- Ability to work 20 or 40 hours per week depending on location.
- 4 hours of PST overlap required.
Qualifications
- Relevant professional qualification, credential, or equivalent advanced training in a related field.
- Experience with client assessment, case review, interviewing, counseling, qualitative research, or similar client-facing or research work.
Project Details
- Contractor assignment.
- Short-term project duration of 3 weeks.
- Start date: immediately.
- Pay-per-task engagement model.