Work Type
Remote
Location
Albania, Algeria, Andorra, Angola, Antigua and Barbuda, Argentina, Bahamas, Bahrain, Barbados, Belize, Bosnia and Herzegovina, Botswana, Brazil, Brunei, Bulgaria, Chile, Colombia, Costa Rica, Croatia, Cyprus, Czechia, Cote d'Ivoire, Dominica, Dominican Republic, Ecuador, Estonia, Fiji, Gabon, Georgia, Greece, Grenada, Guyana, Hungary, Jordan, Kiribati, Kuwait, Latvia, Lithuania, Malaysia, Maldives, Malta, Marshall Islands, Mauritius, Mexico, Micronesia, Montenegro, Morocco, Namibia, Nauru, North Macedonia, Oman, Palau, Poland, Qatar, Romania, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Samoa, San Marino, Serbia, Seychelles, Slovakia, Slovenia, Suriname, Trinidad and Tobago, Tunisia, Turkey, Turkmenistan, Tuvalu, Uruguay, Uzbekistan, Vanuatu
Compensation
PPT Rate: $30 per task; AHT: 75 minutes
About this opportunity
Overview
ExpertWoka is seeking Subject Matter Experts to support AI conversation evaluation research. In this contractor assignment, you will review conversations between people and AI models, assess whether enough context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.
What You'll Do
- Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
- Identify missing context and suggest relevant follow-up questions.
- Evaluate whether additional information would have changed the AI’s recommendations.
- Distinguish between critical context and non-essential information.
- Conduct qualitative reviews and document findings using structured evaluation guidelines.
- Collaborate with research teams to maintain consistent, high-quality assessments.
Requirements
- 3–5 years of direct practice experience in a relevant field.
- Professional experience in at least one of the following areas: licensed social work, counseling/therapy/psychology, qualitative research/HCI/communication, or mediation/coaching/student services/organizational consulting/advisory work.
- Relevant qualification, credential, or demonstrated subject-matter expertise in the selected domain.
- Ability to gather context, identify missing information, and provide informed recommendations.
- Must be based in one of the eligible regions listed for this project.
Project Details
- Contractor assignment; no medical or paid leave.
- Estimated start date: October 1.
- Engagement length: 3 weeks.
- Full-time commitment required: 40 hours per week.
- Pay-per-task structure with an approximate AHT of 75 minutes per task.
Evaluation Process
Applicants will be reviewed via profile review and interview scheduling as part of the selection process.
