Philosophy Quality Assurance Lead (QAL)

Overview

SME Careers is seeking a Philosophy Quality Assurance Lead (QAL) for an hourly, remote contractor role supporting philosophy-focused AI training projects. This position is intended to help maintain quality, consistency, and reviewer performance across future opportunities in the expert network. The selection process includes an AI interview, a domain-specific task, and an interview with a recruiter.

There is no immediate project attached to this role; qualified candidates may be among the first contacted when relevant work becomes available.

What You'll Do

• Review AI-generated philosophy content and QA/trainer work for quality and alignment with project rubrics.
• Assess conceptual accuracy, argument structure, logical validity, philosophical context, interpretation quality, clarity, nuance, formatting, and instruction-following.
• Provide clear written feedback and surface recurring issues to trainers and QAs.
• Support onboarding, training, documentation, calibration, and quality workflow updates.
• Help manage contributor activation by following up with inactive or inconsistent contributors.
• Communicate project changes, expectations, and review standards through remote team channels.
• Identify recurring quality gaps and suggest process improvements for scalable QA operations.

Requirements

• Bachelor’s, Master’s, or PhD in Philosophy, Ethics, Logic, Political Theory, Humanities, Religious Studies, Classics, Cognitive Science, or a closely related field.
• Strong command of English for written feedback and team communication.
• At least 3 years of experience in philosophy research, teaching, writing, editing, academic review, ethics review, logic instruction, or related humanities workflows.
• Strong grasp of philosophical methods, logic, argument analysis, ethics, epistemology, metaphysics, philosophy of mind, political philosophy, history of philosophy, and conceptual clarification.
• Ability to identify issues such as strawman arguments, invalid inference, conceptual confusion, oversimplification, unsupported claims, false equivalence, and misrepresentation of philosophers’ views.
• Comfort working in remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Highly organized and detail-oriented, with experience maintaining style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Experience leading or supporting remote teams of researchers, writers, reviewers, educators, annotators, or QAs is strongly preferred.

Preferred Qualifications

• Familiarity with formal logic, moral philosophy, applied ethics, analytic philosophy, continental philosophy, ancient philosophy, political philosophy, philosophy of science, or AI ethics.
• Experience with AI training, data annotation, LLM evaluation, academic QA, ethics review, or rubric-based review.

Skills

• Philosophy
• Argument Analysis
• Logic
• Ethics
• Epistemology
• LLM Evaluation
• AI Training
• Humanities Review