Work Type
Remote
Location
United States
Compensation
Paid per accepted task, up to the equivalent of $100/hr
About this opportunity
Overview
Mindrift is looking for US-based, actively practicing physicians to support a project-based medical AI evaluation program. The work focuses on reviewing clinical EHR vignettes and related benchmark items to help test, evaluate, and improve AI systems. General and internal medicine are the main focus.
This opportunity is part-time and project-based, with tasks estimated at around 10-20 hours per week during active phases. Work must be submitted by the deadline and meet the stated acceptance criteria to be accepted. Compensation is paid per accepted task, and the rate depends on the qualification tier reached and task efficiency, with an equivalent of up to $100/hr.
What You'll Do
- Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor “trap” answers across diagnosis and treatment tasks.
- Review clinical reasoning quality, including vignette accuracy and completeness, whether the vignette gives away the answer, answer correctness and gradeability, and trap quality.
- Assess whether the reasoning chain can reach the answer from vignette facts alone.
- Check reasoning traces for correctness and write short rationales.
- Work through three independent blind reads followed by physician adjudication.
Requirements
- US-based physician with an MD or DO degree.
- Active, unrestricted US medical license verified with the issuing medical board.
- Board certification or completed residency training, with recent direct patient care; attending-level experience is preferred.
- Broad diagnostic and treatment experience across multiple systems, such as internal medicine, family medicine, emergency medicine, or hospital medicine.
- Strong clinical reasoning, including differential diagnosis, next-step management, and evidence-based guideline application.
- Strong written English, at least C1 level.
- Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare titles.
Preferred Experience
- Experience in medical AI evaluation, clinical content review, exam-question review, or medical annotation/QA is a plus.
Application Notes
- Applicants should submit a CV in English.
- Applicants should indicate their level of English proficiency.
