Back to opportunities
CNTXT AI

Medical AI Evaluator

Posted 2026-08-20
Work Type
Remote
Location
Global
Compensation
Not specified

About this opportunity


Role

Evaluate AI-generated medical content for clinical accuracy, reasoning quality, and patient safety, while developing test cases to assess AI performance in healthcare scenarios.

Responsibilities

  • Review AI-generated medical responses for accuracy and safety.
  • Identify clinical errors, unsafe assumptions, missing contraindications, and diagnostic misinterpretations.
  • Provide clear written feedback and corrections.
  • Develop clinical prompts and test cases.
  • Rate and compare AI responses.
  • Fact-check medical content against reliable sources.

Requirements

  • Bachelor’s degree or higher in Medicine (MD/DO), Nursing, Public Health, Health Sciences, or Allied Health.
  • 5+ years of relevant healthcare experience.
  • Strong clinical reasoning, including differential diagnosis, risk assessment, and red-flag recognition.
  • Solid knowledge of disease processes, patient care, public health, and medical terminology.
  • Full professional English proficiency.
  • Excellent attention to detail and written communication.
  • Ability to work independently and reliably remotely.

Preferred

  • Clinical documentation review, utilization review, or healthcare editorial QA experience.
  • AI training or annotation experience.

Contract: Remote, hourly, asynchronous.

Related Opportunities

Trending Right Now

View all

Don't miss the next opportunity

Get a curated Friday digest of new AI and remote roles based on your location and interests — free, no spam.

Get Weekly Opportunities