Role Overview

DataAnnotation is seeking Machine Learning Engineers to evaluate how AI models reason about machine learning systems. You will assess AI-generated solutions involving training, evaluation, debugging, data pipelines and deployment, identify technical errors, and provide correct solutions based on practical experience.

Responsibilities

• Create prompts that test AI reasoning about ML training, evaluation, debugging and production systems.

• Review AI-generated output for technical errors, including leaky evaluations, incorrect loss formulations and misdiagnosed training issues.

• Provide accurate, practitioner-level solutions when AI responses are incorrect or incomplete.

Suitable Backgrounds

• Machine Learning Engineer

• MLOps Engineer

• Applied Scientist

Requirements

• Hands-on experience training, evaluating or deploying machine learning models, professionally or through serious personal work.

• Familiarity with the modern ML stack.

• Experience with Python and PyTorch or JAX.

• Strong written English and ability to clearly explain technical concepts.

• No degree required.

Compensation & Work Details

• Pay: Up to $75–$150+ per hour, depending on task difficulty and specialization.

• Location: Remote

• Commitment: Flexible hours

• Type: Independent contractor

• Payouts: Weekly

• Contributors may earn $10,000–$100,000+ per year; some use the work as a full-time income.