Role Overview

Surge AI is hiring a Human Data Architect to design systems for collecting, structuring, and delivering human data used to train and evaluate frontier AI models.

The role combines ML post-training, human data collection methodology, task design, evaluation, and data pipeline architecture.

Responsibilities

• Design end-to-end data workflows from task design and collection through quality assurance and delivery for SFT, RL, and model evaluation.

• Develop scalable task frameworks that translate client model requirements into data-generation processes.

• Build and monitor data-quality frameworks to identify issues before delivery.

• Partner with engineering and product teams to improve data pipelines and increase throughput without compromising quality.

• Analyze data-quality and project patterns to inform project design, client deliverables, and product development.

Requirements

• Experience designing human data collection at scale, such as in computational cognitive science, HCI, crowdsourcing research, or similar fields.

• Familiarity with ML post-training approaches such as SFT and RL, with an understanding of how data quality affects model outcomes.

• Strong technical skills and experience working across data pipelines.

• Systems-level thinking and the ability to understand how task design affects downstream training data.

• Excellent communication skills, including the ability to explain measurement concepts to engineers and technical constraints to researchers.