Software Engineer, Coding Evaluation & Training Data

Overview

Surge is hiring a Software Engineer, Coding Evaluation & Training Data to work at the intersection of software engineering, product, and AI training data. In this role, you will build and run systems that help teach frontier models how to code, including end-to-end coding data projects for top AI labs. The work emphasizes training data quality, agentic evaluation, and systems design over traditional product feature development.

What You’ll Do

• Own coding data projects end to end, from scoping and pilot design through execution, iteration, and scale-up.
• Design agentic training workflows and task structures that reflect real software engineering work, such as refactoring, debugging, code review, large-repo navigation, and tool use.
• Define and refine rubrics, golden sets, and reward signals that measure real engineering value, not just whether code compiles.
• Review data and worker output with strong software engineering judgment and decide what meets the standard for frontier training.
• Design and run qualification processes for coding workers, including hands-on assessments of coding ability.
• Set up or partner on technical environments such as containers, repositories, test harnesses, sandboxes, and code execution infrastructure.
• Work with technical staff at client companies to translate high-level training goals into concrete projects and technical environments.
• Collaborate with Surge engineering, product, and operations teams to improve coding data products, internal tools, and execution processes.

What We’re Looking For

• 2–6+ years of professional software engineering experience building and maintaining real systems.
• Strong coding ability in at least one mainstream language and comfort working in production codebases.
• Strong engineering judgment, with an emphasis on correctness, code quality, and how real engineering teams work.
• Ability to reason about and debug technical environments, including containers, dependencies, and automated test setups.
• Interest in owning projects end to end, including scoping, workflow design, execution, and continuous improvement.
• Excellent written and verbal communication skills, including the ability to work credibly with senior client engineers and translate fuzzy goals into actionable plans.
• Interest in AI/ML systems and in how data, evaluation, and reward design improve agentic coding capabilities.