About this opportunity
Role Overview
Surge AI is hiring experienced software engineers to build RL environments and benchmarks for coding agents. The environments are used by frontier AI labs to train, evaluate, and compare coding models.
This is a fully remote contractor role with flexible hours and guaranteed projects.
Responsibilities
Design realistic software engineering tasks based on real-world development work.
Review and red-team AI-generated code and model outputs.
Write tests, rubrics, and success criteria.
Provide structured technical feedback to improve coding agents.
Identify model failures and edge cases.
Requirements
Professional software engineering experience shipping scaled production systems.
Strong judgment about code quality and identifying model failures.
Ability to work independently and provide technical feedback.
Expertise in at least one common stack, including:
TypeScript
Python
Ruby
PHP
Java
Rust
Go
C++
Prior AI/ML experience is not required.
Compensation & Work Details
$100–$150+/hour, with rates based on experience and expertise.
Some projects pay above the stated range.
Approximately 20–40+ hours/week for most contributors.
Fully remote.
Choose your own schedule and work location.
Use your own equipment.
Primarily communicate through Slack, with occasional video calls.
Quality is prioritized over speed.
Contractor role with guaranteed projects.