Work Type
Remote
Location
United States, Canada
Compensation
$100/hour
About this opportunity
Overview
ExpertWoka is sourcing a Senior Software Engineer with strong Python and/or TypeScript experience for a short-term contract opportunity supporting AI data and evaluation workflows.
What You'll Do
- Design, refine, and iterate on rubrics and evaluation criteria for preference data.
- Review and label data with a high bar for quality.
- Build and maintain pipelines and infrastructure that support data generation, collection, and evaluation workflows.
- Synthesize findings into clear write-ups, updates, or recommendations.
- Collaborate with researchers and engineers to translate qualitative judgment into scalable processes
Requirements
- 5+ years of proficiency in Python, especially building and maintaining pipelines and infrastructure, or TypeScript, Golang, or JavaScript.
- Hands-on experience with preference data collection and/or rubric creation.
- Strong written and verbal communication skills.
- Ability to make and explain high-quality technical judgments.
- Must be available for at least 20 hours per week.
- Must be able to overlap with PST for 4 hours.
- Must have a LinkedIn profile included in the resume.
- Must not be currently working with Microsoft.
Qualifications
- Experience contributing to or navigating large codebases is a plus.
Project Details
- Contract type: Short-term contract.
- Estimated duration: 3 months.
- Start: Immediate / expected next week.
- Work arrangement: Remote.
- Compensation: $100/hour.
Evaluation Process
- AI interview.
- Coding challenge.
- One 30-minute technical and cultural interview.
