Work Type
Remote
Location
United States
Compensation
$100-$120 per task
About this opportunity
Overview
Mercor is looking for US-based people with strong baseball knowledge to evaluate AI assistants live while MLB postseason games are being played. On scheduled game days, you will ask AI assistants the kinds of questions a real fan would ask during a game, then assess how useful, accurate, and well-presented the answers are. Your feedback helps shape how AI products serve sports fans.
What You'll Do
- Follow live MLB postseason games and ask AI assistants real fan questions about live scores and win probability, player and team stats, rules and challenges, schedules and broadcasts, highlights, and expert-style analysis.
- Run the same question on two AI products side by side, either as a single prompt or as a multi-turn conversation of 2 to 10 turns.
- Capture share links and full screenshots of every conversation.
- Rate each response for helpfulness, factual accuracy, and presentation, choose which product performed better, and explain your decision clearly.
What We're Looking For
- Based in the United States.
- At least 1 year of professional work experience.
- Strong baseball knowledge, including rules, teams, players, and how the postseason works.
- Availability to work live during game windows on scheduled game days.
- Comfort using AI chat assistants and web search.
- Strong written English, careful attention to detail, and the ability to spot factual errors.
- Prior AI rating or evaluation experience is helpful but not required.
Details
- This is event-based work on MLB postseason game days in October, from the Division Series through the World Series.
- Each task takes about 2 to 2.5 hours and is completed while the game is live.
- The first game day is as early as Saturday, October 3.
