Quickbooks AI Trainer - Non US

Overview

ExpertWoka is seeking experienced accounting professionals to help evaluate AI model performance on accounting workflows and SMB-related questions.

This contract role involves assessing AI responses, developing evaluation rubrics, and supporting model reliability on financial tasks such as reporting, reconciliations, compliance checks, and audit reviews.

Responsibilities

• Evaluate AI responses to small business and accounting-related questions.
• Score responses for correctness, completeness, relevance, and reasoning.
• Identify missing assumptions, indirect answers, and unclear structure.
• Detect when clarifying questions are needed.
• Apply structured evaluation guidelines consistently.
• Participate in calibration sessions and feedback coaching.
• Flag systematic failure patterns and rubric ambiguities.

Requirements

• 2+ years of experience in Accounting, FP&A, Auditing, or Financial Consulting.
• Strong understanding of small business operations, bookkeeping, or accounting concepts.
• Ability to interpret financial or business context questions.
• Active QuickBooks user with experience using Omni Chat.
• Excellent written English and attention to precision.
• Strong analytical thinking and structured decision-making.
• Comfortable applying detailed rubrics and scoring guidelines.
• Experience in QA, content evaluation, audit, compliance, or similar structured review roles is preferred.

Schedule

• Contract assignment lasting 12 weeks.
• Available full-time or part-time: 40 hours per week or 20 hours per week.
• Requires 4 hours of PST overlap.
• Start as soon as possible.