Expert AI Evaluation Community

Overview

TELUS Digital is building a global community of experts to evaluate, challenge, and improve advanced AI systems. This opportunity is designed for university students, graduates, researchers, and experienced professionals with strong subject-matter expertise and the ability to judge whether AI outputs are accurate, logical, safe, and fit for purpose.

Work may be assigned across a range of specialist domains, including artificial intelligence, machine learning, LLMs, mathematics, science, engineering, linguistics, cybersecurity, psychology, law, healthcare, finance, education, and related fields. This is expert AI evaluation rather than traditional data annotation.

What You May Work On

• Evaluating AI and machine learning outputs for technical accuracy, reasoning quality, and performance.
• Reviewing AI-generated text and conversations for language quality, context, factual accuracy, hallucinations, and instruction following.
• Assessing mathematical and logical reasoning, including calculations, statistics, probability, and multi-step problem solving.
• Reviewing AI safety and red teaming cases, including unsafe outputs, vulnerabilities, edge cases, and responsible AI behavior.
• Evaluating domain-specific responses in areas such as healthcare, law, finance, economics, accounting, education, engineering, physics, business, humanities, and linguistics.

Responsibilities

• Evaluate AI-generated responses against defined criteria.
• Identify factual, technical, linguistic, and reasoning errors.
• Compare multiple AI responses and determine which is stronger.
• Assess whether an AI solution is accurate, relevant, and logically sound.
• Identify hallucinations, inconsistencies, and potential risks.
• Apply evaluation guidelines consistently.
• Provide clear, structured expert feedback.
• Help establish and maintain high-quality evaluation standards.

Who They're Looking For

• University students or recent graduates.
• Bachelor's, Master's, or PhD graduates.
• Researchers or academics.
• Industry professionals.
• Subject-matter experts.
• AI/ML practitioners.

Qualifications

• Strong expertise in one or more relevant subject areas.
• Analytical thinking and the ability to assess AI outputs carefully and consistently.
• Relevant background in fields such as artificial intelligence, machine learning, computer science, data science, mathematics, statistics, physics, engineering, linguistics, computational linguistics, psychology, cybersecurity, law, medicine, healthcare, finance, economics, education, business, science, or humanities.
• Successful completion of a subject-specific qualification exam.
• ID verification.

Compensation

Pay rates for experts currently range from $45 to $160 USD per hour. Payment terms are defined for each project.