Role Overview

The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice.

Occupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.

Key Responsibilities

• Review submissions requiring professional or technical domain knowledge

• Validate factual accuracy, terminology, and real-world applicability within the domain

• Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance

• Evaluate alignment with professional standards, norms, and best practices

• Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts

• Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise

• Identify high-risk errors related to safety, ethics, or misuse

• Escalate ambiguous or high-impact issues appropriately

• Maintain clear documentation of review decisions and reasoning

Required Qualifications

• 5+ years of professional experience practicing in that domain

• Demonstrated experience with:

-- Evaluation, review, auditing, or supervisory responsibilities OR

-- Teaching, mentoring, training, or assessing professional work

• Strong understanding of professional boundaries, risk, and compliance considerations

• Excellent written communication skills suitable for formal feedback

Preferred Qualifications

• Prior experience reviewing AI-generated or training data content

• Familiarity with compliance, regulatory, or ethical standards in the field

• Experience translating expert knowledge into clear, structured explanations

• Comfort working with evolving guidelines and iterative feedback cycles

Key Competencies

• Subject matter expertise

• Risk awareness and safety judgment

• Guideline fidelity

• Clear, corrective feedback

• Professional integrity

Expectations

• Strict adherence to confidentiality and data protection requirements

• Consistent application of guidelines across all reviews

• Willingness to update evaluation approach as standards evolve

• Professional, unbiased, and respectful communication at all times

Compensation & Logistics

• $70 to $85 per hour, depending on expertise and relevance, with bonuses for key contributions

• Begins with a paid trial period

• Paid every two weeks based on approved and tracked hours

• Fully remote and async friendly, work at your own pace within flexible deadlines

• Employment type: Contract, flexible hours (part-time and full-time options).