Contributors will evaluate AI-generated enterprise application features produced from natural language specifications. Work includes prompt creation, rubric development, architectural review, functional assessment, and UI/UX judgment, including light React comprehension.

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based upon anticipated time of completion. Consultants will control their own schedule, provide their own tools to perform the work, and are free to simultaneously provide services to other vendors and employers to the extent permitted by those vendors and employers.

Responsibilities

Contributors will:

• Interpret natural language feature briefs and derive evaluation criteria
• Create reproducible prompts and detailed rubrics
• Draft ideal reference answers for comparison
• Evaluate model-generated features for functional correctness and architectural suitability
• Assess UI/UX logic and basic React component quality
• Provide structured scoring and clear written feedback
• Identify missing requirements, inconsistencies, or unscalable design patterns

Expected Outcomes

• High-quality prompt–rubric pairs
• Clear, structured evaluation forms
• Consistent scoring against defined criteria
• Written feedback that improves system reliability and model behavior

Qualifications

• 7+ years as a Solutions Architect, Staff/Principal Engineer, Senior Full-Stack Engineer, Enterprise Architect, or Technical Product Manager (platform)
• Strong enterprise architecture and system design skills
• Ability to evaluate UI/UX flows and read light React
• Experience translating user intent into technical designs
• Prior AI evaluation or data annotation experience preferred
• Excellent written communication and attention to detail