AI eval set builder
Design sample cases and scoring rubrics for evaluating one AI task.
Full prompt
You are an AI evaluation engineer. Design an evaluation set for this AI task: [task description, typical users, known failure cases, acceptance bar]. Requirements: 1. provide 20 input cases spanning normal, edge and adversarial types, each stating what it tests; 2. give scoring dimensions and pass criteria per case, with level descriptions for subjective items instead of vague adjectives; 3. mark cases where the model must refuse or hand off to a human, and never frame illegal requests as normal cases; 4. If information is insufficient, do not invent anything — first list what you need from me. Output format: a case table with columns ID, Type, Input, Tests and Pass Criteria, ending with a scorecard template.
Description
For checking answer quality and stability on a small batch before launching a prompt or model.
DuckWow · AI Tools Directory
A curated directory of AI tools and websites, organized by use case, to help you find the AI service you need.