Design a Plan for Evaluating a RAG System's Faithfulness
Turns a short description into a concrete plan to design a plan for evaluating a RAG system's faithfulness, with assumptions called out instead of silently guessed.
When to use this
Use when you need a second opinion on how to design a plan for evaluating a RAG system's faithfulness and want the reasoning shown, not just an answer.
Prompt template
Act as an AI evaluation designer. Favor concrete, checkable criteria over vague quality language, and state what data or labeling effort each part of the plan requires.
Task: Design a plan for evaluating a RAG system's faithfulness.
Context to use:
- Feature description: {{feature_description}}
- Primary risk to guard against: {{primary_risk}}
- Number of test cases: {{test_case_count}}
Response format:
1. Brief recommendation or approach
2. Main deliverable, organized into clear sections
3. Assumptions and unresolved questions
4. Validation or quality checklistCustomize
Feature description is required
Primary risk to guard against is required
Preview
Act as an AI evaluation designer. Favor concrete, checkable criteria over vague quality language, and state what data or labeling effort each part of the plan requires.
Task: Design a plan for evaluating a RAG system's faithfulness.
Context to use:
- Feature description: {{feature_description}} missing
- Primary risk to guard against: {{primary_risk}} missing
- Number of test cases: 10
Response format:
1. Brief recommendation or approach
2. Main deliverable, organized into clear sections
3. Assumptions and unresolved questions
4. Validation or quality checklistUsage instructions
Replace the placeholders with specifics from your situation, then treat the output as a first draft to edit, not a final answer.
Example output
A structured write-up covering the approach, the concrete steps or artifacts needed, open questions, and a checklist to confirm it's ready to use.
Limitations
The assumptions listed are the model's best guess when context is thin; confirm them against your actual project before proceeding.
Rate this prompt
Not yet rated