Add feedback to completed requests to help improve reviewer performance and overall system quality. Feedback can include ratings, comments, and specific quality metrics that help reviewers understand what worked well and what could be improved.
Good: “The analysis was thorough and covered all the key policy violations I mentioned in the request.”Avoid: “Good job.”Why: Specific feedback helps reviewers understand exactly what they did well.
Balance Appreciation and Improvement
Good: “Great attention to detail in identifying spam patterns. For future requests, could you also mention the confidence level of your assessment?”Avoid: “Everything was perfect” or “Everything was wrong.”Why: Balanced feedback encourages growth while recognizing strengths.
Focus on Behavior, Not Person
Good: “The response could benefit from more detailed examples to support the conclusion.”Avoid: “You’re not very thorough.”Why: Focus on actions and outcomes rather than personal characteristics.
Include Context
Good: “Given the urgent nature of this content moderation request, the 15-minute response time was exactly what we needed.”Avoid: “Too slow.”Why: Context helps reviewers understand the specific requirements of different request types.
Create reusable feedback templates for common scenarios:
Excellent Performance Template
Copy
{ "rating": 5, "comment": "Outstanding work! Response was accurate, timely, and exceeded expectations. The detailed analysis and clear recommendations were exactly what we needed.", "accuracy": 5, "timeliness": 5, "helpfulness": 5, "would_recommend": true, "tags": ["excellent", "thorough", "professional"], "category": "positive"}
Good with Minor Improvements Template
Copy
{ "rating": 4, "comment": "Solid work overall. The analysis was accurate and helpful. For future requests, consider providing more specific examples to support your conclusions.", "accuracy": 5, "timeliness": 4, "helpfulness": 4, "would_recommend": true, "tags": ["accurate", "could-add-examples"], "category": "constructive"}
Needs Improvement Template
Copy
{ "rating": 2, "comment": "The response addressed the basic question but lacked the depth and detail specified in the request. Please review the requirements more carefully for future requests.", "accuracy": 3, "timeliness": 3, "helpfulness": 2, "would_recommend": false, "tags": ["incomplete", "needs-detail"], "category": "issue", "follow_up_needed": true}
Quick Appreciation Template
Copy
{ "rating": 5, "comment": "Perfect response! Quick, accurate, and exactly what we needed. Thank you!", "timeliness": 5, "would_recommend": true, "tags": ["quick", "accurate"], "category": "positive"}