Model Evaluation & RLHFBeginnerTier 2 · $99
Helpfulness Scoring
Scoring task completion and instruction following, including partial credit.
3 modules100 minutes of material10 exam questions · 80% to pass
Syllabus
01Task completion
35 min- Decide whether the task was actually done
- Score partial completion
02Instruction following
35 min- Check every stated constraint
- Mark a broken constraint
03Concise and actionable
30 min- Weigh brevity against completeness
- Write the rationale
Assessed concepts
The exam tests these directly. Definitions are summarised here; the exact answer key stays on the server.
Task completion
Instruction following
Conciseness tradeoff
Actionability
Partial credit