StoryBench.
Local models on a 2× DGX Spark cluster, scored for storytelling. v1 is quality vs speed on five kids’ prompts. v1.5 re-judges that corpus for craft · religion · values. v2 is a multi-type battery (bedtime · fable · family · quest · contemplative) for craft parity and content soul.
Five children’s-story prompts, generated cold. Each story judged independently for prose and structure (1–10). Speed measured on the same run.
Quality vs speed
Leaderboard
Click a column to sort, a row for the five judged stories. Or use the browser below (DharmaBench-style) to pick a model and read every story + judgment.
| # | Model config | Ctx | Overall | Prose | Structure | Tok/s | Perf |
|---|
Stories & judgments
Select a model to browse its five stories, classic prose/structure scores, rationales, and full text.
Same v1 stories, new judgment system: craft (prose · structure · fit), religion (25 personas), values (8). Dual judges selectable — no mixed-judge polygons.
Loading…
Hover or click a line / chip to highlight (same interaction as DharmaBench belief vectors). Reading order: craft parity → religion lean → values lean.
v1.5 leaderboard
| # | Model | Craft | Target religion | Target values | n |
|---|
Judge agreement
Stories & judgments
Models scored by the active judge. Open a story for craft rationales, religion vector (25), values (8), and full text.
New multi-type battery: early bedtime · animal fable · realistic family · quest · contemplative literary. Worker gens: Gemma-4-12B base · Catholic v3 · Mahayana v1. Same craft / religion / values judges.
Loading…
v2 leaderboard
| # | Model | Craft | Target religion | Target values | n |
|---|
Judge agreement
Stories & judgments
Multi-type battery stories (early · fable · family · quest · contemplative) with craft, religion, and values judgments.
Method
v1: five fixed kids briefs, Claude prose+structure 1–10, tok/s on the same run.
v1.5 / v2 craft: religion-blind prose · structure · fit.
Religion: 25 DharmaBench personas (vector mode). Charts offer a default view
(Buddhism · Christianity · Islam · Judaism · Hinduism · Secular Philosophy — means of sub-traditions;
omits Generalized Abrahamic and Secular Humanism) and a detailed view of key tradition axes.
Values: Family · Individuality · Community · Transcendence · Compassion · Order · Freedom · Courage.
Finetune success: craft ≈ base, content shifts toward target religion/values without high preachiness.
Judges are selectable; each chart is one ruler only. Provenance: JUDGMENT_OUTCOMES.md on the cluster.