Spend transparency
Every API call is logged with its prompt tokens, completion tokens, reasoning tokens (where the provider reports them), latency, and authoritative cost from OpenRouter’s /generation endpoint. No black boxes — every row below is a real billed call.
Total spent
$89.67
Runs completed
4,324
Tokens in
4,067,353
Tokens out
3,707,230
Reasoning tok
1,786,465
By model
Click any column header to sortRun counts are uneven by design. Frontier models (the cutting-edge release from each lab) are sampled at N=5 per cell across 14 instruments × 2 framings (max 140 runs). Historical models from earlier product generations are sampled at N=3 per cell (max 84 runs) for the cross-version drift analysis. Lower counts than the max reflect occasional content-filter rejections or empty responses.
| Lab | Model | Cohort | Runs | Tokens in | Tokens out | Cost▼ |
|---|---|---|---|---|---|---|
| OpenAI | OpenAI o1 | Historical | 140 | 120,930 | 554,789 | $34.99 |
| Anthropic | Claude Fable 5 | Historical | 140 | 177,510 | 99,510 | $6.75 |
| Anthropic | Claude Opus 4 | Historical | 140 | 133,230 | 51,760 | $5.88 |
| Anthropic | Claude Opus 4.1 | Historical | 140 | 133,230 | 51,760 | $5.88 |
| Gemini 2.5 Pro | Frontier | 140 | 128,340 | 378,948 | $3.95 | |
| OpenAI | GPT-5.5 | Frontier | 140 | 120,930 | 83,275 | $3.05 |
| OpenAI | GPT-5 | Historical | 127 | 95,093 | 279,404 | $2.91 |
| OpenAI | GPT-4 Turbo | Historical | 140 | 122,320 | 51,003 | $2.75 |
| Anthropic | Claude Opus 4.7 | Historical | 140 | 178,210 | 60,469 | $2.40 |
| Anthropic | Claude Opus 4.8 | Frontier | 140 | 177,510 | 60,340 | $2.40 |
| Gemini 3.1 Pro Preview | Historical | 139 | 125,749 | 173,293 | $2.33 | |
| Anthropic | Claude Opus 4.5 | Historical | 140 | 133,230 | 51,760 | $1.96 |
| Anthropic | Claude Opus 4.6 | Historical | 140 | 133,370 | 51,160 | $1.95 |
| OpenAI | OpenAI o3 | Historical | 140 | 120,930 | 182,096 | $1.68 |
| OpenAI | GPT-5.2 | Historical | 140 | 120,930 | 76,740 | $1.27 |
| Anthropic | Claude Sonnet 4.5 | Historical | 140 | 133,230 | 52,968 | $1.19 |
| Anthropic | Claude Sonnet 4.6 | Historical | 140 | 133,370 | 51,760 | $1.18 |
| Anthropic | Claude Sonnet 4 | Historical | 140 | 133,230 | 51,760 | $1.18 |
| DeepSeek | DeepSeek R1 | Historical | 140 | 123,900 | 347,693 | $0.96 |
| OpenAI | GPT-5.4 | Historical | 140 | 120,930 | 35,440 | $0.81 |
| OpenAI | GPT-4o | Historical | 140 | 121,070 | 51,202 | $0.79 |
| DeepSeek | DeepSeek R1 (0528) | Frontier | 140 | 121,938 | 321,111 | $0.78 |
| OpenAI | GPT-5.1 | Historical | 140 | 120,930 | 50,194 | $0.63 |
| Mistral | Mistral Large 2411 | Historical | 140 | 137,270 | 51,286 | $0.55 |
| xAI | Grok 4.3 | Historical | 140 | 139,330 | 171,126 | $0.49 |
| Anthropic | Claude Haiku 4.5 | Historical | 140 | 133,230 | 52,460 | $0.40 |
| xAI | Grok 4.20 | Frontier | 140 | 138,210 | 51,891 | $0.25 |
| Mistral | Mistral Large (2512) | Frontier | 140 | 125,960 | 59,306 | $0.14 |
| DeepSeek | DeepSeek Chat V3 | Historical | 140 | 120,400 | 51,620 | $0.08 |
| Meta | Llama 4 Maverick | Frontier | 140 | 121,790 | 51,288 | $0.06 |
| Meta | Llama 3.3 70B | Historical | 138 | 121,053 | 49,818 | $0.03 |
Recent runs
| Model | Instrument | Framing | In/Out | Latency | Cost | Status |
|---|---|---|---|---|---|---|
| claude-fable-5 | vark16 | human#4 | 900/292 | 3.2s | $0.02 | completed |
| claude-fable-5 | vark16 | human#5 | 900/292 | 3.1s | $0.02 | completed |
| claude-fable-5 | vark16 | human#3 | 900/283 | 3.6s | $0.02 | completed |
| claude-fable-5 | vark16 | self#4 | 939/723 | 3.2s | $0.05 | completed |
| claude-fable-5 | vark16 | human#2 | 900/279 | 3.1s | $0.02 | completed |
| claude-fable-5 | vark16 | self#2 | 939/759 | 3.3s | $0.05 | completed |
| claude-fable-5 | vark16 | self#3 | 939/647 | 3.5s | $0.04 | completed |
| claude-fable-5 | vark16 | self#5 | 939/429 | 3.6s | $0.03 | completed |
| claude-fable-5 | vark16 | self#1 | 939/686 | 3.7s | $0.04 | completed |
| claude-fable-5 | vark16 | human#1 | 900/284 | 3.3s | $0.02 | completed |
| claude-fable-5 | sd3 | human#5 | 896/643 | 3.5s | $0.04 | completed |
| claude-fable-5 | sd3 | human#4 | 896/671 | 3.6s | $0.04 | completed |
| claude-fable-5 | sd3 | self#2 | 935/1,045 | 3.4s | $0.06 | completed |
| claude-fable-5 | sd3 | human#3 | 896/802 | 3.5s | $0.05 | completed |
| claude-fable-5 | sd3 | human#1 | 896/681 | 3.6s | $0.04 | completed |
| claude-fable-5 | sd3 | human#2 | 896/699 | 3.6s | $0.04 | completed |
| claude-fable-5 | sd3 | self#1 | 935/668 | 3.7s | $0.04 | completed |
| claude-fable-5 | sd3 | self#4 | 935/671 | 3.5s | $0.04 | completed |
| claude-fable-5 | sd3 | self#5 | 935/631 | 3.6s | $0.04 | completed |
| claude-fable-5 | sd3 | self#3 | 935/627 | 3.3s | $0.04 | completed |
| claude-fable-5 | pvq21 | human#3 | 1,122/371 | 3.7s | $0.03 | completed |
| claude-fable-5 | pvq21 | human#4 | 1,122/336 | 3.7s | $0.03 | completed |
| claude-fable-5 | pvq21 | human#5 | 1,122/369 | 3.0s | $0.03 | completed |
| claude-fable-5 | pvq21 | human#2 | 1,122/365 | 3.2s | $0.03 | completed |
| claude-fable-5 | pvq21 | self#3 | 1,161/385 | 4.5s | $0.03 | completed |
| claude-fable-5 | pvq21 | human#1 | 1,122/340 | 3.1s | $0.03 | completed |
| claude-fable-5 | pvq21 | self#5 | 1,161/390 | 3.4s | $0.03 | completed |
| claude-fable-5 | pvq21 | self#4 | 1,161/380 | 3.3s | $0.03 | completed |
| claude-fable-5 | pvq21 | self#1 | 1,161/380 | 3.3s | $0.03 | completed |
| claude-fable-5 | pvq21 | self#2 | 1,161/382 | 3.6s | $0.03 | completed |
| claude-fable-5 | ncs18 | human#4 | 885/310 | 2.9s | $0.02 | completed |
| claude-fable-5 | ncs18 | human#5 | 885/337 | 2.8s | $0.03 | completed |
| claude-fable-5 | ncs18 | human#3 | 885/311 | 3.0s | $0.02 | completed |
| claude-fable-5 | ncs18 | human#1 | 885/351 | 4.3s | $0.03 | completed |
| claude-fable-5 | ncs18 | self#5 | 924/306 | 3.7s | $0.02 | completed |
| claude-fable-5 | ncs18 | human#2 | 885/318 | 3.4s | $0.02 | completed |
| claude-fable-5 | ncs18 | self#3 | 924/304 | 3.2s | $0.02 | completed |
| claude-fable-5 | ncs18 | self#4 | 924/307 | 3.4s | $0.02 | completed |
| claude-fable-5 | mfq30 | human#5 | 1,584/475 | 3.6s | $0.04 | completed |
| claude-fable-5 | ncs18 | self#1 | 924/305 | 3.8s | $0.02 | completed |
| claude-fable-5 | ncs18 | self#2 | 924/305 | 3.5s | $0.02 | completed |
| claude-fable-5 | mfq30 | self#5 | 1,623/473 | 6.3s | $0.04 | completed |
| claude-fable-5 | mfq30 | human#4 | 1,584/477 | 3.9s | $0.04 | completed |
| claude-fable-5 | mfq30 | human#1 | 1,584/472 | 3.4s | $0.04 | completed |
| claude-fable-5 | mfq30 | human#3 | 1,584/476 | 3.1s | $0.04 | completed |
| claude-fable-5 | mfq30 | self#2 | 1,623/771 | 3.9s | $0.05 | completed |
| claude-fable-5 | mfq30 | self#4 | 1,623/536 | 3.7s | $0.04 | completed |
| claude-fable-5 | mfq30 | human#2 | 1,584/475 | 3.1s | $0.04 | completed |
| claude-fable-5 | mfq30 | self#3 | 1,623/472 | 3.5s | $0.04 | completed |
| claude-fable-5 | lsq40 | self#2 | 1,525/1,352 | 3.6s | $0.08 | completed |
| claude-fable-5 | mfq30 | self#1 | 1,623/473 | 2.9s | $0.04 | completed |
| claude-fable-5 | lsq40 | human#4 | 1,486/610 | 4.2s | $0.05 | completed |
| claude-fable-5 | lsq40 | human#5 | 1,486/569 | 3.2s | $0.04 | completed |
| claude-fable-5 | lsq40 | self#5 | 1,525/1,318 | 3.0s | $0.08 | completed |
| claude-fable-5 | lsq40 | self#3 | 1,525/1,216 | 3.5s | $0.08 | completed |
| claude-fable-5 | lsq40 | self#4 | 1,525/1,201 | 3.5s | $0.08 | completed |
| claude-fable-5 | lsq40 | self#1 | 1,525/1,200 | 3.6s | $0.08 | completed |
| claude-fable-5 | lsq40 | human#3 | 1,486/623 | 3.4s | $0.05 | completed |
| claude-fable-5 | lsq40 | human#2 | 1,486/621 | 4.4s | $0.05 | completed |
| claude-fable-5 | lsq40 | human#1 | 1,486/632 | 3.5s | $0.05 | completed |
| claude-fable-5 | locus_levenson | self#5 | 1,144/1,009 | 3.6s | $0.06 | completed |
| claude-fable-5 | locus_levenson | human#5 | 1,105/464 | 2.9s | $0.03 | completed |
| claude-fable-5 | locus_levenson | self#2 | 1,144/1,168 | 3.1s | $0.07 | completed |
| claude-fable-5 | locus_levenson | self#4 | 1,144/1,052 | 3.0s | $0.06 | completed |
| claude-fable-5 | locus_levenson | human#4 | 1,105/370 | 3.5s | $0.03 | completed |
| claude-fable-5 | locus_levenson | self#1 | 1,144/1,017 | 3.8s | $0.06 | completed |
| claude-fable-5 | locus_levenson | self#3 | 1,144/994 | 2.9s | $0.06 | completed |
| claude-fable-5 | locus_levenson | human#3 | 1,105/432 | 3.8s | $0.03 | completed |
| claude-fable-5 | locus_levenson | human#2 | 1,105/390 | 4.0s | $0.03 | completed |
| claude-fable-5 | locus_levenson | human#1 | 1,105/390 | 3.6s | $0.03 | completed |
| claude-fable-5 | kolb12 | human#4 | 853/246 | 3.8s | $0.02 | completed |
| claude-fable-5 | kolb12 | human#5 | 853/221 | 3.7s | $0.02 | completed |
| claude-fable-5 | kolb12 | human#2 | 853/215 | 3.8s | $0.02 | completed |
| claude-fable-5 | kolb12 | human#3 | 853/225 | 4.3s | $0.02 | completed |
| claude-fable-5 | kolb12 | self#5 | 892/451 | 3.4s | $0.03 | completed |
| claude-fable-5 | kolb12 | self#3 | 892/453 | 3.3s | $0.03 | completed |
| claude-fable-5 | kolb12 | self#4 | 892/236 | 4.6s | $0.02 | completed |
| claude-fable-5 | kolb12 | human#1 | 853/210 | 3.8s | $0.02 | completed |
| claude-fable-5 | ipip50 | human#5 | 1,096/748 | 3.6s | $0.05 | completed |
| claude-fable-5 | kolb12 | self#1 | 892/450 | 3.6s | $0.03 | completed |
| claude-fable-5 | ipip50 | human#4 | 1,096/769 | 3.2s | $0.05 | completed |
| claude-fable-5 | kolb12 | self#2 | 892/235 | 3.8s | $0.02 | completed |
| claude-fable-5 | ipip50 | human#3 | 1,096/769 | 4.0s | $0.05 | completed |
| claude-fable-5 | ipip50 | human#2 | 1,096/764 | 3.1s | $0.05 | completed |
| claude-fable-5 | ipip50 | self#5 | 1,135/776 | 3.0s | $0.05 | completed |
| claude-fable-5 | ipip50 | human#1 | 1,096/741 | 3.7s | $0.05 | completed |
| claude-fable-5 | ipip50 | self#2 | 1,135/730 | 3.8s | $0.05 | completed |
| claude-fable-5 | ipip50 | self#3 | 1,135/770 | 3.0s | $0.05 | completed |
| claude-fable-5 | ipip50 | self#4 | 1,135/730 | 2.8s | $0.05 | completed |
| claude-fable-5 | ipip50 | self#1 | 1,135/730 | 3.4s | $0.05 | completed |
| claude-fable-5 | enneagram90 | human#5 | 3,396/2,578 | 3.6s | $0.16 | completed |
| claude-fable-5 | hexaco24 | human#3 | 1,018/365 | 3.7s | $0.03 | completed |
| claude-fable-5 | hexaco24 | human#4 | 1,018/355 | 3.6s | $0.03 | completed |
| claude-fable-5 | hexaco24 | human#5 | 1,018/365 | 2.9s | $0.03 | completed |
| claude-fable-5 | hexaco24 | self#4 | 1,057/846 | 3.5s | $0.05 | completed |
| claude-fable-5 | hexaco24 | self#5 | 1,057/746 | 3.5s | $0.05 | completed |
| claude-fable-5 | hexaco24 | self#3 | 1,057/724 | 4.1s | $0.05 | completed |
| claude-fable-5 | hexaco24 | self#2 | 1,057/772 | 3.7s | $0.05 | completed |
| claude-fable-5 | hexaco24 | human#1 | 1,018/366 | 3.6s | $0.03 | completed |
| claude-fable-5 | hexaco24 | self#1 | 1,057/826 | 4.0s | $0.05 | completed |
| claude-fable-5 | hexaco24 | human#2 | 1,018/364 | 2.8s | $0.03 | completed |
| claude-fable-5 | eq_short | human#4 | 967/349 | 3.1s | $0.03 | completed |
| claude-fable-5 | eq_short | human#5 | 967/346 | 3.2s | $0.03 | completed |
| claude-fable-5 | enneagram90 | human#4 | 3,396/2,591 | 3.5s | $0.16 | completed |
| claude-fable-5 | eq_short | self#3 | 1,006/781 | 3.0s | $0.05 | completed |
| claude-fable-5 | eq_short | human#3 | 967/377 | 3.6s | $0.03 | completed |
| claude-fable-5 | eq_short | human#2 | 967/375 | 3.6s | $0.03 | completed |
| claude-fable-5 | eq_short | self#4 | 1,006/366 | 4.2s | $0.03 | completed |
| claude-fable-5 | eq_short | self#5 | 1,006/380 | 3.5s | $0.03 | completed |
| claude-fable-5 | eq_short | human#1 | 967/369 | 3.5s | $0.03 | completed |
| claude-fable-5 | eq_short | self#2 | 1,006/377 | 3.0s | $0.03 | completed |
| claude-fable-5 | eq_short | self#1 | 1,006/385 | 3.3s | $0.03 | completed |
| claude-fable-5 | enneagram90 | self#3 | 3,435/3,083 | 4.1s | $0.19 | completed |
| claude-fable-5 | enneagram90 | human#3 | 3,396/2,648 | 4.4s | $0.17 | completed |
| claude-fable-5 | enneagram90 | self#2 | 3,435/3,175 | 3.2s | $0.19 | completed |
| claude-fable-5 | enneagram90 | self#4 | 3,435/2,887 | 4.0s | $0.18 | completed |
| claude-fable-5 | enneagram90 | self#5 | 3,435/2,778 | 3.4s | $0.17 | completed |
| claude-fable-5 | enneagram90 | human#2 | 3,396/2,568 | 3.0s | $0.16 | completed |
| claude-fable-5 | enneagram90 | self#1 | 3,435/2,930 | 3.1s | $0.18 | completed |
| claude-fable-5 | enneagram90 | human#1 | 3,396/1,330 | 4.0s | $0.10 | completed |
| claude-fable-5 | enneagram36 | self#5 | 1,475/1,321 | 3.4s | $0.08 | completed |
| claude-fable-5 | enneagram36 | human#5 | 1,436/558 | 3.3s | $0.04 | completed |
| claude-fable-5 | enneagram36 | self#4 | 1,475/1,214 | 3.9s | $0.08 | completed |
| claude-fable-5 | enneagram36 | human#4 | 1,436/541 | 3.6s | $0.04 | completed |
| claude-fable-5 | enneagram36 | self#1 | 1,475/1,333 | 3.9s | $0.08 | completed |
| claude-fable-5 | enneagram36 | self#2 | 1,475/1,041 | 4.0s | $0.07 | completed |
| claude-fable-5 | enneagram36 | self#3 | 1,475/949 | 3.7s | $0.06 | completed |
| claude-fable-5 | enneagram36 | human#1 | 1,436/557 | 4.5s | $0.04 | completed |
| claude-fable-5 | enneagram36 | human#3 | 1,436/535 | 3.0s | $0.04 | completed |
| claude-fable-5 | enneagram36 | human#2 | 1,436/536 | 3.0s | $0.04 | completed |
| claude-fable-5 | ecr12 | human#2 | 734/317 | 9.4s | $0.02 | completed |
| claude-fable-5 | ecr12 | human#4 | 734/341 | 3.1s | $0.02 | completed |
| claude-fable-5 | ecr12 | human#5 | 734/208 | 3.6s | $0.02 | completed |
| claude-fable-5 | ecr12 | self#1 | 773/469 | 4.2s | $0.03 | completed |
| claude-fable-5 | ecr12 | self#2 | 773/528 | 3.6s | $0.03 | completed |
| claude-fable-5 | ecr12 | self#4 | 773/459 | 3.8s | $0.03 | completed |
| claude-fable-5 | ecr12 | self#3 | 773/405 | 3.8s | $0.03 | completed |
| claude-fable-5 | ecr12 | self#5 | 773/304 | 3.3s | $0.02 | completed |
| claude-fable-5 | ecr12 | human#1 | 734/299 | 3.3s | $0.02 | completed |
| claude-fable-5 | ecr12 | human#3 | 734/332 | 3.6s | $0.02 | completed |
| mistral-large-2411 | vark16 | self#5 | 698/206 | 0.3s | $0.00142 | completed |
| mistral-large-2411 | sd3 | self#5 | 740/349 | 0.4s | $0.00340 | completed |
| mistral-large-2411 | sd3 | human#4 | 712/349 | 0.4s | $0.00346 | completed |
| mistral-large-2411 | vark16 | self#4 | 698/206 | 0.4s | $0.00246 | completed |
| mistral-large-2411 | vark16 | human#5 | 670/206 | 0.4s | $0.00252 | completed |
| mistral-large-2411 | sd3 | self#4 | 740/349 | 0.4s | $0.00340 | completed |
| mistral-large-2411 | sd3 | human#5 | 712/268 | 0.4s | $0.00297 | completed |
| mistral-large-2411 | vark16 | human#4 | 670/158 | 0.4s | $0.00223 | completed |
| mistral-large-2411 | pvq21 | human#5 | 919/208 | 0.7s | $0.00303 | completed |
| mistral-large-2411 | pvq21 | self#4 | 947/271 | 0.4s | $0.00335 | completed |