Spend transparency
Every API call is logged with its prompt tokens, completion tokens, reasoning tokens (where the provider reports them), latency, and authoritative cost from OpenRouter’s /generation endpoint. No black boxes — every row below is a real billed call.
Total spent
$234.74
Runs completed
8,720
Tokens in
13,479,521
Tokens out
8,464,543
Reasoning tok
4,305,268
By model
Click any column header to sortRun counts are uneven by design. Frontier models (the cutting-edge release from each lab) are sampled at N=5 per cell across 14 instruments × 2 framings (max 140 runs). Historical models from earlier product generations are sampled at N=3 per cell (max 84 runs) for the cross-version drift analysis. Lower counts than the max reflect occasional content-filter rejections or empty responses.
| Lab | Model | Cohort | Runs | Tokens in | Tokens out | Cost▼ |
|---|---|---|---|---|---|---|
| OpenAI | GPT-5.5 Pro | Historical | 160 | 149,010 | 256,376 | $50.62 |
| OpenAI | OpenAI o1 | Historical | 160 | 149,010 | 623,900 | $39.46 |
| OpenAI | GPT-5.6 Sol Pro | Historical | 159 | 1,080,356 | 288,255 | $11.79 |
| OpenAI | GPT-6 Astra Pro | Historical | 133 | 622,234 | 82,045 | $9.42 |
| Anthropic | Claude Fable 5 | Historical | 160 | 219,100 | 133,315 | $8.86 |
| Anthropic | Claude Opus 4 | Historical | 160 | 164,270 | 68,000 | $7.56 |
| Anthropic | Claude Opus 4.1 | Historical | 160 | 164,270 | 68,000 | $7.56 |
| Anthropic | Claude Fable 5.1 | Historical | 160 | 219,420 | 81,386 | $6.26 |
| Anthropic | Claude Opus 4.8 Fast | Historical | 160 | 219,100 | 79,280 | $6.16 |
| OpenAI | GPT-5.6 Terra Pro | Historical | 160 | 1,057,101 | 267,816 | $5.06 |
| Gemini 2.5 Pro | Frontier | 160 | 158,720 | 450,130 | $4.69 | |
| Anthropic | Claude Fable 5.2 | Historical | 160 | 219,420 | 67,505 | $4.46 |
| Anthropic | Claude Opus 5 | Historical | 160 | 219,100 | 110,785 | $3.87 |
| OpenAI | GPT-5.5 | Frontier | 160 | 149,010 | 105,233 | $3.79 |
| OpenAI | GPT-6 Astra | Historical | 160 | 149,010 | 50,219 | $3.67 |
| OpenAI | GPT-5 | Historical | 147 | 123,173 | 351,361 | $3.65 |
| OpenAI | GPT-4 Turbo | Historical | 160 | 150,490 | 67,698 | $3.54 |
| OpenAI | GPT-6 Sol Pro | Historical | 160 | 837,855 | 189,388 | $3.40 |
| xAI | Grok 4.6 | Historical | 160 | 183,660 | 480,834 | $3.13 |
| Anthropic | Claude Opus 4.8 | Frontier | 160 | 219,100 | 79,280 | $3.08 |
| Anthropic | Claude Opus 4.7 | Historical | 160 | 219,900 | 77,619 | $3.04 |
| Gemini 3.1 Pro Preview | Historical | 159 | 156,129 | 215,886 | $2.90 | |
| OpenAI | GPT-5.6 Sol | Historical | 160 | 149,010 | 82,774 | $2.60 |
| Anthropic | Claude Opus 4.5 | Historical | 160 | 164,270 | 68,000 | $2.52 |
| Anthropic | Claude Opus 4.6 | Historical | 160 | 164,430 | 67,400 | $2.51 |
| Anthropic | Claude Opus 5.5 | Historical | 160 | 219,420 | 79,280 | $2.46 |
| OpenAI | GPT-6.1 Sol Pro | Historical | 156 | 740,412 | 101,360 | $2.25 |
| xAI | Grok 4.7 | Historical | 160 | 349,420 | 391,496 | $2.13 |
| OpenAI | OpenAI o3 | Historical | 160 | 149,010 | 226,878 | $2.07 |
| OpenAI | GPT-5.2 | Historical | 160 | 149,010 | 100,062 | $1.62 |
| xAI | Grok 4.5 | Historical | 160 | 183,660 | 227,350 | $1.56 |
| Anthropic | Claude Sonnet 4.5 | Historical | 160 | 164,270 | 69,308 | $1.53 |
| Anthropic | Claude Sonnet 4.6 | Historical | 160 | 164,430 | 68,000 | $1.51 |
| Anthropic | Claude Sonnet 4 | Historical | 160 | 164,270 | 68,000 | $1.51 |
| DeepSeek | DeepSeek V4 Pro 0813 | Historical | 160 | 161,517 | 299,610 | $1.16 |
| DeepSeek | DeepSeek R1 | Historical | 160 | 151,806 | 416,509 | $1.15 |
| Anthropic | Claude Sonnet 5.5 | Historical | 160 | 219,420 | 67,534 | $1.11 |
| OpenAI | GPT-5.6 Terra | Historical | 160 | 149,010 | 72,869 | $1.08 |
| OpenAI | GPT-5.4 | Historical | 160 | 149,010 | 46,400 | $1.02 |
| OpenAI | GPT-4o | Historical | 160 | 149,170 | 67,372 | $1.02 |
| OpenAI | GPT-6 Sol | Historical | 160 | 149,010 | 80,480 | $1.01 |
| OpenAI | GPT-6.1 Terra Pro | Historical | 160 | 776,747 | 111,851 | $0.94 |
| DeepSeek | DeepSeek R1 (0528) | Frontier | 160 | 149,850 | 388,373 | $0.94 |
| DeepSeek | DeepSeek V4 Pro | Historical | 156 | 145,798 | 329,879 | $0.89 |
| OpenAI | GPT-5.1 | Historical | 160 | 149,010 | 63,298 | $0.78 |
| OpenAI | GPT-6.1 Sol | Historical | 152 | 143,157 | 48,613 | $0.68 |
| xAI | Grok 4.3 | Historical | 160 | 171,140 | 210,739 | $0.61 |
| Mistral | Mistral Large 2411 | Historical | 140 | 137,270 | 51,286 | $0.55 |
| Anthropic | Claude Haiku 4.5 | Historical | 160 | 164,270 | 68,800 | $0.51 |
| OpenAI | GPT-6.1 Terra | Historical | 160 | 149,010 | 49,113 | $0.34 |
| xAI | Grok 4.20 | Frontier | 160 | 169,860 | 68,069 | $0.31 |
| Mistral | Mistral Large (2512) | Frontier | 160 | 155,530 | 78,000 | $0.17 |
| DeepSeek | DeepSeek Chat V3 | Historical | 160 | 148,297 | 67,913 | $0.11 |
| Meta | Llama 4 Maverick | Frontier | 160 | 150,010 | 67,512 | $0.08 |
| Meta | Llama 3.3 70B | Historical | 158 | 149,579 | 66,104 | $0.05 |
Recent runs
| Model | Instrument | Framing | In/Out | Latency | Cost | Status |
|---|---|---|---|---|---|---|
| claude-fable-5.2 | vark16 | human#4 | 902/186 | 1.7s | $0.01 | completed |
| claude-fable-5.2 | vark16 | human#1 | 902/233 | 3.4s | $0.02 | completed |
| claude-fable-5.2 | vark16 | human#5 | 902/186 | 1.3s | $0.01 | completed |
| claude-fable-5.2 | vark16 | human#3 | 902/233 | 2.2s | $0.02 | completed |
| claude-fable-5.2 | vark16 | self#3 | 941/233 | 3.5s | $0.02 | completed |
| claude-fable-5.2 | vark16 | human#2 | 902/233 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | vark16 | self#2 | 941/233 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | vark16 | self#4 | 941/233 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | vark16 | self#5 | 941/233 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | sd3 | human#3 | 898/307 | 3.4s | $0.02 | completed |
| claude-fable-5.2 | sd3 | human#4 | 898/307 | 1.6s | $0.02 | completed |
| claude-fable-5.2 | sd3 | human#5 | 898/307 | 1.4s | $0.02 | completed |
| claude-fable-5.2 | vark16 | self#1 | 941/233 | 1.0s | $0.02 | completed |
| claude-fable-5.2 | sd3 | self#5 | 937/387 | 3.1s | $0.02 | completed |
| claude-fable-5.2 | sd3 | human#1 | 898/307 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | sd3 | human#2 | 898/307 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | sd3 | self#4 | 937/387 | 1.8s | $0.02 | completed |
| claude-fable-5.2 | sd3 | self#2 | 937/387 | 3.2s | $0.02 | completed |
| claude-fable-5.2 | sd3 | self#3 | 937/307 | 3.6s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | human#5 | 1,124/241 | 3.5s | $0.02 | completed |
| claude-fable-5.2 | sd3 | self#1 | 937/387 | 1.6s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | human#3 | 1,124/241 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | human#4 | 1,124/241 | 0.8s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | human#1 | 1,124/241 | 1.3s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | human#2 | 1,124/241 | 0.9s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | self#4 | 1,163/303 | 3.4s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | self#5 | 1,163/303 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | otti102 | human#5 | 2,837/1,132 | 1.2s | $0.07 | completed |
| claude-fable-5.2 | pvq21 | self#3 | 1,163/303 | 3.5s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | self#2 | 1,163/303 | 3.0s | $0.02 | completed |
| claude-fable-5.2 | pvq21 | self#1 | 1,163/303 | 2.5s | $0.02 | completed |
| claude-fable-5.2 | otti102 | human#4 | 2,837/1,132 | 1.1s | $0.07 | completed |
| claude-fable-5.2 | otti102 | human#3 | 2,837/1,132 | 2.8s | $0.07 | completed |
| claude-fable-5.2 | otti102 | human#1 | 2,837/1,132 | 2.8s | $0.07 | completed |
| claude-fable-5.2 | otti102 | human#2 | 2,837/1,132 | 1.7s | $0.07 | completed |
| claude-fable-5.2 | otti102 | self#5 | 2,876/1,132 | 1.3s | $0.07 | completed |
| claude-fable-5.2 | otti102 | self#3 | 2,876/1,132 | 3.6s | $0.07 | completed |
| claude-fable-5.2 | otti102 | self#2 | 2,876/1,132 | 3.0s | $0.07 | completed |
| claude-fable-5.2 | otti102 | self#4 | 2,876/1,132 | 1.2s | $0.07 | completed |
| claude-fable-5.2 | otti102 | self#1 | 2,876/1,132 | 0.9s | $0.07 | completed |
| claude-fable-5.2 | obsi32 | human#3 | 1,287/362 | 3.3s | $0.02 | completed |
| claude-fable-5.2 | obsi32 | human#5 | 1,287/362 | 2.0s | $0.02 | completed |
| claude-fable-5.2 | obsi32 | human#4 | 1,287/362 | 1.9s | $0.02 | completed |
| claude-fable-5.2 | obsi32 | human#2 | 1,287/362 | 2.5s | $0.02 | completed |
| claude-fable-5.2 | obsi32 | self#4 | 1,326/457 | 3.1s | $0.03 | completed |
| claude-fable-5.2 | obsi32 | self#5 | 1,326/457 | 1.3s | $0.03 | completed |
| claude-fable-5.2 | obsi32 | human#1 | 1,287/362 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | obsi32 | self#3 | 1,326/457 | 1.1s | $0.03 | completed |
| claude-fable-5.2 | obsi32 | self#1 | 1,326/362 | 2.3s | $0.03 | completed |
| claude-fable-5.2 | obsi32 | self#2 | 1,326/457 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | ncs18 | human#5 | 887/261 | 3.1s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | human#4 | 887/261 | 3.2s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | human#3 | 887/261 | 2.4s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | human#2 | 887/261 | 2.5s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | human#1 | 887/261 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | self#4 | 926/261 | 3.0s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | self#5 | 926/261 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | self#3 | 926/261 | 2.2s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | self#2 | 926/261 | 2.9s | $0.02 | completed |
| claude-fable-5.2 | ncs18 | self#1 | 926/261 | 3.0s | $0.02 | completed |
| claude-fable-5.2 | mfq30 | human#5 | 1,586/340 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | human#4 | 1,586/340 | 2.3s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | human#2 | 1,586/340 | 3.0s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | human#3 | 1,586/340 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | self#5 | 1,625/429 | 3.8s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | human#1 | 1,586/340 | 1.1s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | self#3 | 1,625/429 | 2.6s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | self#4 | 1,625/429 | 1.1s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | self#2 | 1,625/429 | 3.4s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | human#5 | 1,488/450 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | mfq30 | self#1 | 1,625/429 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | human#4 | 1,488/450 | 1.1s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | human#1 | 1,488/450 | 2.6s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | human#2 | 1,488/450 | 3.3s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | human#3 | 1,488/450 | 3.0s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | self#5 | 1,527/450 | 1.7s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | self#1 | 1,527/569 | 3.5s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | self#3 | 1,527/450 | 3.5s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | self#4 | 1,527/569 | 1.6s | $0.03 | completed |
| claude-fable-5.2 | lsq40 | self#2 | 1,527/569 | 2.9s | $0.03 | completed |
| claude-fable-5.2 | locus_levenson | human#5 | 1,107/274 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | human#4 | 1,107/274 | 1.3s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | self#5 | 1,146/345 | 3.7s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | human#2 | 1,107/345 | 2.4s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | human#3 | 1,107/274 | 1.0s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | human#1 | 1,107/274 | 1.4s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | self#2 | 1,146/345 | 3.2s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | self#4 | 1,146/274 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | self#1 | 1,146/345 | 3.9s | $0.02 | completed |
| claude-fable-5.2 | locus_levenson | self#3 | 1,146/274 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | kolb12 | human#5 | 855/177 | 3.5s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | human#3 | 855/177 | 2.5s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | human#4 | 855/177 | 2.3s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | human#2 | 855/177 | 2.5s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | self#5 | 894/177 | 3.3s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | human#1 | 855/177 | 3.2s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | self#4 | 894/177 | 3.8s | $0.01 | completed |
| claude-fable-5.2 | kolb12 | self#2 | 894/177 | 2.6s | $0.01 | completed |
| claude-fable-5.2 | ipip50 | human#5 | 1,098/560 | 3.7s | $0.03 | completed |
| claude-fable-5.2 | kolb12 | self#3 | 894/177 | 1.1s | $0.01 | completed |
| claude-fable-5.2 | ipip50 | human#4 | 1,098/560 | 2.9s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | human#2 | 1,098/560 | 3.4s | $0.03 | completed |
| claude-fable-5.2 | kolb12 | self#1 | 894/177 | 1.2s | $0.01 | completed |
| claude-fable-5.2 | ipip50 | human#3 | 1,098/560 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | self#5 | 1,137/560 | 2.2s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | human#1 | 1,098/560 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | self#3 | 1,137/560 | 3.5s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | self#4 | 1,137/560 | 2.1s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | self#2 | 1,137/560 | 2.0s | $0.03 | completed |
| claude-fable-5.2 | ipip50 | self#1 | 1,137/560 | 1.1s | $0.03 | completed |
| claude-fable-5.2 | hexaco24 | human#5 | 1,020/274 | 2.3s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | human#4 | 1,020/274 | 1.6s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | human#2 | 1,020/274 | 3.1s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | human#3 | 1,020/274 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | self#4 | 1,059/345 | 1.0s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | self#5 | 1,059/345 | 1.4s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | human#1 | 1,020/274 | 1.2s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | self#3 | 1,059/345 | 1.4s | $0.02 | completed |
| claude-fable-5.2 | eq_short | human#5 | 969/252 | 3.5s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | self#1 | 1,059/345 | 1.0s | $0.02 | completed |
| claude-fable-5.2 | hexaco24 | self#2 | 1,059/345 | 1.4s | $0.02 | completed |
| claude-fable-5.2 | eq_short | human#4 | 969/252 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | eq_short | human#1 | 969/252 | 3.0s | $0.02 | completed |
| claude-fable-5.2 | eq_short | human#2 | 969/252 | 2.3s | $0.02 | completed |
| claude-fable-5.2 | eq_short | human#3 | 969/252 | 1.5s | $0.02 | completed |
| claude-fable-5.2 | eq_short | self#5 | 1,008/317 | 1.3s | $0.02 | completed |
| claude-fable-5.2 | eq_short | self#4 | 1,008/317 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | enneagram90 | human#4 | 3,398/1,000 | 2.3s | $0.07 | completed |
| claude-fable-5.2 | eq_short | self#3 | 1,008/317 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | enneagram90 | human#5 | 3,398/1,000 | 1.7s | $0.07 | completed |
| claude-fable-5.2 | eq_short | self#2 | 1,008/317 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | eq_short | self#1 | 1,008/252 | 1.1s | $0.02 | completed |
| claude-fable-5.2 | enneagram90 | human#3 | 3,398/1,000 | 1.2s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | human#1 | 3,398/1,000 | 2.9s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | self#5 | 3,437/1,000 | 2.9s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | human#2 | 3,398/1,000 | 1.1s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | self#4 | 3,437/1,000 | 3.3s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | self#1 | 3,437/1,000 | 3.0s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | self#3 | 3,437/1,000 | 2.6s | $0.07 | completed |
| claude-fable-5.2 | enneagram90 | self#2 | 3,437/1,000 | 1.3s | $0.07 | completed |
| claude-fable-5.2 | enneagram36 | human#5 | 1,438/406 | 0.9s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | human#4 | 1,438/406 | 1.4s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | self#5 | 1,477/513 | 3.5s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | human#2 | 1,438/406 | 3.5s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | human#3 | 1,438/406 | 1.2s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | human#1 | 1,438/406 | 0.8s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | self#3 | 1,477/513 | 2.6s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | self#1 | 1,477/513 | 3.0s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | self#2 | 1,477/513 | 1.1s | $0.03 | completed |
| claude-fable-5.2 | enneagram36 | self#4 | 1,477/406 | 0.8s | $0.03 | completed |