Spend transparency
Every API call is logged with its prompt tokens, completion tokens, reasoning tokens (where the provider reports them), latency, and authoritative cost from OpenRouter’s /generation endpoint. No black boxes — every row below is a real billed call.
Total spent
$229.00
Runs completed
8,240
Tokens in
12,334,344
Tokens out
8,236,074
Reasoning tok
4,286,396
By model
Click any column header to sortRun counts are uneven by design. Frontier models (the cutting-edge release from each lab) are sampled at N=5 per cell across 14 instruments × 2 framings (max 140 runs). Historical models from earlier product generations are sampled at N=3 per cell (max 84 runs) for the cross-version drift analysis. Lower counts than the max reflect occasional content-filter rejections or empty responses.
| Lab | Model | Cohort | Runs | Tokens in | Tokens out | Cost▼ |
|---|---|---|---|---|---|---|
| OpenAI | GPT-5.5 Pro | Historical | 160 | 149,010 | 256,376 | $50.62 |
| OpenAI | OpenAI o1 | Historical | 160 | 149,010 | 623,900 | $39.46 |
| OpenAI | GPT-5.6 Sol Pro | Historical | 159 | 1,080,356 | 288,255 | $11.79 |
| OpenAI | GPT-6 Astra Pro | Historical | 133 | 622,234 | 82,045 | $9.42 |
| Anthropic | Claude Fable 5 | Historical | 160 | 219,100 | 133,315 | $8.86 |
| Anthropic | Claude Opus 4 | Historical | 160 | 164,270 | 68,000 | $7.56 |
| Anthropic | Claude Opus 4.1 | Historical | 160 | 164,270 | 68,000 | $7.56 |
| Anthropic | Claude Fable 5.1 | Historical | 160 | 219,420 | 81,386 | $6.26 |
| Anthropic | Claude Opus 4.8 Fast | Historical | 160 | 219,100 | 79,280 | $6.16 |
| OpenAI | GPT-5.6 Terra Pro | Historical | 160 | 1,057,101 | 267,816 | $5.06 |
| Gemini 2.5 Pro | Frontier | 160 | 158,720 | 450,130 | $4.69 | |
| Anthropic | Claude Opus 5 | Historical | 160 | 219,100 | 110,785 | $3.87 |
| OpenAI | GPT-5.5 | Frontier | 160 | 149,010 | 105,233 | $3.79 |
| OpenAI | GPT-6 Astra | Historical | 160 | 149,010 | 50,219 | $3.67 |
| OpenAI | GPT-5 | Historical | 147 | 123,173 | 351,361 | $3.65 |
| OpenAI | GPT-4 Turbo | Historical | 160 | 150,490 | 67,698 | $3.54 |
| OpenAI | GPT-6 Sol Pro | Historical | 160 | 837,855 | 189,388 | $3.40 |
| xAI | Grok 4.6 | Historical | 160 | 183,660 | 480,834 | $3.13 |
| Anthropic | Claude Opus 4.8 | Frontier | 160 | 219,100 | 79,280 | $3.08 |
| Anthropic | Claude Opus 4.7 | Historical | 160 | 219,900 | 77,619 | $3.04 |
| Gemini 3.1 Pro Preview | Historical | 159 | 156,129 | 215,886 | $2.90 | |
| OpenAI | GPT-5.6 Sol | Historical | 160 | 149,010 | 82,774 | $2.60 |
| Anthropic | Claude Opus 4.5 | Historical | 160 | 164,270 | 68,000 | $2.52 |
| Anthropic | Claude Opus 4.6 | Historical | 160 | 164,430 | 67,400 | $2.51 |
| Anthropic | Claude Opus 5.5 | Historical | 160 | 219,420 | 79,280 | $2.46 |
| OpenAI | GPT-6.1 Sol Pro | Historical | 156 | 740,412 | 101,360 | $2.25 |
| xAI | Grok 4.7 | Historical | 160 | 349,420 | 391,496 | $2.13 |
| OpenAI | OpenAI o3 | Historical | 160 | 149,010 | 226,878 | $2.07 |
| OpenAI | GPT-5.2 | Historical | 160 | 149,010 | 100,062 | $1.62 |
| xAI | Grok 4.5 | Historical | 160 | 183,660 | 227,350 | $1.56 |
| Anthropic | Claude Sonnet 4.5 | Historical | 160 | 164,270 | 69,308 | $1.53 |
| Anthropic | Claude Sonnet 4.6 | Historical | 160 | 164,430 | 68,000 | $1.51 |
| Anthropic | Claude Sonnet 4 | Historical | 160 | 164,270 | 68,000 | $1.51 |
| DeepSeek | DeepSeek V4 Pro 0813 | Historical | 160 | 161,517 | 299,610 | $1.16 |
| DeepSeek | DeepSeek R1 | Historical | 160 | 151,806 | 416,509 | $1.15 |
| Anthropic | Claude Sonnet 5.5 | Historical | 160 | 219,420 | 67,534 | $1.11 |
| OpenAI | GPT-5.6 Terra | Historical | 160 | 149,010 | 72,869 | $1.08 |
| OpenAI | GPT-5.4 | Historical | 160 | 149,010 | 46,400 | $1.02 |
| OpenAI | GPT-4o | Historical | 160 | 149,170 | 67,372 | $1.02 |
| OpenAI | GPT-6 Sol | Historical | 160 | 149,010 | 80,480 | $1.01 |
| DeepSeek | DeepSeek R1 (0528) | Frontier | 160 | 149,850 | 388,373 | $0.94 |
| DeepSeek | DeepSeek V4 Pro | Historical | 156 | 145,798 | 329,879 | $0.89 |
| OpenAI | GPT-5.1 | Historical | 160 | 149,010 | 63,298 | $0.78 |
| OpenAI | GPT-6.1 Sol | Historical | 152 | 143,157 | 48,613 | $0.68 |
| xAI | Grok 4.3 | Historical | 160 | 171,140 | 210,739 | $0.61 |
| Mistral | Mistral Large 2411 | Historical | 140 | 137,270 | 51,286 | $0.55 |
| Anthropic | Claude Haiku 4.5 | Historical | 160 | 164,270 | 68,800 | $0.51 |
| xAI | Grok 4.20 | Frontier | 160 | 169,860 | 68,069 | $0.31 |
| Mistral | Mistral Large (2512) | Frontier | 160 | 155,530 | 78,000 | $0.17 |
| DeepSeek | DeepSeek Chat V3 | Historical | 160 | 148,297 | 67,913 | $0.11 |
| Meta | Llama 4 Maverick | Frontier | 160 | 150,010 | 67,512 | $0.08 |
| Meta | Llama 3.3 70B | Historical | 158 | 149,579 | 66,104 | $0.05 |
Recent runs
| Model | Instrument | Framing | In/Out | Latency | Cost | Status |
|---|---|---|---|---|---|---|
| gpt-6.1-sol | vark16 | human#4 | 599/140 | 0.9s | $0.00260 | completed |
| gpt-6.1-sol | vark16 | human#2 | 0/0 | 0.7s | $0 | invalid |
| gpt-6.1-sol | vark16 | human#1 | 599/140 | 0.4s | $0.00260 | completed |
| gpt-6.1-sol | vark16 | self#1 | 0/0 | 0.5s | $0 | invalid |
| gpt-6.1-sol | sd3 | human#5 | 625/228 | 0.4s | $0.00353 | completed |
| gpt-6.1-sol | sd3 | human#3 | 625/228 | 0.8s | $0.00353 | completed |
| gpt-6.1-sol | sd3 | human#2 | 625/228 | 0.4s | $0.00353 | completed |
| gpt-6.1-sol | sd3 | human#1 | 625/228 | 0.5s | $0.00353 | completed |
| gpt-6.1-sol | sd3 | self#3 | 0/0 | 0.5s | $0 | invalid |
| gpt-6.1-sol | pvq21 | self#4 | 858/180 | 0.5s | $0.00352 | completed |
| gpt-6.1-sol | obsi32 | self#1 | 889/268 | 0.4s | $0.00446 | completed |
| gpt-6.1-sol | mfq30 | human#1 | 1,073/347+93r | 1.0s | $0.00358 | completed |
| gpt-6.1-sol | mfq30 | self#4 | 1,096/293+39r | 0.4s | $0.00305 | completed |
| gpt-6.1-sol | lsq40 | human#4 | 948/332 | 0.4s | $0.00522 | completed |
| gpt-6.1-sol | lsq40 | self#1 | 0/0 | 0.7s | $0 | invalid |
| gpt-6.1-sol | locus_levenson | human#2 | 0/0 | 0.3s | $0 | invalid |
| gpt-6.1-sol | locus_levenson | human#1 | 771/204 | 0.5s | $0.00358 | completed |
| gpt-6.1-sol | locus_levenson | self#3 | 0/0 | 0.4s | $0 | invalid |
| gpt-6.1-sol | locus_levenson | self#2 | 794/232+26r | 0.4s | $0.00391 | completed |
| gpt-6.1-sol | locus_levenson | self#1 | 794/242+36r | 0.5s | $0.00401 | completed |
| gpt-6.1-sol | kolb12 | self#1 | 573/108 | 0.4s | $0.00223 | completed |
| gpt-6.1-sol | ipip50 | human#5 | 753/412 | 0.5s | $0.00563 | completed |
| gpt-6.1-sol | ipip50 | human#2 | 753/412 | 0.6s | $0.00563 | completed |
| gpt-6.1-sol | hexaco24 | human#3 | 683/317+111r | 0.4s | $0.00454 | completed |
| gpt-6.1-sol | hexaco24 | self#3 | 706/321+115r | 0.4s | $0.00462 | completed |
| gpt-6.1-sol | enneagram90 | human#4 | 2,371/755+21r | 0.4s | $0.00779 | completed |
| gpt-6.1-sol | enneagram90 | self#5 | 2,394/762+28r | 0.6s | $0.00787 | completed |
| gpt-6.1-sol | enneagram90 | self#2 | 2,394/768+34r | 1.8s | $0.00793 | completed |
| gpt-6.1-sol | enneagram90 | self#1 | 2,394/765+31r | 0.4s | $0.00790 | completed |
| gpt-6.1-sol | enneagram36 | human#3 | 0/0 | 0.5s | $0 | invalid |
| gpt-6.1-sol | ecr12 | human#5 | 506/108 | 0.5s | $0.00209 | completed |
| gpt-6.1-sol | ecr12 | human#1 | 506/108 | 0.5s | $0.00209 | completed |
| gpt-6.1-sol | ecr12 | human#3 | 0/0 | 0.6s | $0 | invalid |
| gpt-6.1-sol | ecr12 | self#1 | 529/194+84r | 0.6s | $0.00300 | completed |
| gpt-6.1-sol | vark16 | human#3 | 599/140 | 0.3s | $0.00260 | completed |
| gpt-6.1-sol | vark16 | human#5 | 599/140 | 0.5s | $0.00260 | completed |
| gpt-6.1-sol | vark16 | self#5 | 622/140 | 0.9s | $0.00264 | completed |
| gpt-6.1-sol | vark16 | self#4 | 622/140 | 0.4s | $0.00264 | completed |
| gpt-6.1-sol | vark16 | self#2 | 622/140 | 0.9s | $0.00264 | completed |
| gpt-6.1-sol | vark16 | self#3 | 622/140 | 1.2s | $0.00264 | completed |
| gpt-6.1-sol | sd3 | self#5 | 648/349+119r | 3.1s | $0.00479 | completed |
| gpt-6.1-sol | sd3 | human#4 | 625/228 | 0.5s | $0.00353 | completed |
| gpt-6.1-sol | sd3 | self#4 | 648/324+94r | 0.5s | $0.00454 | completed |
| gpt-6.1-sol | sd3 | self#2 | 648/308+78r | 0.6s | $0.00438 | completed |
| gpt-6.1-sol | sd3 | self#1 | 648/385+155r | 0.8s | $0.00515 | completed |
| gpt-6.1-sol | pvq21 | human#4 | 835/180 | 0.5s | $0.00347 | completed |
| gpt-6.1-sol | pvq21 | human#5 | 835/180 | 0.3s | $0.00347 | completed |
| gpt-6.1-sol | pvq21 | human#2 | 835/180 | 0.7s | $0.00347 | completed |
| gpt-6.1-sol | pvq21 | human#3 | 835/180 | 0.4s | $0.00347 | completed |
| gpt-6.1-sol | pvq21 | self#5 | 858/180 | 0.4s | $0.00352 | completed |
| gpt-6.1-sol | pvq21 | human#1 | 835/180 | 0.3s | $0.00347 | completed |
| gpt-6.1-sol | otti102 | human#5 | 1,919/828 | 0.4s | $0.00848 | completed |
| gpt-6.1-sol | pvq21 | self#2 | 858/180 | 0.4s | $0.00352 | completed |
| gpt-6.1-sol | pvq21 | self#3 | 858/180 | 0.4s | $0.00352 | completed |
| gpt-6.1-sol | otti102 | human#3 | 1,919/828 | 0.9s | $0.00848 | completed |
| gpt-6.1-sol | otti102 | human#4 | 1,919/828 | 0.8s | $0.00848 | completed |
| gpt-6.1-sol | pvq21 | self#1 | 858/180 | 0.5s | $0.00352 | completed |
| gpt-6.1-sol | otti102 | human#2 | 1,919/828 | 0.6s | $0.00848 | completed |
| gpt-6.1-sol | otti102 | human#1 | 1,919/828 | 0.6s | $0.00848 | completed |
| gpt-6.1-sol | otti102 | self#4 | 1,942/861+31r | 0.5s | $0.00881 | completed |
| gpt-6.1-sol | otti102 | self#5 | 1,942/877+47r | 0.4s | $0.00897 | completed |
| gpt-6.1-sol | otti102 | self#2 | 1,942/860+30r | 0.4s | $0.00880 | completed |
| gpt-6.1-sol | otti102 | self#3 | 1,942/828 | 0.5s | $0.00848 | completed |
| gpt-6.1-sol | otti102 | self#1 | 1,942/866+36r | 1.0s | $0.00886 | completed |
| gpt-6.1-sol | obsi32 | human#5 | 866/268 | 1.7s | $0.00441 | completed |
| gpt-6.1-sol | obsi32 | human#4 | 866/268 | 0.4s | $0.00441 | completed |
| gpt-6.1-sol | obsi32 | human#1 | 866/268 | 0.5s | $0.00441 | completed |
| gpt-6.1-sol | obsi32 | human#2 | 866/268 | 0.5s | $0.00441 | completed |
| gpt-6.1-sol | obsi32 | human#3 | 866/268 | 0.7s | $0.00441 | completed |
| gpt-6.1-sol | obsi32 | self#5 | 889/268 | 0.5s | $0.00446 | completed |
| gpt-6.1-sol | obsi32 | self#3 | 889/268 | 0.5s | $0.00446 | completed |
| gpt-6.1-sol | obsi32 | self#4 | 889/268 | 0.8s | $0.00446 | completed |
| gpt-6.1-sol | obsi32 | self#2 | 889/268 | 0.4s | $0.00446 | completed |
| gpt-6.1-sol | ncs18 | human#4 | 602/254+96r | 0.5s | $0.00374 | completed |
| gpt-6.1-sol | ncs18 | human#3 | 602/266+108r | 0.5s | $0.00386 | completed |
| gpt-6.1-sol | ncs18 | human#5 | 602/156 | 0.5s | $0.00276 | completed |
| gpt-6.1-sol | ncs18 | self#4 | 625/206+48r | 0.5s | $0.00331 | completed |
| gpt-6.1-sol | ncs18 | human#1 | 602/250+92r | 0.8s | $0.00370 | completed |
| gpt-6.1-sol | ncs18 | human#2 | 602/156 | 0.6s | $0.00276 | completed |
| gpt-6.1-sol | ncs18 | self#5 | 625/156 | 0.5s | $0.00281 | completed |
| gpt-6.1-sol | mfq30 | human#5 | 1,073/388+134r | 0.4s | $0.00399 | completed |
| gpt-6.1-sol | ncs18 | self#1 | 625/251+93r | 0.4s | $0.00376 | completed |
| gpt-6.1-sol | ncs18 | self#2 | 625/186+28r | 0.6s | $0.00311 | completed |
| gpt-6.1-sol | ncs18 | self#3 | 625/156 | 0.6s | $0.00281 | completed |
| gpt-6.1-sol | mfq30 | human#3 | 1,073/290+36r | 0.6s | $0.00301 | completed |
| gpt-6.1-sol | mfq30 | human#4 | 1,073/252 | 1.5s | $0.00263 | completed |
| gpt-6.1-sol | mfq30 | human#2 | 1,073/252 | 0.3s | $0.00263 | completed |
| gpt-6.1-sol | mfq30 | self#5 | 1,096/293+39r | 1.3s | $0.00305 | completed |
| gpt-6.1-sol | mfq30 | self#3 | 1,096/402+148r | 0.4s | $0.00414 | completed |
| gpt-6.1-sol | mfq30 | self#2 | 1,096/332+78r | 0.4s | $0.00344 | completed |
| gpt-6.1-sol | mfq30 | self#1 | 1,096/305+51r | 0.6s | $0.00317 | completed |
| gpt-6.1-sol | lsq40 | human#5 | 948/332 | 0.4s | $0.00522 | completed |
| gpt-6.1-sol | lsq40 | human#2 | 948/332 | 0.4s | $0.00522 | completed |
| gpt-6.1-sol | lsq40 | human#3 | 948/332 | 0.4s | $0.00522 | completed |
| gpt-6.1-sol | lsq40 | human#1 | 948/332 | 0.6s | $0.00522 | completed |
| gpt-6.1-sol | lsq40 | self#5 | 971/332 | 0.7s | $0.00526 | completed |
| gpt-6.1-sol | lsq40 | self#4 | 971/332 | 0.4s | $0.00526 | completed |
| gpt-6.1-sol | lsq40 | self#2 | 971/332 | 0.5s | $0.00526 | completed |
| gpt-6.1-sol | lsq40 | self#3 | 971/332 | 0.3s | $0.00526 | completed |
| gpt-6.1-sol | locus_levenson | human#5 | 771/204 | 0.8s | $0.00358 | completed |
| gpt-6.1-sol | locus_levenson | self#5 | 794/325+119r | 0.7s | $0.00484 | completed |
| gpt-6.1-sol | locus_levenson | human#4 | 771/204 | 0.6s | $0.00358 | completed |
| gpt-6.1-sol | kolb12 | human#5 | 550/108 | 3.1s | $0.00218 | completed |
| gpt-6.1-sol | locus_levenson | human#3 | 771/204 | 0.4s | $0.00358 | completed |
| gpt-6.1-sol | locus_levenson | self#4 | 794/241+35r | 0.4s | $0.00400 | completed |
| gpt-6.1-sol | kolb12 | human#3 | 550/108 | 0.7s | $0.00218 | completed |
| gpt-6.1-sol | kolb12 | human#4 | 550/108 | 0.4s | $0.00218 | completed |
| gpt-6.1-sol | kolb12 | human#1 | 550/108 | 0.6s | $0.00218 | completed |
| gpt-6.1-sol | kolb12 | human#2 | 550/108 | 0.4s | $0.00218 | completed |
| gpt-6.1-sol | kolb12 | self#5 | 573/108 | 0.5s | $0.00223 | completed |
| gpt-6.1-sol | kolb12 | self#4 | 573/108 | 0.4s | $0.00223 | completed |
| gpt-6.1-sol | kolb12 | self#2 | 573/108 | 0.2s | $0.00223 | completed |
| gpt-6.1-sol | kolb12 | self#3 | 573/108 | 0.7s | $0.00223 | completed |
| gpt-6.1-sol | ipip50 | human#3 | 753/412 | 0.5s | $0.00563 | completed |
| gpt-6.1-sol | ipip50 | human#4 | 753/412 | 0.4s | $0.00563 | completed |
| gpt-6.1-sol | ipip50 | human#1 | 753/412 | 0.4s | $0.00563 | completed |
| gpt-6.1-sol | ipip50 | self#5 | 776/546+132r | 0.6s | $0.00701 | completed |
| gpt-6.1-sol | ipip50 | self#3 | 776/438+24r | 0.4s | $0.00593 | completed |
| gpt-6.1-sol | ipip50 | self#4 | 776/412 | 0.5s | $0.00567 | completed |
| gpt-6.1-sol | ipip50 | self#2 | 776/412 | 0.5s | $0.00567 | completed |
| gpt-6.1-sol | hexaco24 | human#4 | 683/320+114r | 0.5s | $0.00457 | completed |
| gpt-6.1-sol | ipip50 | self#1 | 776/445+31r | 0.3s | $0.00600 | completed |
| gpt-6.1-sol | hexaco24 | human#5 | 683/204 | 0.4s | $0.00341 | completed |
| gpt-6.1-sol | hexaco24 | human#2 | 683/204 | 0.5s | $0.00341 | completed |
| gpt-6.1-sol | hexaco24 | self#4 | 706/325+119r | 0.4s | $0.00466 | completed |
| gpt-6.1-sol | hexaco24 | self#5 | 706/226+20r | 0.4s | $0.00367 | completed |
| gpt-6.1-sol | hexaco24 | self#2 | 706/330+124r | 0.4s | $0.00471 | completed |
| gpt-6.1-sol | hexaco24 | human#1 | 683/204 | 0.5s | $0.00341 | completed |
| gpt-6.1-sol | eq_short | human#4 | 674/188 | 0.5s | $0.00323 | completed |
| gpt-6.1-sol | hexaco24 | self#1 | 706/204 | 0.5s | $0.00345 | completed |
| gpt-6.1-sol | eq_short | human#5 | 674/188 | 0.5s | $0.00323 | completed |
| gpt-6.1-sol | eq_short | human#3 | 674/188 | 0.7s | $0.00323 | completed |
| gpt-6.1-sol | eq_short | human#1 | 674/188 | 0.5s | $0.00323 | completed |
| gpt-6.1-sol | eq_short | human#2 | 674/188 | 0.4s | $0.00323 | completed |
| gpt-6.1-sol | eq_short | self#4 | 697/188 | 0.4s | $0.00327 | completed |
| gpt-6.1-sol | eq_short | self#5 | 697/188 | 0.3s | $0.00327 | completed |
| gpt-6.1-sol | eq_short | self#3 | 697/188 | 1.8s | $0.00327 | completed |
| gpt-6.1-sol | enneagram90 | human#5 | 2,371/732 | 0.6s | $0.00756 | completed |
| gpt-6.1-sol | eq_short | self#1 | 697/224+34r | 0.8s | $0.00363 | completed |
| gpt-6.1-sol | eq_short | self#2 | 697/217+27r | 0.4s | $0.00356 | completed |
| gpt-6.1-sol | enneagram90 | human#3 | 2,371/732 | 0.4s | $0.00756 | completed |
| gpt-6.1-sol | enneagram90 | human#1 | 2,371/732 | 0.4s | $0.00756 | completed |
| gpt-6.1-sol | enneagram90 | self#3 | 2,394/758+24r | 0.4s | $0.00783 | completed |
| gpt-6.1-sol | enneagram90 | human#2 | 2,371/732 | 0.3s | $0.01 | completed |
| gpt-6.1-sol | enneagram90 | self#4 | 2,394/760+26r | 0.5s | $0.00785 | completed |
| gpt-6.1-sol | enneagram36 | human#5 | 942/300 | 0.5s | $0.00488 | completed |
| gpt-6.1-sol | enneagram36 | human#4 | 942/300 | 0.9s | $0.00488 | completed |
| gpt-6.1-sol | enneagram36 | human#2 | 942/300 | 0.5s | $0.00488 | completed |
| gpt-6.1-sol | enneagram36 | self#4 | 965/487+185r | 1.4s | $0.00680 | completed |
| gpt-6.1-sol | enneagram36 | self#5 | 965/469+167r | 0.6s | $0.00662 | completed |