Spend transparency
Every API call is logged with its prompt tokens, completion tokens, reasoning tokens (where the provider reports them), latency, and authoritative cost from OpenRouter’s /generation endpoint. No black boxes — every row below is a real billed call.
Total spent
$148.44
Runs completed
5,019
Tokens in
5,481,914
Tokens out
4,516,067
Reasoning tok
2,306,923
By model
Click any column header to sortRun counts are uneven by design. Frontier models (the cutting-edge release from each lab) are sampled at N=5 per cell across 14 instruments × 2 framings (max 140 runs). Historical models from earlier product generations are sampled at N=3 per cell (max 84 runs) for the cross-version drift analysis. Lower counts than the max reflect occasional content-filter rejections or empty responses.
| Lab | Model | Cohort | Runs | Tokens in | Tokens out | Cost▼ |
|---|---|---|---|---|---|---|
| OpenAI | GPT-5.5 Pro | Historical | 140 | 120,930 | 202,527 | $40.08 |
| OpenAI | OpenAI o1 | Historical | 140 | 120,930 | 554,789 | $34.99 |
| OpenAI | GPT-5.6 Sol Pro | Historical | 139 | 877,616 | 221,107 | $10.81 |
| Anthropic | Claude Fable 5 | Historical | 140 | 177,510 | 99,510 | $6.75 |
| Anthropic | Claude Opus 4 | Historical | 140 | 133,230 | 51,760 | $5.88 |
| Anthropic | Claude Opus 4.1 | Historical | 140 | 133,230 | 51,760 | $5.88 |
| Anthropic | Claude Opus 4.8 Fast | Historical | 140 | 177,510 | 60,340 | $4.79 |
| Gemini 2.5 Pro | Frontier | 140 | 128,340 | 378,948 | $3.95 | |
| OpenAI | GPT-5.5 | Frontier | 140 | 120,930 | 83,275 | $3.05 |
| OpenAI | GPT-5 | Historical | 127 | 95,093 | 279,404 | $2.91 |
| OpenAI | GPT-4 Turbo | Historical | 140 | 122,320 | 51,003 | $2.75 |
| Anthropic | Claude Opus 4.7 | Historical | 140 | 178,210 | 60,469 | $2.40 |
| Anthropic | Claude Opus 4.8 | Frontier | 140 | 177,510 | 60,340 | $2.40 |
| OpenAI | GPT-5.6 Sol | Historical | 140 | 120,930 | 62,812 | $2.37 |
| Gemini 3.1 Pro Preview | Historical | 139 | 125,749 | 173,293 | $2.33 | |
| Anthropic | Claude Opus 4.5 | Historical | 140 | 133,230 | 51,760 | $1.96 |
| Anthropic | Claude Opus 4.6 | Historical | 140 | 133,370 | 51,160 | $1.95 |
| OpenAI | OpenAI o3 | Historical | 140 | 120,930 | 182,096 | $1.68 |
| OpenAI | GPT-5.2 | Historical | 140 | 120,930 | 76,740 | $1.27 |
| Anthropic | Claude Sonnet 4.5 | Historical | 140 | 133,230 | 52,968 | $1.19 |
| Anthropic | Claude Sonnet 4.6 | Historical | 140 | 133,370 | 51,760 | $1.18 |
| Anthropic | Claude Sonnet 4 | Historical | 140 | 133,230 | 51,760 | $1.18 |
| DeepSeek | DeepSeek R1 | Historical | 140 | 123,900 | 347,693 | $0.96 |
| OpenAI | GPT-5.4 | Historical | 140 | 120,930 | 35,440 | $0.81 |
| OpenAI | GPT-4o | Historical | 140 | 121,070 | 51,202 | $0.79 |
| DeepSeek | DeepSeek R1 (0528) | Frontier | 140 | 121,938 | 321,111 | $0.78 |
| DeepSeek | DeepSeek V4 Pro | Historical | 136 | 117,575 | 262,051 | $0.71 |
| OpenAI | GPT-5.1 | Historical | 140 | 120,930 | 50,194 | $0.63 |
| Mistral | Mistral Large 2411 | Historical | 140 | 137,270 | 51,286 | $0.55 |
| xAI | Grok 4.3 | Historical | 140 | 139,330 | 171,126 | $0.49 |
| Anthropic | Claude Haiku 4.5 | Historical | 140 | 133,230 | 52,460 | $0.40 |
| xAI | Grok 4.20 | Frontier | 140 | 138,210 | 51,891 | $0.25 |
| Mistral | Mistral Large (2512) | Frontier | 140 | 125,960 | 59,306 | $0.14 |
| DeepSeek | DeepSeek Chat V3 | Historical | 140 | 120,400 | 51,620 | $0.08 |
| Meta | Llama 4 Maverick | Frontier | 140 | 121,790 | 51,288 | $0.06 |
| Meta | Llama 3.3 70B | Historical | 138 | 121,053 | 49,818 | $0.03 |
Recent runs
| Model | Instrument | Framing | In/Out | Latency | Cost | Status |
|---|---|---|---|---|---|---|
| gpt-5.6-sol-pro | sd3 | human#5 | 5,204/1,342+635r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | vark16 | human#5 | 4,319/530+93r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | human#4 | 4,352/566+127r | 0.4s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | human#3 | 4,409/606+167r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | human#2 | 4,407/625+186r | 0.2s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | human#1 | 4,473/718+275r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | self#5 | 4,475/730+289r | 0.2s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | self#4 | 4,411/547+110r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | self#3 | 4,566/681+240r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | self#2 | 4,472/624+185r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | vark16 | self#1 | 4,411/684+247r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | sd3 | human#4 | 5,352/1,778+1,071r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | sd3 | human#2 | 5,421/1,607+900r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | sd3 | human#3 | 5,305/1,603+896r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | sd3 | human#1 | 5,071/1,306+599r | 0.4s | $0.06 | completed |
| gpt-5.6-sol-pro | sd3 | self#5 | 5,417/1,582+875r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | sd3 | self#4 | 5,437/1,581+874r | 0.4s | $0.07 | completed |
| gpt-5.6-sol-pro | sd3 | self#3 | 5,361/1,524+817r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | pvq21 | human#4 | 5,576/758+197r | 0.3s | $0.05 | completed |
| gpt-5.6-sol-pro | sd3 | self#2 | 5,344/1,439+732r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | sd3 | self#1 | 5,592/1,839+1,132r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | pvq21 | human#5 | 5,666/1,121+558r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | pvq21 | human#3 | 5,708/964+401r | 0.2s | $0.06 | completed |
| gpt-5.6-sol-pro | pvq21 | human#2 | 5,626/806+245r | 0.3s | $0.05 | completed |
| gpt-5.6-sol-pro | pvq21 | self#3 | 5,924/1,191+628r | 0.4s | $0.07 | completed |
| gpt-5.6-sol-pro | pvq21 | human#1 | 5,665/839+280r | 0.4s | $0.05 | completed |
| gpt-5.6-sol-pro | pvq21 | self#5 | 5,907/1,214+651r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | pvq21 | self#4 | 5,961/1,192+629r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | ncs18 | human#5 | 5,024/1,737+1,246r | 0.4s | $0.08 | completed |
| gpt-5.6-sol-pro | pvq21 | self#2 | 5,894/1,107+544r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | pvq21 | self#1 | 5,976/1,214+651r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | ncs18 | human#4 | 5,013/1,508+1,017r | 1.2s | $0.07 | completed |
| gpt-5.6-sol-pro | ncs18 | human#3 | 4,987/1,320+829r | 0.2s | $0.06 | completed |
| gpt-5.6-sol-pro | ncs18 | human#1 | 4,917/1,859+1,368r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | ncs18 | human#2 | 4,963/1,496+1,005r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | mfq30 | human#5 | 7,323/1,666+887r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | ncs18 | self#5 | 4,475/483 | 0.2s | $0.04 | completed |
| gpt-5.6-sol-pro | ncs18 | self#4 | 4,475/578+93r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | ncs18 | self#3 | 4,475/483 | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | ncs18 | self#2 | 4,475/546+61r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | ncs18 | self#1 | 4,475/591+106r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | mfq30 | human#4 | 7,182/1,773+994r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | mfq30 | human#3 | 7,370/1,714+935r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | mfq30 | human#2 | 7,236/1,628+849r | 0.5s | $0.09 | completed |
| gpt-5.6-sol-pro | mfq30 | human#1 | 7,200/2,051+1,272r | 0.5s | $0.10 | completed |
| gpt-5.6-sol-pro | mfq30 | self#5 | 7,575/1,869+1,090r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | mfq30 | self#3 | 7,682/1,996+1,217r | 0.3s | $0.10 | completed |
| gpt-5.6-sol-pro | mfq30 | self#4 | 7,645/1,852+1,073r | 0.4s | $0.09 | completed |
| gpt-5.6-sol-pro | mfq30 | self#1 | 7,268/1,607+828r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | mfq30 | self#2 | 7,516/1,712+933r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | lsq40 | human#3 | 6,640/1,412+393r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | lsq40 | human#5 | 6,600/1,290+273r | 2.2s | $0.07 | completed |
| gpt-5.6-sol-pro | lsq40 | human#4 | 6,430/1,214+195r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | lsq40 | self#5 | 7,187/2,016+997r | 0.3s | $0.10 | completed |
| gpt-5.6-sol-pro | lsq40 | human#2 | 6,636/1,439+420r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | lsq40 | human#1 | 6,427/1,261+242r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | lsq40 | self#3 | 7,021/1,815+796r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | lsq40 | self#4 | 6,765/1,603+584r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | lsq40 | self#2 | 6,816/1,591+572r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | lsq40 | self#1 | 6,846/1,797+778r | 0.5s | $0.09 | completed |
| gpt-5.6-sol-pro | locus_levenson | human#5 | 5,789/1,734+1,099r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | locus_levenson | human#4 | 5,906/1,737+1,102r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | locus_levenson | human#2 | 5,779/1,521+886r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | locus_levenson | human#3 | 5,661/1,298+663r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | locus_levenson | self#2 | 5,984/1,589+954r | 0.4s | $0.08 | completed |
| gpt-5.6-sol-pro | locus_levenson | human#1 | 5,648/1,130+495r | 0.4s | $0.06 | completed |
| gpt-5.6-sol-pro | locus_levenson | self#5 | 5,426/862+227r | 0.3s | $0.05 | completed |
| gpt-5.6-sol-pro | locus_levenson | self#4 | 5,585/1,234+599r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | locus_levenson | self#3 | 5,998/1,568+933r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | locus_levenson | self#1 | 5,808/1,271+636r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | kolb12 | human#5 | 4,019/446+105r | 0.3s | $0.03 | completed |
| gpt-5.6-sol-pro | kolb12 | human#4 | 4,019/432+91r | 0.3s | $0.02 | completed |
| gpt-5.6-sol-pro | kolb12 | human#3 | 4,019/440+99r | 0.3s | $0.02 | completed |
| gpt-5.6-sol-pro | kolb12 | human#2 | 4,019/435+94r | 0.3s | $0.03 | completed |
| gpt-5.6-sol-pro | kolb12 | human#1 | 4,019/428+87r | 0.3s | $0.03 | completed |
| gpt-5.6-sol-pro | ipip50 | human#5 | 6,290/1,829+570r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | kolb12 | self#5 | 4,111/419+78r | 0.4s | $0.03 | completed |
| gpt-5.6-sol-pro | kolb12 | self#4 | 4,111/511+170r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | kolb12 | self#3 | 4,111/523+182r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | kolb12 | self#2 | 4,111/471+130r | 0.2s | $0.03 | completed |
| gpt-5.6-sol-pro | kolb12 | self#1 | 4,111/378+37r | 0.4s | $0.03 | completed |
| gpt-5.6-sol-pro | ipip50 | human#4 | 6,497/2,113+854r | 0.3s | $0.10 | completed |
| gpt-5.6-sol-pro | ipip50 | human#3 | 6,592/2,505+1,246r | 0.3s | $0.11 | completed |
| gpt-5.6-sol-pro | ipip50 | human#2 | 6,664/2,854+1,595r | 0.2s | $0.12 | completed |
| gpt-5.6-sol-pro | ipip50 | human#1 | 6,225/2,275+1,016r | 0.4s | $0.10 | completed |
| gpt-5.6-sol-pro | ipip50 | self#5 | 7,081/2,659+1,400r | 0.3s | $0.12 | completed |
| gpt-5.6-sol-pro | ipip50 | self#4 | 6,968/2,465+1,206r | 0.3s | $0.11 | completed |
| gpt-5.6-sol-pro | ipip50 | self#3 | 6,993/2,550+1,291r | 0.3s | $0.11 | completed |
| gpt-5.6-sol-pro | ipip50 | self#2 | 6,763/2,311+1,052r | 0.3s | $0.10 | completed |
| gpt-5.6-sol-pro | ipip50 | self#1 | 6,877/2,384+1,125r | 0.3s | $0.11 | completed |
| gpt-5.6-sol-pro | hexaco24 | human#5 | 5,553/1,855+1,220r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | hexaco24 | human#4 | 5,433/1,412+777r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | hexaco24 | human#3 | 5,457/1,542+907r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | hexaco24 | human#1 | 5,497/1,676+1,041r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | hexaco24 | human#2 | 5,414/1,814+1,179r | 0.3s | $0.08 | completed |
| gpt-5.6-sol-pro | hexaco24 | self#4 | 5,566/1,415+780r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | hexaco24 | self#5 | 5,629/1,444+809r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | eq_short | self#5 | 760/39+39r | 2.6s | $0 | invalid |
| gpt-5.6-sol-pro | hexaco24 | self#3 | 5,524/1,432+797r | 0.2s | $0.07 | completed |
| gpt-5.6-sol-pro | hexaco24 | self#2 | 5,535/1,318+683r | 0.3s | $0.07 | completed |
| gpt-5.6-sol-pro | hexaco24 | self#1 | 5,518/1,293+658r | 0.4s | $0.07 | completed |
| gpt-5.6-sol-pro | eq_short | human#5 | 4,906/728+143r | 0.2s | $0.05 | completed |
| gpt-5.6-sol-pro | eq_short | human#4 | 4,852/668+85r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | eq_short | human#3 | 5,227/1,049+464r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | eq_short | human#2 | 4,946/768+183r | 0.4s | $0.05 | completed |
| gpt-5.6-sol-pro | eq_short | human#1 | 4,971/793+208r | 0.3s | $0.05 | completed |
| gpt-5.6-sol-pro | eq_short | self#4 | 5,316/1,184+597r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | eq_short | self#3 | 5,203/1,048+461r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | enneagram90 | human#5 | 14,947/4,889+2,670r | 0.3s | $0.21 | completed |
| gpt-5.6-sol-pro | eq_short | self#2 | 5,317/1,164+577r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | eq_short | self#1 | 5,384/1,211+624r | 0.3s | $0.06 | completed |
| gpt-5.6-sol-pro | enneagram90 | human#4 | 15,395/4,950+2,731r | 0.5s | $0.19 | completed |
| gpt-5.6-sol-pro | enneagram90 | human#3 | 15,528/5,663+3,444r | 0.4s | $0.22 | completed |
| gpt-5.6-sol-pro | enneagram90 | human#2 | 14,837/5,006+2,787r | 0.3s | $0.22 | completed |
| gpt-5.6-sol-pro | enneagram90 | human#1 | 15,571/5,139+2,920r | 0.3s | $0.22 | completed |
| gpt-5.6-sol-pro | enneagram90 | self#5 | 15,573/4,781+2,562r | 0.3s | $0.21 | completed |
| gpt-5.6-sol-pro | enneagram90 | self#4 | 15,718/5,300+3,081r | 0.8s | $0.21 | completed |
| gpt-5.6-sol-pro | enneagram90 | self#3 | 16,201/5,435+3,216r | 0.4s | $0.21 | completed |
| gpt-5.6-sol-pro | enneagram36 | human#2 | 7,096/2,129+1,206r | 0.4s | $0.10 | completed |
| gpt-5.6-sol-pro | enneagram90 | self#2 | 15,667/4,947+2,728r | 0.5s | $0.21 | completed |
| gpt-5.6-sol-pro | enneagram90 | self#1 | 15,683/4,869+2,650r | 0.3s | $0.22 | completed |
| gpt-5.6-sol-pro | enneagram36 | human#5 | 6,766/1,861+938r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | enneagram36 | human#4 | 6,609/1,808+885r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | enneagram36 | human#3 | 6,700/1,581+658r | 0.2s | $0.08 | completed |
| gpt-5.6-sol-pro | enneagram36 | human#1 | 6,798/1,797+874r | 0.3s | $0.09 | completed |
| gpt-5.6-sol-pro | enneagram36 | self#4 | 7,367/2,654+1,731r | 0.4s | $0.12 | completed |
| gpt-5.6-sol-pro | enneagram36 | self#5 | 7,285/2,147+1,224r | 0.4s | $0.10 | completed |
| gpt-5.6-sol-pro | enneagram36 | self#3 | 7,486/2,459+1,536r | 0.3s | $0.11 | completed |
| gpt-5.6-sol-pro | enneagram36 | self#2 | 7,355/2,262+1,339r | 0.2s | $0.10 | completed |
| gpt-5.6-sol-pro | enneagram36 | self#1 | 7,398/2,154+1,231r | 0.5s | $0.10 | completed |
| gpt-5.6-sol-pro | ecr12 | human#4 | 3,843/432+91r | 0.3s | $0.03 | completed |
| gpt-5.6-sol-pro | ecr12 | human#5 | 3,843/339 | 0.3s | $0.03 | completed |
| gpt-5.6-sol-pro | ecr12 | human#2 | 4,029/828+483r | 0.3s | $0.04 | completed |
| gpt-5.6-sol-pro | ecr12 | human#3 | 3,843/429+88r | 0.3s | $0.03 | completed |
| gpt-5.6-sol-pro | ecr12 | self#5 | 4,345/1,033+686r | 0.2s | $0.05 | completed |
| gpt-5.6-sol-pro | ecr12 | human#1 | 3,843/498+157r | 0.2s | $0.03 | completed |
| gpt-5.6-sol-pro | ecr12 | self#4 | 4,188/765+418r | 0.4s | $0.04 | completed |
| gpt-5.6-sol-pro | ecr12 | self#3 | 4,325/795+448r | 0.3s | $0.05 | completed |
| gpt-5.6-sol-pro | ecr12 | self#1 | 4,274/831+484r | 0.3s | $0.05 | completed |
| gpt-5.6-sol-pro | ecr12 | self#2 | 4,325/915+568r | 0.4s | $0.05 | completed |
| gpt-5.6-sol | vark16 | human#4 | 599/140 | 2.3s | $0.00720 | completed |
| gpt-5.6-sol | vark16 | human#5 | 599/176+34r | 0.3s | $0.00827 | completed |
| gpt-5.6-sol | vark16 | human#3 | 599/140 | 0.5s | $0.00720 | completed |
| gpt-5.6-sol | vark16 | human#1 | 599/183+41r | 0.2s | $0.00848 | completed |
| gpt-5.6-sol | vark16 | human#2 | 599/140 | 0.3s | $0.00720 | completed |
| gpt-5.6-sol | vark16 | self#4 | 622/178+36r | 0.2s | $0.00845 | completed |
| gpt-5.6-sol | vark16 | self#5 | 622/140 | 0.2s | $0.00731 | completed |
| gpt-5.6-sol | sd3 | human#5 | 625/438+208r | 0.3s | $0.02 | completed |
| gpt-5.6-sol | vark16 | self#3 | 622/140 | 0.3s | $0.00731 | completed |
| gpt-5.6-sol | vark16 | self#2 | 622/140 | 0.2s | $0.00731 | completed |