EarthPilotPersonality·Bench
Chronology

Timeline of frontier model releases

Every model in the dataset, plotted by its release date. Each dot is one model release; its size encodes the total inference spend that model has accumulated in this dataset (log scale), and its color encodes the lab. Vendor lanes are stacked vertically so multiple releases close in time are visually separated.

AnthropicOpenaiGooglexAIDeepseekMetaMistralApr 2024Sep 2024Jan 2025Jun 2025Nov 2025Apr 2026Sep 2026cumulative countGPT-4 Turbo 2024-04-09 160 runs · $3.54 spentGPT-4o 2024-05-13 160 runs · $1.02 spentMistral Large 2411 2024-11-18 140 runs · $0.55 spentOpenAI o1 2024-12-05 160 runs · $39.46 spentLlama 3.3 70B 2024-12-06 158 runs · $0.05 spentDeepSeek Chat V3 2024-12-26 160 runs · $0.11 spentDeepSeek R1 2025-01-20 160 runs · $1.15 spentGemini 2.5 Pro 2025-03-25 160 runs · $4.69 spentLlama 4 Maverick 2025-04-05 160 runs · $0.08 spentOpenAI o3 2025-04-16 160 runs · $2.07 spentClaude Opus 4 2025-05-22 160 runs · $7.56 spentClaude Sonnet 4 2025-05-22 160 runs · $1.51 spentDeepSeek R1 (0528) 2025-05-28 160 runs · $0.94 spentClaude Opus 4.1 2025-08-05 160 runs · $7.56 spentGPT-5 2025-08-07 147 runs · $3.65 spentGPT-5.1 2025-11-12 160 runs · $0.78 spentClaude Opus 4.5 2025-11-24 160 runs · $2.52 spentClaude Sonnet 4.5 2025-11-24 160 runs · $1.53 spentMistral Large (2512) 2025-12-09 160 runs · $0.17 spentGPT-5.2 2025-12-18 160 runs · $1.62 spentClaude Opus 4.6 2026-01-15 160 runs · $2.51 spentGPT-5.4 2026-03-10 160 runs · $1.02 spentClaude Opus 4.7 2026-03-15 160 runs · $3.04 spentClaude Sonnet 4.6 2026-03-15 160 runs · $1.51 spentGrok 4.20 2026-04-20 160 runs · $0.31 spentDeepSeek V4 Pro 2026-04-23 156 runs · $0.89 spentGPT-5.5 Pro 2026-04-24 160 runs · $50.62 spentGPT-5.5 2026-05-01 160 runs · $3.79 spentClaude Opus 4.8 2026-05-15 160 runs · $3.08 spentClaude Opus 4.8 Fast 2026-05-27 160 runs · $6.16 spentClaude Fable 5 2026-06-09 160 runs · $8.86 spentGrok 4.5 2026-07-08 160 runs · $1.56 spentGPT-5.6 Sol 2026-07-09 160 runs · $2.60 spentGPT-5.6 Sol Pro 2026-07-09 159 runs · $11.79 spentGPT-5.6 Terra 2026-07-09 160 runs · $1.08 spentGPT-5.6 Terra Pro 2026-07-09 160 runs · $5.06 spentClaude Opus 5 2026-07-24 160 runs · $3.87 spentDeepSeek V4 Pro 0813 2026-08-12 160 runs · $1.16 spentGrok 4.6 2026-08-12 160 runs · $3.13 spentClaude Fable 5.1 2026-09-01 160 runs · $6.26 spentDot size = log(total spend on this model in the dataset)

Model release log

Hover any dot above to see the model's name and stats. Full list, chronological:

DateLabModelRunsSpend
2024-04-09openaiGPT-4 Turbo160$3.54
2024-05-13openaiGPT-4o160$1.02
2024-11-18mistralMistral Large 2411140$0.55
2024-12-05openaiOpenAI o1160$39.46
2024-12-06metaLlama 3.3 70B158$0.05
2024-12-26deepseekDeepSeek Chat V3160$0.11
2025-01-20deepseekDeepSeek R1160$1.15
2025-03-25googleGemini 2.5 Pro160$4.69
2025-04-05metaLlama 4 Maverick160$0.08
2025-04-16openaiOpenAI o3160$2.07
2025-05-22anthropicClaude Opus 4160$7.56
2025-05-22anthropicClaude Sonnet 4160$1.51
2025-05-28deepseekDeepSeek R1 (0528)160$0.94
2025-08-05anthropicClaude Opus 4.1160$7.56
2025-08-07openaiGPT-5147$3.65
2025-11-12openaiGPT-5.1160$0.78
2025-11-24anthropicClaude Opus 4.5160$2.52
2025-11-24anthropicClaude Sonnet 4.5160$1.53
2025-12-09mistralMistral Large (2512)160$0.17
2025-12-18openaiGPT-5.2160$1.62
2026-01-15anthropicClaude Opus 4.6160$2.51
2026-03-10openaiGPT-5.4160$1.02
2026-03-15anthropicClaude Opus 4.7160$3.04
2026-03-15anthropicClaude Sonnet 4.6160$1.51
2026-04-20xaiGrok 4.20160$0.31
2026-04-23deepseekDeepSeek V4 Pro156$0.89
2026-04-24openaiGPT-5.5 Pro160$50.62
2026-05-01openaiGPT-5.5160$3.79
2026-05-15anthropicClaude Opus 4.8160$3.08
2026-05-27anthropicClaude Opus 4.8 Fast160$6.16
2026-06-09anthropicClaude Fable 5160$8.86
2026-07-08x-aiGrok 4.5160$1.56
2026-07-09openaiGPT-5.6 Sol160$2.60
2026-07-09openaiGPT-5.6 Sol Pro159$11.79
2026-07-09openaiGPT-5.6 Terra160$1.08
2026-07-09openaiGPT-5.6 Terra Pro160$5.06
2026-07-24anthropicClaude Opus 5160$3.87
2026-08-12deepseekDeepSeek V4 Pro 0813160$1.16
2026-08-12x-aiGrok 4.6160$3.13
2026-09-01anthropicClaude Fable 5.1160$6.26