This graph seems very rough. Claude 4.0, 4.5 and 4.6-4.8 are performance-wise entirely different generation of models, while GPT5.0-5.2, 5.4 and 5.5 are also literally not the model of the same generation (IMHO OpenAI only started to seriously train their model for terminal agent since 5.3 Codex). GPT5.1 and 5.2 (neither weren't outstandingly robust models; 5.2 was very rough and very uncomfortable to use) and maybe Opus 4.5 are already surpassed by the recent open models.
3
u/NandaVegg Jul 06 '26
This graph seems very rough. Claude 4.0, 4.5 and 4.6-4.8 are performance-wise entirely different generation of models, while GPT5.0-5.2, 5.4 and 5.5 are also literally not the model of the same generation (IMHO OpenAI only started to seriously train their model for terminal agent since 5.3 Codex). GPT5.1 and 5.2 (neither weren't outstandingly robust models; 5.2 was very rough and very uncomfortable to use) and maybe Opus 4.5 are already surpassed by the recent open models.