Skip to content

Archive

July 26, 2026

1 event

Importance: monitoring Anthropic New models update 1 source

OpenAI claims that GPT-5.6 Sol outperformed Opus 5 on ARC-AGI-3 – but only with its own testing environment

OpenAI states that GPT-5.6 Sol achieved a score of 38.3 % on ARC-AGI-3 compared with 30.2 % for Opus 5 from Anthropic. However, this holds only with the custom API configuration used by OpenAI; in the official test, GPT-5.6 Sol scores only 7.8 %.

New: OpenAI achieves 38.3 % on ARC-AGI-3 with its own API setup (Retained Reasoning + Compaction); In the official harness without these features, GPT-5.6 Sol scores only 7.8 %; ARC-AGI-3 was deliberately designed without external aids to measure raw model performance; Retained Reasoning and Compaction are not part of the official testing environment; Benchmark results reflect both the model and the technical setup around it