OpenAI: performance of coding agents in its own research is uneven
OpenAI now describes the performance of coding agents in accelerating its internal AI research as uneven across domains, and is examining the connection with the recursive self-improvement of agents. It previously released data on agent usage and experiment speed.
New: The performance of coding agents remains uneven across different research domains; OpenAI is examining the connection with the recursive self-improvement of agents; The measurement focuses on identifying the boundaries between the agents' current capabilities and their limits
Companies planning to deploy coding agents in internal research or development should not expect uniform acceleration across projects — according to data from OpenAI, the benefit of agents varies significantly between research domains, which affects estimates of return on investment in development automation.