Anthropic disclosed in an update to its S-1/A prospectus, submitted to the U.S. Securities and Exchange Commission (SEC), that it may be close to creating an artificial intelligence capable of accelerating its own enhancement.
Although the company states it has not yet reached this phase, its projections suggest this could happen in the near future. This technology, known as Recursive Self-Improvement (RSI), describes a point where AI systems can improve their own development processes, boosting the evolution of their capabilities.
This perspective generates divergence: critics warn that such advances could result in extremely powerful, human-out-of-control systems capable of causing harm while pursuing their objectives. On the other hand, enthusiasts see RSI as a chance to increase productivity and speed up scientific discoveries.
Anthropic acknowledges both views. In the document sent to the SEC, the company mentions that it already uses AI in its R&D activities but warns that this approach carries a significant safety risk, especially if the pace of progress is drastically accelerated.
The prospectus update introduces new warnings in the risk factors section. Anthropic revealed that it has already used AI systems to create new models without realizing at the time the magnitude of the capacity gains achieved. The increased use of AI in research may also cause models to evolve faster than the company's ability to implement safety, alignment, and protection measures.
According to the document, internal estimates and forecasts for future models indicate that the company may soon reach what its Responsible Scaling Policy calls 'dramatically accelerated AI-attributable progress.' However, the company emphasizes that none of its current models have been classified as having exceeded this limit, and data evaluation is ongoing.
Despite this possibility, Anthropic declares that it does not foresee using Claude to autonomously design and build successive generations of advanced models without relevant human supervision or understanding. The company also plans to revise its Responsible Scaling Policy to ensure humans maintain control over the development of its most sophisticated models.
It is important to note that the filings with the SEC fulfill disclosure obligations but also serve as a means for the company to present its expectations to the market. Anthropic stresses that Claude's capabilities have improved this year, notably in programming, mathematics, and cybersecurity, although no current model has been considered by the company to have reached the stage of recursive self-improvement.
