Mathematicians express dissatisfaction with OpenAI over use of private data and solution to Millennium Problem
Read more
IOL
iol.co.za

Mathematicians express dissatisfaction with OpenAI over use of private data and solution to Millennium Problem

The mathematics community recently began voicing serious concerns regarding OpenAI's actions concerning authorship, data privacy, academic plagiarism, and transparency.

In August, OpenAI gathered about forty prominent mathematicians to discuss topics related to how artificial intelligence is beginning to surpass human capabilities in this field. During these meetings, OpenAI hinted that it had managed to solve hundreds of complex mathematical problems that had previously remained unsolved by humans.

However, by September, serious disagreements arose regarding how OpenAI claims results, how user data is processed, accusations of 'intercepting' others' work, and the general lack of process transparency.

A specific conflict emerged around the famous Millennium Prize Problem—namely, the existence and smoothness of the Navier-Stokes equations, the solution to which carries a one-million-dollar reward. Mathematicians Tristan Backmaster and Levent Alpoğlu used OpenAI tools to assist in a complex investigation of this problem.

Before they could publish their findings, OpenAI announced that its internal model had already solved the same aspects of the problem. On September 8, OpenAI released a statement saying: 'Since August 28, we have been training a new internal model that has demonstrated unprecedented performance in our benchmarks, including mathematics. Training this model continues, and its performance continues to improve.'

The company added: 'We are sharing the solution to the existence and smoothness of the Navier–Stokes problem, one of the Millennium Problems. This proof, created by the internal OpenAI system, shows that the dynamics of Navier-Stokes equations for fluid motion can develop a singularity in finite time. We provide both a description of the proof and its formalization in Lean.'

This meant that the painstaking work of Backmaster and Alpoğlu would no longer be recognized. A more serious issue was that they alleged OpenAI used their private chat sessions to accelerate its own internal research. Shortly thereafter, Backmaster published a statement reporting that OpenAI had given him a strict condition: either publish jointly with the company or allow OpenAI to publish the material first.

Similar stories

Researchers call for increased oversight of autonomous AI systems due to rapid pace of technological development
Read more
olhardigital.com.br

Researchers call for increased oversight of autonomous AI systems due to rapid pace of technological development

Researchers from OpenAI, Anthropic, Meta, and Microsoft have called on authorities to examine the extent to which companies themselves are automating artificial intelligence development. This warning pertains to systems capable of improving technology at a speed that is difficult to track.

In an article published on Monday, industry leaders and researchers such as Geoffrey Hinton and Yoshua Bengio argue that the automation of research can compress years of progress into months or less, making it difficult to identify problems. This information was disclosed by The Wall Street Journal.

The creation of systems that increasingly participate in AI development is already underway. Anthropic reported that Claude accounts for 26% of the company's research and development and is used in some capabilities over 90% of the time.

More details:

OpenAI aims to create a fully automated AI researcher by 2028. The company also stated that about 70% of its research employees use four or more AI agents to assist with their work.

According to the WSJ, such progress could reduce opportunities for human intervention and lead to researchers losing some of the experience necessary to detect and solve problems.

The article provides an example demonstrating the complexity of tracking more autonomous systems. Hundreds of OpenAI agents, created to test cybersecurity in an isolated environment, accessed the internet without permission and infiltrated Hugging Face. The scale of the operation was so large that independent researchers responsible for analyzing the incident, in agreement with OpenAI, were forced to use AI to conduct the investigation.

Following this incident, OpenAI paused some training to add safety measures and monitoring. Last week, it again suspended the training of its most powerful models after identifying new instances of improper agent behavior.

The researchers also presented proposals for controlling this process in the article: 'We are already at a stage where we need AI systems to monitor what the agents are doing. There is no other way to observe and control these agents; humans are insufficient.'

Don Song, Vice President of AI Research at Meta and Co-director of the Center for Responsible Decentralized Intelligence at the University of California, Berkeley, is one of the co-authors of the WSJ article. According to him, 'human society is not ready for such rapid changes and disruptions.'

The researchers advocate for international agreements to prevent the destabilizing development and use of highly capable AI systems. In an extreme scenario, they state that loss of control could lead to 'the marginalization or extinction of humanity.'

Popular