DIGITAL LIFE

Artificial intelligence may start to "unlearn," and researchers explain why
For years, artificial intelligence has evolved thanks to the vast volume of text, images, and information produced by billions of people around the world. But this landscape is changing rapidly. Today, a growing share of the content available on the internet is no longer created by humans, but by other artificial intelligences. This transformation might seem natural, but a new study reveals a hidden challenge that could directly affect the future of AI itself.
Recent advances in artificial intelligence have spawned tools capable of writing articles, creating images, developing code, and answering questions with impressive quality. Consequently, the amount of synthetic content available online is growing at an unprecedented rate.
The problem is that this very content ends up being used to train future generations of models. Instead of learning solely from books, scientific research, newspapers, and human-written texts, AI is beginning to consume material produced by other machines.
It was precisely this phenomenon that caught the attention of researchers in a study published in the scientific journal *npj Artificial Intelligence*. According to the authors, this cycle can trigger a process known as "model collapse"—a gradual degradation of the systems' learning capabilities.
Unlike a sudden failure, this problem unfolds slowly. Each new generation learns from a larger volume of artificial data and, little by little, begins to reproduce increasingly repetitive patterns, losing some of the diversity found in the original information.
The researchers explain that the risk does not lie in the occasional use of AI-generated content. On the contrary, such material can be extremely useful in various applications. The challenge arises when it begins to replace a significant portion of human-produced content, reducing the variety of examples available during training.
A simple comparison helps illustrate the phenomenon: imagine making a copy of a photograph and then repeatedly copying that new image. Each reproduction looks virtually identical to the last, yet small losses of detail accumulate until the final result no longer preserves the full richness of the original photograph. To address this challenge, researchers developed a new training strategy called Confidence-Aware Loss, designed to make learning more balanced.
The method stems from an interesting observation: when a model encounters highly predictable examples, it quickly learns those patterns and begins assigning a high degree of confidence to its responses. However, continuing to reinforce these same examples adds little value to the learning process.
The solution involves reducing the weight given to these overly predictable cases and focusing more attention on less common examples that contain more varied information. To achieve this, scientists created a technique called Truncated Cross-Entropy, which redistributes the weight assigned to different types of data during training.
In practice, this helps the system maintain a richer representation of language and knowledge, preventing highly frequent responses from completely dominating the learning process.
Tests yielded very promising results. According to the researchers, the models were able to handle more than 2.3 times the amount of synthetic content before showing significant signs of so-called "model collapse."
Although the technique does not entirely eliminate the problem, it significantly expands the systems' ability to combine human-produced data with AI-generated content without compromising response quality.
The study also launched an open platform allowing other researchers to test new solutions and compare different training methods.
The main conclusion goes beyond the creation of a new algorithm. The rapid growth of AI-generated content makes preserving original sources of information increasingly important. In the future, the evolution of artificial intelligence will depend not only on the quantity of available data but also on the diversity and quality of that information. Preventing machines from learning solely from other machines may well be one of the greatest technological challenges of the coming decade.
mundophone


/i.s3.glbimg.com/v1/AUTH_e536e40f1baf4c1a8bf1ed12d20577fd/internal_photos/bs/2026/8/z/AH8sJTSq2brbWdEXZUrQ/messi-infantino.gif)