TECH

Learning reveals hidden information about network structure
Learning in the brain involves changes in the connections between neurons, but its effects show up in the system’s overall behavior. How do the many changes in these connections combine to alter the system’s function? In a new study, Technion researchers examined this relationship using mathematical models of neural networks, showing that a network’s function and learning reveal different aspects of its internal structure.The paper by Prof. Omri Barak and research student Yoav Ger of the Technion’s Ruth and Bruce Rappaport Faculty of Medicine was selected for an oral presentation at NeurIPS 2026, one of the world’s leading conferences in artificial intelligence and computational neuroscience. Of the 30,709 papers submitted to the conference, only 112 (approximately 0.36%) were selected for oral presentations.
The researchers focused on a particular type of recurrent neural network, used to model how the brain processes information. They developed a mathematical description that makes it possible to calculate how a network changes during learning using a small number of variables. Their analysis distinguished between two types of properties: those that determine the network’s actual behavior and those that do not affect its current performance but influence how it learns in the future. These “hidden” properties are not apparent when examining the system’s behavior alone, but they may emerge when the system is required to learn a new task.
In one example in the study, two networks with different internal structures responded identically to the same inputs. However, when trained under the same conditions, they followed different learning trajectories: one experienced a period in which improvement slowed considerably, while the other improved more steadily. Learning itself can therefore serve as a research tool, revealing differences that are not apparent when examining only the system’s current function.
The study also demonstrated that, under certain conditions, these hidden properties can retain traces of the network’s learning history. Networks initially trained on different tasks and subsequently trained on a shared task achieved similar performance, yet their hidden structural properties still made it possible to identify each network’s training history.
“The question of how changes in the structure of a complex system affect its behavior arises in many fields of science,” said Prof. Barak. “In the networks we studied, we found that understanding what the system does today is not enough to describe how it will learn in the future. The way it changes through learning can reveal structural differences that remain hidden in its current function.”
The results were obtained using mathematical models and computer simulations. They suggest a direction for experiments in biological systems: examining how systems with similar behavior change in response to the same learning process, and determining which internal differences can be revealed in this way.
The research was supported by the Israel Science Foundation (ISF) and the Human Frontier Science Program.
Unveiling the hidden layers of deep learning...In a Scientific American article entitled “Springtime for AI: The Rise of Deep Learning,” computer scientist Yoshua Bengio explains why complex neural networks are the key to true artificial intelligence as people have long envisioned it. It seems logical that the way to make computers as smart as humans is to program them to behave like human brains. However, given how little we know of how the brain functions, this task seems more than a little daunting. So how does deep learning work?
Evidently, these so-called “hidden layers” play a key role in breaking down visual components to decode the image as a whole. And we know there is an order to how the layers act: from input to output, each layer handles increasingly complex information. But beyond that, the hidden layers—as their name suggests—are shrouded in mystery.
As part of a recent collaborative project called Tensor Flow, Daniel Smilkov and Shan Carter created a neural network playground, which aims to demystify the hidden layers by allowing users to interact and experiment with them.
There is a lot going on in this visualization, and I was recently fortunate enough to hear Fernanda Viégas and Martin Wattenberg break some of it down in their keynote talk at OpenVisConf. (Fernanda and Martin were part of the team behind Tensor Flow, which is a much more complex, open-source tool for using neural networks in real-world applications.)


Rather than something as complicated as faces, the neural network playground uses blue and orange points scattered within a field to “teach” the machine how to find and echo patterns. The user can select different dot-arrangements of varying degrees of complexity, and manipulate the learning system by adding new hidden layers, as well as new neurons within each layer. Then, each time the user hits the “play” button, she can watch as the background color gradient shifts to approximate the arrangement of blue and orange dots. As the pattern becomes more complex, additional neurons and layers help the machine to complete the task more successfully.
Besides the neuron layers, the machine has other meaningful features, such as the connections among the neurons. The connections appear as either blue or orange lines, blue being positive—that is, the output for each neuron is the same as its content—and orange being negative—meaning the output is the opposite of each neuron’s values. Additionally, the thickness and opacity of the connection lines indicate the confidence of the prediction each neuron is making, much like the connections in our brains strengthen as we advance through a learning process.
Interestingly, as we get better at building neural networks for machines, we may end up revealing new information about how our own brains work. Visualizing and playing with the hidden layers seems like a great way to facilitate this process while also making the concept of deep learning accessible to a wider audience.








