Cloud Hosting

Summary: Researchers created a virtual rat with an AI brain to study how real rats control movement. Using data from real rats, they trained the AI to mimic behaviors in a physics simulator.

The virtual rats neural activations closely matched those of real rats, offering new insights into brain function. This innovation could revolutionize neuroscience and improve robotic control systems.

Key Facts:

Source: Harvard

The agility with which humans and animals move is an evolutionary marvel thatno robot has yet been able to closely emulate.

To help probe the mystery of how brains control movement, Harvard neuroscientists have created a virtual rat with an artificial brain that can move around just like a real rodent.

Bence lveczky, professor in the Department of Organismic and Evolutionary Biology, led a group of researchers who collaborated with scientists at Googles DeepMind AI lab to build a biomechanically realistic digital model of a rat.

Using high-resolution data recorded from real rats, they trained an artificial neural network the virtual rats brain to control the virtual body in a physics simulator calledMuJoco, where gravity and other forces are present.

Publishing inNature,the researchers found that activations in the virtual control network accurately predicted neural activity measured from the brains of real rats producing the same behaviors, said lveczky, who is an expert at training (real) rats to learn complex behaviors in order to study their neural circuitry.

The feat represents a new approach to studying how the brain controls movement, lveczky said, by leveraging advances in deep reinforcement learning and AI, as well as 3D movement-tracking in freely behaving animals.

The collaboration was fantastic, lveczky said. DeepMind had developed a pipeline to train biomechanical agents to move around complex environments. We simply didnt have the resources to run simulations like those, to train these networks.

Working with the Harvard researchers was, likewise, a really exciting opportunity for us, said co-author and Google DeepMind Senior Director of Research Matthew Botvinick.

Weve learned a huge amount from the challenge of building embodied agents: AI systems that not only have to think intelligently, but also have to translate that thinking into physical action in a complex environment.

It seemed plausible that taking this same approach in a neuroscience context might be useful for providing insights in both behavior and brain function.

Graduate student Diego Aldarondo worked closely with DeepMind researchers to train the artificial neural network to implement what are called inverse dynamics models, which scientists believe our brains use to guide movement. When we reach for a cup of coffee, for example, our brain quickly calculates the trajectory our arm should follow and translates this into motor commands.

Similarly, based on data from actual rats, the network was fed a reference trajectory of the desired movement and learned to produce the forces to generate it. This allowed the virtual rat to imitate a diverse range of behaviors, even ones it hadnt been explicitly trained on.

These simulations may launch an untapped area of virtual neuroscience in which AI-simulated animals, trained to behave like real ones, provide convenient and fully transparent models for studying neural circuits, and even how such circuits are compromised in disease.

While lveczkys lab is interested in fundamental questions about how the brain works, the platform could be used, as one example, to engineer better robotic control systems.

A next step might be to give the virtual animal autonomy to solve tasks akin to those encountered by real rats.

From our experiments, we have a lot of ideas about how such tasks are solved, and how the learning algorithms that underlie the acquisition of skilled behaviors are implemented, lveczky continued.

We want to start using the virtual rats to test these ideas and help advance our understanding of how real brains generate complex behavior.

Author: Anne Manning Source: Harvard Contact: Anne Manning Harvard Image: The image is credited to Google DeepMind

Original Research: Closed access. A virtual rodent predicts the structure of neural activity across behaviors by Bence lveczky et al. Nature

Abstract

A virtual rodent predicts the structure of neural activity across behaviors

Animals have exquisite control of their bodies, allowing them to perform a diverse range of behaviors. How such control is implemented by the brain, however, remains unclear. Advancing our understanding requires models that can relate principles of control to the structure of neural activity in behaving animals.

To facilitate this, we built a virtual rodent, in which an artificial neural network actuates a biomechanically realistic model of the ratin a physics simulator.

We used deep reinforcement learningto train the virtual agent to imitate the behavior of freely-moving rats, thus allowing us to compare neural activity recorded in real rats to the network activity of a virtual rodent mimicking their behavior.

We found that neural activity in the sensorimotor striatum and motor cortex was better predicted by the virtual rodents network activity than by any features of the real rats movements, consistent with both regions implementing inverse dynamics.

Furthermore, the networks latent variability predicted the structure of neural variability across behaviors and afforded robustness in a way consistent with the minimal intervention principle of optimal feedback control.

These results demonstrate how physical simulation of biomechanically realistic virtual animals can help interpret the structure of neural activity across behavior and relate it to theoretical principles of motor control.

Read more from the original source:
Virtual Rat with AI Brain Mimics Real Rodent Movement - Neuroscience News