How Modern Robots Are Developed
Today, neuroscience and robotics are developing hand in hand. Mikhail Lebedev, Academic Supervisor at HSE University’s Centre for Bioelectric Interfaces, spoke about how studying the brain inspires the development of robots.
Robots are interesting to neuroscience and neuroscience is interesting to robots —this is what our article ‘Neuroengineering challenges of fusing robotics and neuroscience’ was about in the journal Science Robotics. Such collaborative development contributes to progress in both fields, bringing us closer to developing more advanced android robots and a deeper understanding of the structure of the human brain. And, to some extent, to combining biological organisms with machines, to create cybernetic organisms (cyborgs).
Neuroscience for Robots
Robots often resemble humans in their make-up. This is true for robots that are meant to mimic human actions and behaviour — neuroscience is less important to industrial machines.
The most obvious thing to use in the design of a robot is to make it look human. Robots often have two arms, two legs and a head, even if it is not necessary from an engineering point of view. This is especially important when the robot will interact with people — a machine that looks like us is easier to trust.
It is possible to ensure that not only the appearance, but also the ‘brain’ of the robot resembles that of a human. In developing the mechanisms for perception, information processing, and control, engineers are inspired by the structure of the human nervous system.
For example, a robot's eyes — TV cameras that can move on different axes — mimic the human visual system. Based on the knowledge of how human vision is structured and how the visual signal is processed, engineers design the robot's sensors according to the same principles. In this way the robot can be endowed with the human ability to see the world in three dimensions, for example.
Humans have a vestibulo-ocular reflex: the eyes apply stabilisation using vestibular information when we move, allowing us to maintain the stability of the picture we see. There may also be acceleration and orientation sensors on a robot's body. These help the robot to take body movements into account to stabilise the visual perception of the outside world and improve agility.
In addition, a robot can experience the sense of touch just like a human — a robot can have skin, it can feel touched. And then it doesn't just move randomly in space: if it touches an obstacle, it senses it and reacts to it just like a human does. It can also use this artificial tactile information to grip objects.
Robots can even simulate sensations of pain: some forms of physical contact feel normal and some cause pain, which drastically changes the robot's behaviour. It starts to avoid pain and develop new behaviour patterns, i.e. it learns — like a child who has been burned by something hot for the first time.
Not only sensory systems, but also a robot's body control can be designed analogously to that of humans. In humans, walking is controlled by so-called central rhythm generators — specialized nerve cells designed to control autonomous motor activity. There are robots in which the same idea is used to control walking.
In addition, robots can learn from humans. A robot can perform actions in an infinite number of ways, but if it wants to mimic a human, it must observe the human and try to repeat their movements. When it makes mistakes, it compares itself with how a human performs the same action.
Robots for Neuroscience
How can neuroscience use robots? When we build a model of a biological system, we begin to better understand the principles by which it works. Therefore, developing mechanical and computer models of human nervous system movement control brings us closer to understanding neurological functions and biomechanics.
And the most promising area of using robots in modern neuroscience is in designing neurointerfaces — systems for controlling external devices using brain signals. Neurointerfaces are necessary for the development of neuroprostheses (for example, an artificial arm for people who have lost a limb) and exoskeletons — external frames or skeletons for a human body to increase its strength or restore lost motor ability.
A robot can interact with the nervous system through a bi-directional interface: the nervous system can send a command signal to the robot, and the robot from its sensors can return sensory information to the human, causing real sensations by stimulating nerves, nerve endings in the skin, or the sensory cortex itself. Such feedback mechanisms make it possible to restore the sensation of a limb if it has been lost. They are also necessary for more precise movements of the robotic limb, since it is on the basis of sensory information received from the arms and legs that we correct our movements.
There is an interesting question that arises here: Should we control all degrees of freedom of the robot through a neural interface? In other words, how should we send specific commands to it? For example, we can ‘order’ the robotic arm to pick up a bottle of water, and it will perform specific operations: it will lower its arm, turn it, and unclench and clench the fingers on its hand — all on its own. This approach is called combined control — we give simple commands through a neural interface, and a special controller inside the robot selects the best strategy for implementation. Or we can create a mechanism that will not understand the ‘take the bottle’ command: it needs to be sent information about specific, detailed movements.
Current Studies
Neuroscientists and robotic scientists study various aspects of brain operation and robotic devices. For example, at Duke University I conducted experiments with neural interfaces on monkeys, since interfaces need to be directly connected to brain areas for them to work accurately and such experimental interventions are not always possible to be performed on humans.
In one of my studies, a monkey walked along a path and the activity of its motor cortex, which is responsible for leg movement, was read and triggered a robot to start walking. At the same time, the monkey observed this walking robot on a screen placed in front of it.
The monkey used feedback, so it corrected its movements based on what it saw on the screen. This is how the most effective neural interfaces for implementing walking are developed.
The Cybernetic Future
Such research leads us to innovative developments in the future. For example, creating an exoskeleton to restore the movements of completely paralysed people no longer seems like an unattainable fantasy — it just takes time. Progress may be held back by the lack of computer power, but development over the past ten years has also been enormous here. It is likely that we will soon see people around us using light, comfortable exoskeletons rather than wheelchairs or strollers to get around. Human cyborgs will become commonplace.
Commercial development of such systems is taking place all over the world, including in Russia. For example, the famous ExoAtlet project is developing exoskeletons for the rehabilitation of people with motor disabilities. The HSE Centre for Bioelectric Interfaces participated in the development of algorithms for these machines: Centre Head, Professor Alexey Ossadtchi, and his doctoral students developed a neurointerface that triggers the walking movements of the exoskeleton.
The rapid development of humanoid robots is also becoming a reality. It is likely that we will soon have robots walking around imitating us in many respects —moving like us and thinking like us. They will be able to do some of the work previously available only to humans.
Obviously, we will see the development of both robotics and neuroscience, and these fields will converge. This not only opens up new opportunities, but also creates new ethical questions, such as how we should treat android robots or human cyborgs.
And yet, so far, humans are better than robots in many ways. Our muscles are the most economical: eat a sandwich and you will have enough energy for the whole day. The robot will have a flat battery in half an hour. And although it may be much more powerful than a human, it is often too heavy. When it comes to elegance and energy capacity optimisation — so far, a human is still superior to a robot.
It is not far into the future when this will change — there are tens of thousands of talented scientists and engineers working towards this goal.
Interviewed by Anastasia Lobanova
See also:
Why Ice Cream Tastes Better in Hot Weather: HSE's Science Republic Takes Part in Popular Science Festival at VDNKh
In early June, the Science Republic initiative of the Centre for Student Academic Development presented popular science projects at the Science and Ice Cream Festival at VDNKh. On June 5, 13, and 14, HSE University ran an extensive programme of events, from lectures to intellectual games. The events took place at the BIOTECH Museum, Museum of Urban Economy of Moscow, and Smart City pavilions.
Wearable Device Data and Saliva Biomarkers Help Assess Stress Resilience
A team of scientists, including researchers from HSE University, has proposed a method for assessing stress resilience using physiological markers derived from wearable devices and saliva samples. The participants who adapted better to stress showed higher heart rate variability, higher zinc concentrations in saliva, and lower potassium levels. The findings were published in the Journal of Molecular Neuroscience.
HSE Researchers Propose New Method of Verbal Fluency Analysis for Early Detection of Cognitive Impairment
Researchers from the HSE Center for Language and Brain and the Mental Health Research Centre have proposed a new method of linguistic analysis that enables the distinction between normal and pathological ageing. Using this approach, they showed that patterns in patients’ word choices during verbal fluency tests allow clinicians to more accurately differentiate clinically significant impairments from subjective memory complaints. Incorporating this type of analysis into clinical practice could improve the accuracy of early dementia diagnosis. The results have been published in Applied Neuropsychology: Adult.
Scientists Reveal How Language Supports Complex Cognitive Processing in the Brain
Valeria Vinogradova, a researcher at HSE University, together with British colleagues, studied how language proficiency affects cognitive processing in deaf adults. The study showed that higher language proficiency—regardless of whether the language is signed or spoken—is associated with higher activity and stronger functional connectivity within the brain network responsible for cognitive task performance. The findings have been published in Cerebral Cortex.
Scientists Show That Peer Influence Can Be as Effective as Expert Advice
Eating habits can be shaped not only by the authority of medical experts but also through ordinary conversations among friends. Researchers at HSE University have shown that advice from peers to reduce sugar consumption is just as effective as advice from experts. The study's findings have been published in Frontiers in Nutrition.
HSE Scientists Uncover How Authoritativeness Shapes Trust
Researchers at the HSE Institute for Cognitive Neuroscience have studied how the brain responds to audio deepfakes—realistic fake speech recordings created using AI. The study shows that people tend to trust the current opinion of an authoritative speaker even when new statements contradict the speaker’s previous position. This effect also occurs when the statement conflicts with the listener’s internal attitudes. The research has been published in the journal NeuroImage.
Language Mapping in the Operating Room: HSE Neurolinguists Assist Surgeons in Complex Brain Surgery
Researchers from the HSE Center for Language and Brain took part in brain surgery on a patient who had been seriously wounded in the SMO. A shell fragment approximately five centimetres long entered through the eye socket, penetrated the cranial cavity, and became lodged in the brain, piercing the temporal lobe responsible for language. Surgeons at the Burdenko Main Military Clinical Hospital removed the foreign object while the patient remained conscious. During the operation, neurolinguists conducted language tests to ensure that language function was preserved.
HSE Scientists Use MEG for Precise Language Mapping in the Brain
Scientists at the HSE Centre for Language and Brain have demonstrated a more accurate way to identify the boundaries of language regions in the brain. They used magnetoencephalography (MEG) together with a sentence-completion task, which activates language areas and reveals their functioning in real time. This approach can help clinicians plan surgeries more effectively and improve diagnostic accuracy in cases where fMRI is not the optimal method. The study has been published in the European Journal of Neuroscience.
Researchers Identify Link between Bilingualism and Cognitive Efficiency
An international team of researchers, including scholars from HSE University, has discovered that knowledge of a foreign language can improve memory performance and increase automaticity when solving complex tasks. The higher a person’s language proficiency, the stronger the effect. The results have been published in the journal Brain and Cognition.
‘Engagement in the Scientific Process’: HSE Launches Master’s Programme in Neurobiology
The HSE University Academic Council has elected to launch a new Master's programme in Neurobiology for students majoring in Biology. Students of the programme will have access to unique equipment and research groups, providing them with the knowledge and experience to pursue careers in science, medicine and pharmacy, IT and neurotechnology, and education and HR services.