• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

AI Robot for Environmental Recognition Tested at HSE University

AI Robot for Environmental Recognition Tested at HSE University

© HSE University

Engineers and researchers at the HSE Institute for Robotics Systems have successfully run the first tests of an AI-powered environmental recognition model deployed on a robot dog. The robot navigated around the HSE Pokrovka building and Pokrovsky Bulvar, analysing the surrounding environment to identify its location.

Work on the neural network model and software has been underway since April in partnership with EFKO. The creators call this system a 'scene classifier.' It captures images from the robot's camera to identify the type of environment it is in. The classifier recognises more than 60 distinct categories, such as rooms, streets, courtyards, and parks.

Sergey Slastnikov

Sergey Slastnikov

‘We developed and trained a neural network model capable of analysing images from the robot's camera to classify them into over 50 environment types. Prior to this, the model was only run on a standard computer. This current test was essential to transfer the software directly to the robot's onboard hardware and verify its operation in real-world environments,’ noted Sergey Slastnikov, Deputy Director of the HSE Institute for Robotics Systems.

A primary goal of the testing was to evaluate how effectively the model functions directly on the robot. The team guided the robot through buildings and streets, gathering data and logging the specific environmental characteristics the system could identify. Following the tests, the team computed the model's evaluation metrics.

Across all classification tasks—including space type, weather, season, and time of day—the final Micro F1 score reached 93.6%. This summary metric aggregates results across all classes to show overall performance, making it ideal for datasets with varying category sizes. These results demonstrate that the model delivers high-quality environmental recognition under real-world conditions.

Additionally, the team assessed computational performance, focusing on the model's processing speed on the onboard computer. These metrics are vital for the future integration of the classifier into the robot's adaptive control system. 

The successful trials represent a major development milestone, serving as the first validation of running the model directly on the robot's hardware.

‘This result is crucial for our current robotics projects—anthropomorphic delivery droids and robot dogs designed for city logistics. For such platforms to operate safely and efficiently in an urban environment, their software must provide autonomous positioning: the robot needs to understand where it is and what is happening around it, and adapt its behaviour accordingly. Testing the scene classifier directly on the robot's onboard hardware is a major step toward the real-world deployment of autonomous couriers in urban conditions,’ noted Andrey Blokhin, IT Innovation Director at EFKO Group.

‘This model isn't the final product; it's an intermediate step toward a more sophisticated adaptive control system. Moving forward, the robot will use scene data to dynamically adjust its behaviour depending on its surroundings. For example, when navigating winter streets, the robot will be able to account for the presence of snow and adjust its movement parameters, or adopt a more cautious driving style when encountering a dense crowd,’ noted Sergey Slastnikov.

Thus, the project's objective goes beyond simple image recognition. Scene detection must serve as the foundation for the adaptive control of the robot's behaviour—specifically its speed, trajectory, and motion parameters—and, looking forward, the behaviour of the entire system.

See also:

AI Users Earn Up to 41.8% More Than Non-Users

Research conducted by economists at HSE University has revealed a significant correlation between the regular use of GenAI in the workplace and higher pay among Russian employees. The study found that individuals who frequently use GenAI in their professional activities earn notably more than those who reject these new tools or resort to them occasionally. The salary premium for highly qualified specialists reaches 41.8%. The article was published in the Voprosy Ekonomiki journal.

Algebra, Geometry, and AI: Russian and Vietnamese Mathematicians Discuss Current Research

A delegation of scientists from Hanoi visited the HSE Faculty of Computer Science and then took part in a Russian-Vietnamese conference in St Petersburg. The events were part of the three-year project ‘Flexibility and Computational Methods.’ Over the course of the project, the researchers have prepared joint publications and obtained new mathematical results.

Scientific Expedition to Hainan: HSE Scientists Organise Conference on Statistical AI in China

The Statistical AI Conference was held in Sanya, Hainan Island, China, from 24 to 28 August 2026. The international event brought together leading experts in statistics, machine learning, and applied AI. Alexey Naumov, Director of the AI and Digital Science Institute at the HSE Faculty of Computer Science, and Sergey Samsonov, Head of the International Laboratory of Stochastic Algorithms and High-Dimensional Inference, were among the conference organisers.

How to Assess Students’ Knowledge in the Age of AI

A researcher at HSE University has proposed a flowchart to help lecturers decide how to assess students who use artificial intelligence. It shows where the use of AI should be restricted and where it can be incorporated into the learning process. The article has been published in IT Professional.

Scientists Train Neural Network to Generate Process Plans from 3D Models

Researchers at the HSE FCS AI and Digital Science Institute have developed CAD2TechSpec, a framework that converts 3D models of mechanical parts into machining process plans—step-by-step instructions for machine tools. The solution aims to reduce the time required for the design and preparation of technical process documentation in mechanical engineering, aircraft manufacturing, and other high-tech industries. The study findings have been published in PeerJ Computer Science.

Researchers Assess Contributions of BRICS Countries to Leading ML/AI Conferences

The HSE Scientometrics Centre analysed more than 104,000 papers published between 2020 and 2025 and presented at ten top-level A* conferences ranked by ICORE 2026. The researchers examined the contributions of Brazil, Russia, India, China and South Africa. Together, these countries accounted for around 40,800 publications, or 39.2% of the total. However, the distribution is highly uneven, and a shared BRICS research space has yet to emerge.

Laboratory of Future Networks: HSE Telecommunications Research Institute Develops 5G/6G Research Testbed

The 5G/6G testbed at the HSE Telecommunications Research Institute is becoming a research platform, an educational laboratory, and a foundation for developing new software components for future networks. It makes it possible not only to observe how a mobile network operates, but also to change its operating conditions and measure the results: data-transmission speed, latency, errors, radio-resource utilisation, and other parameters. Based on the testbed, researchers plan to develop MIMO, O-RAN, xApp, and IAB technologies, as well as experiment with artificial intelligence.

Hybrid Intelligence: Competencies in the Age of AI Discussed at Technoprom-2026

Artificial intelligence is not creating new professions, but rather transforming the nature of existing ones. This was the conclusion reached by participants in the panel session ‘Hybrid Intelligence: Digital and Human Drivers of Development,’ organised by the Institute for Statistical Studies and Economics of Knowledge (ISSEK) at HSE University as part of the 13th International Forum of Technological Development (Technoprom-2026). The experts discussed how the nature of work is changing, which skills are becoming increasingly sought after, and what prevents companies from fully capitalising on new technologies.

Researchers Rank Recommendation Algorithms Using Sports Tournament Model

Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed an approach for selecting recommendation algorithms more effectively. Their approach uses pairwise comparisons of algorithms to create a tournament table, with the overall ranking based on their performance across all datasets in the tournament. This can reduce the number of algorithms that need to be tested when developing new services, saving both time and money. The study was presented at the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2026).

Researchers Develop Method for Direct Generation of Regulatory DNA

Researchers at HSE University have developed a model for generating promoters and enhancers—DNA sequences that regulate gene activity. The model works directly with DNA nucleotides, without first transforming them into a continuous numerical representation. This solution could be useful for applications in synthetic biology and gene therapy. The study results were presented at the ICLR 2026 Workshop ‘Generative AI in Genomics (Gen^2): Barriers and Frontiers.’