Scientists Propose Method for More Efficient Resource Use in Machine Learning

An international group of researchers, including mathematicians from the AI and Digital Science Institute at the HSE Faculty of Computer Science, has provided a theoretical justification for a simple and computationally efficient method of estimating uncertainty in Stochastic Gradient Descent (SGD). The paper has been published on the scientific preprint server arXiv.org and presented at AISTATS 2026.
Stochastic algorithms, including SGD, are widely used in optimisation and machine learning tasks. Because these algorithms incorporate randomness, such as randomly selected mini-batches of data, an important feature of their solutions is the confidence interval—the range within which the true solution is likely to lie. Traditional approaches to constructing such intervals rely on complex statistical estimations, particularly explicit estimates of the solution’s marginal covariance matrix. These methods can be computationally expensive and may still produce inaccurate uncertainty estimates.
A covariance matrix is a table that shows how several random variables, such as features or parameters, are related to one another and how they vary around their mean values.
An international team, including researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science, analysed an empirically popular approach to estimating confidence intervals for averaged SGD that does not require repeated model training or complex calculations. The authors demonstrated that this method accurately reproduces the distribution of the averaged SGD solution and does not require an explicit estimate of the marginal covariance matrix.
Marina Sheshukova
'Similar methods have already been used in practice and have often demonstrated better results than alternative approaches. We wanted to understand the reasons behind this empirical advantage and were able to provide a rigorous mathematical interpretation,' explained Marina Sheshukova, Junior Research Fellow of the International Laboratory of Stochastic Algorithms and High-Dimensional Inference at the HSE AI and Digital Science Institute.
This mathematical justification makes it possible to reassess simple empirical methods for estimating uncertainty in machine learning. Developers will be able to obtain reliable uncertainty estimates faster and with fewer computational resources. This is particularly important in fields where it is essential to know not only the prediction itself but also the level of confidence associated with it, such as medicine, finance, and autonomous systems.
See also:
How to Assess Students’ Knowledge in the Age of AI
A researcher at HSE University has proposed a flowchart to help lecturers decide how to assess students who use artificial intelligence. It shows where the use of AI should be restricted and where it can be incorporated into the learning process. The article has been published in IT Professional.
Scientists Train Neural Network to Generate Process Plans from 3D Models
Researchers at the HSE FCS AI and Digital Science Institute have developed CAD2TechSpec, a framework that converts 3D models of mechanical parts into machining process plans—step-by-step instructions for machine tools. The solution aims to reduce the time required for the design and preparation of technical process documentation in mechanical engineering, aircraft manufacturing, and other high-tech industries. The study findings have been published in PeerJ Computer Science.
Biologists Discover 'Molecular Fingerprint' of Preeclampsia
Researchers at HSE University employed a new method to model hypoxia in placental cells during pregnancies complicated by preeclampsia and identified molecular markers of tissue hypoxia. Since hypoxia is one of the key mechanisms underlying preeclampsia, these findings are important for a more accurate and timely diagnosis of the disease and for the development of effective treatment methods. The paper has been published in Placenta.
‘Hedgehog’ Versus ‘Relatives’: Researchers Measure How the Brain Responds to Unexpected Words During Natural Speech
Russian neurophysiologists, including researchers from HSE University, have demonstrated the feasibility of using event-related fields (ERFs) to study brain activity during natural speech perception. The researchers showed that this approach can be applied not only to individual words but also to continuous speech. Their findings indicate that words whose meanings differ significantly from the preceding context require longer processing times. The study also reveals that the brain processes function words in two stages: first, it identifies their grammatical role and then uses this information to predict the next word. The study has been published in Frontiers in Human Neuroscience.
HSE Researchers Create New Corpus of Early Child Speech in Russian
Researchers at the HSE Centre for Language and Brain have presented RusLan-M, an open multimedia corpus that makes it possible to trace the development of early child speech in Russian from first words to the emergence of complex grammatical constructions. The database contains around 41 hours of video recordings and more than 35,000 child utterances. The new resource will help researchers study more precisely how children acquire Russian and, in the longer term, develop more reliable tools for assessing speech development. The study has been published in Language Resources and Evaluation.
Scientists Develop Algorithm for More Reliable Processors in Data Centres
Researchers from HSE MIEM and Samara University have developed the LRF-3D algorithm to automatically bypass idle nodes in three-dimensional networks-on-chip. Thanks to its hierarchical architecture, the algorithm outperforms existing solutions in both speed and path accuracy, improving processor reliability for use in data centres, supercomputers, and AI computing. The source code and test results are publicly available.
Researchers Rank Recommendation Algorithms Using Sports Tournament Model
Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed an approach for selecting recommendation algorithms more effectively. Their approach uses pairwise comparisons of algorithms to create a tournament table, with the overall ranking based on their performance across all datasets in the tournament. This can reduce the number of algorithms that need to be tested when developing new services, saving both time and money. The study was presented at the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2026).
Researchers Develop Method for Direct Generation of Regulatory DNA
Researchers at HSE University have developed a model for generating promoters and enhancers—DNA sequences that regulate gene activity. The model works directly with DNA nucleotides, without first transforming them into a continuous numerical representation. This solution could be useful for applications in synthetic biology and gene therapy. The study results were presented at the ICLR 2026 Workshop ‘Generative AI in Genomics (Gen^2): Barriers and Frontiers.’
Researchers at HSE University and Sber Train Neural Networks to Better Predict User Preferences
The HSE FCS AI and Digital Science Institute and Sber have introduced a new architecture for recommendation systems that combines two classes of models, enabling algorithms to better predict users’ interests and needs. A preprint of the paper has been published on arxiv.org and presented at Urban ML.
Social Integration: At the Crossroads of Knowledge and Values
The International Laboratory for Social Integration Research (ILSIR) at HSE University studies the challenges faced by vulnerable groups and explores ways to help them participate fully in everyday life. To develop effective solutions, the laboratory’s researchers combine cutting-edge methods with practical fieldwork. In this interview with the HSE News Service, Laboratory Head Elena Iarskaia-Smirnova discusses the laboratory’s work.


