HSE and Yandex Propose Method to Speed Up Neural Networks for Image Generation

A team of scientists at HSE FCS and Yandex Research has proposed a method that reduces computational costs and accelerates text-to-image generation in diffusion models without compromising quality. These models currently set the standard for text-to-image generation, but their use is limited by high computational loads, the company said in a statement.
It is further specified that the developed method—Scale-wise Distillation of Diffusion Models (SwD)—avoids redundant computations during image generation, allowing results to be produced in just 0.3–0.4 seconds.
According to one of the authors, the generation process in diffusion models typically requires dozens of steps involving high-resolution computations. However, in the early stages, only the general structure of the image is formed, and fine details are not yet distinguishable; as a result, some of these computations are redundant. The proposed SwD framework addresses this problem in two ways. First, generation begins at a low resolution and is progressively refined as noise is reduced, eliminating redundant computations in the early stages. Second, the method uses distillation of pre-trained models such as FLUX and Stable Diffusion 3.5, whereby a simpler student model learns to replicate the output of a more complex one, reducing the number of generation steps from dozens to just 4–6.
The authors propose a new loss function for training—Maximum Mean Discrepancy (MMD), which compares how the teacher model 'sees' an image at its internal processing levels with how the student model represents the same image. Unlike traditional approaches, this method does not require auxiliary models, simplifying and accelerating training, the company emphasises. Moreover, MMD can be used as a standalone distillation (knowledge compression) technique: in experiments, the time per training iteration was reduced sevenfold compared to more complex combined approaches.
The new approach reduces generation time from several seconds to just 0.3–0.4 seconds while maintaining visual quality. As a result, SwD makes modern diffusion models faster and more cost-efficient to use, improving their accessibility for practical applications, the company statement says.
The solution is described in a paper to be presented at ICLR 2026, one of the leading conferences on artificial intelligence.
See also:
Resource Race and Green Transition: Three Unexpected Conclusions from Foresight Centre’s Research on Climate and Poverty
Beneath the surface of green energy—which most people associate with solar panels, electric vehicles, and reduced CO2 emissions—lies a complex web of geopolitical interests, international inequality, and resource constraints. Researchers from the Laboratory for Science and Technology Studies (LST) at the HSE ISSEK Foresight Centre have published a series of articles in leading international journals on hidden and overt conflicts surrounding critically important metals and minerals, as well as related processes in the energy sector.
Immersion in Second Language Environment Influences Bilinguals’ Perception of Emotions
Researchers at the Cognitive Health and Intelligence Centre at the HSE Institute for Cognitive Neuroscience have discovered how bilingual individuals process emotional words in their native (first) and non-native (second) languages. It was found that the link between word meaning and bodily sensations is weaker in a second language than in a first language. However, the more a person is immersed in a language environment, the smaller this difference becomes. The article has been published in Language, Cognition and Neuroscience.
Researchers Find More Effective Approach to Revealing Majorana Zero Modes in Superconductors
An international team of researchers, including physicists from HSE MIEM, has demonstrated that nonmagnetic impurities can help more accurately reveal Majorana zero modes—quantum states considered promising building blocks for quantum computing. The researchers found that these impurities shift the energy levels that typically obscure the Majorana signal, while leaving the mode itself largely unaffected, thereby making its spectral peak more distinct. The study has been published in Research.
New Development by HSE Scientists Helps Design Reliable Electronics Faster at a Lower Cost
Scientists from HSE MIEM have developed a new approach to modelling electrothermal processes in high-power electronic circuits on printed circuit boards (PCB). The method allows engineers to quickly and accurately predict how electronic components heat up during operation, helping prevent overheating and potential failures. The results have been published in Russian Microelectronics.
The Future of Cardiogenetics Lies in Artificial Intelligence
Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed a program capable of analysing regions of the human genome that were previously inaccessible for accurate interpretation in genetic testing. The program adapts large generative AI (GenAI) models for cardiogenetics to predict how specific mutations affect the function of individual genes.
HSE Researchers: Young Russians Have Sufficient Knowledge About Money but Lack Money Management Skills
Adolescents and young adults in Russia today are well versed in financial terminology: they know what bank cards, loans, interest rates, and online payments are. However, as researchers at HSE University have found, real money-management skills remain poorly developed among most young people. The study ‘Financial Literacy, Financial Culture, and Financial Autonomy of Youth’ has been published in Monitoring of Public Opinion: Economic and Social Changes.
Why Weaker Competitors Give Up—and How to Keep Them in the Game
Anastasia Antsygina, Assistant Professor at HSE University’s Faculty of Economic Sciences, has developed a prize distribution model that maximises competitor engagement. She proposed revising the traditional ‘winner-takes-all’ approach and, in certain cases, offering a small reward even to those who have lost. According to her, this could increase participant motivation and make the competition more intense. The findings of her research were published in the Economic Theory journal.
HSE Researchers Compile Scientific Database for Studying Children’s Eating Habits
The database created at HSE University can serve as a foundation for studying children’s eating habits. This is outlined in the study ‘The Influence of Age, Gender, and Social-Role Factors on Children’s Compliance with Age-Based Nutritional Norms: An Experimental Study Using the Dish-I-Wish Web Application.’ The work has been carried out as part of the HSE Basic Research Programme and was presented at the XXVI April International Academic Conference named after Evgeny Yasin.
New Foresight Centre Study Identifies the Most Destructive Global Trends for Humankind
A team of researchers from the HSE International Research and Educational Foresight Centre has examined how global trends affect the quality of human life—from life expectancy to professional fulfilment. The findings of the study titled ‘Human Capital Transformation under the Influence of Global Trends’ were published in Foresight.
Scientists Develop Algorithm for Accurate Financial Time Series Forecasting
Researchers at the HSE Faculty of Computer Science benchmarked more than 200,000 model configurations for predicting financial asset prices and realised volatility, showing that performance can be improved by filtering out noise at specific frequencies in advance. This technique increased accuracy in 65% of cases. The authors also developed their own algorithm, which achieves accuracy comparable to that of the best models while requiring less computational power. The study has been published in Applied Soft Computing.


