HSE Experts Reveal Low Accuracy of Technology Forecasts in Transportation
HSE researchers evaluated the accuracy of technology forecasts in the transportation sector over the past 50 years and found that the average accuracy rate does not exceed 25%, with the lowest accuracy observed in aviation and rail transport. According to the scientists, this is due to limitations of the forecasting method and the inherent complexities of the sector. The study findings have been published in Technological Forecasting and Social Change.
Today, foresight methods are widely used to inform science and technology policies, national strategies, and investment programmes. Delphi surveys are a key forecasting tool; they involve a structured process for reaching consensus among a group of experts through anonymous, multi-round surveys with controlled feedback. However, the question of how accurate such forecasts are—and whether they can reliably inform decision-making—remains open.
A team of scientists from the Foresight Centre at the Institute for Statistical Studies and Economics of Knowledge and the Institute of Transport Economics and Transport Policy Studies of HSE University analysed several rounds of Japan's Delphi surveys on technology foresight in the transportation sector. The analysis included 647 observations across 167 topics, ranging from high-speed rail to autonomous vehicles.
Japan presents a unique case: since the 1970s, the country has regularly conducted large-scale Delphi surveys of experts on the prospects of science and technology, making it possible not only to analyse current expectations but also to compare past forecasts with actual outcomes.
The researchers’ conclusions were unexpected: the accuracy of predictions about technological developments in transport made using the classical Delphi method is only 25%, meaning that three out of four forecasts have not been realised. The scientists suggest that the low accuracy rate may result from both the structural complexities inherent in the sector and the limitations of the Delphi method.
Tatiana Kulakova
'Transport can be described as a system of systems: it consists of numerous heterogeneous infrastructure facilities and different modes of transport that are managed and operated independently, yet together form a unified system that is continuously evolving through innovation,' says Tatiana Kulakova, Director of the Institute for Transport Economics and Transport Policy Studies at the HSE Faculty of Urban and Regional Development.
However, environmental constraints, institutional inertia, and the long lifecycle of transport infrastructure significantly limit the sector’s development and delay the adoption of innovations beyond a reasonable planning horizon.
The second reason for the low accuracy of forecasts is the systemic limitation of the Delphi method. It was found that the second round of a Delphi survey—intended to refine and confirm forecasts—may not bring experts closer to consensus but instead increase the dispersion of their estimates.
Olesia Maibakh
'Traditionally, the Delphi method is regarded as the most reliable expert-based forecasting tool, which creates inflated expectations about the accuracy of its predictions. The observed decrease in accuracy in the second round (23.4% compared to 26.4% in the first round) calls into question one of the method’s key assumptions—that iteration automatically improves the accuracy of estimates,' explains Olesia Maibakh, Head of the Foresight Research Methodology and Organisation Unit at the HSE Foresight Centre, and the study author.
According to Maibakh, in practice, feedback can increase conformist pressure by suppressing unconventional but potentially accurate assessments. 'As an alternative to the classic second round, it may be more effective to hold foresight sessions that discuss disagreements, treating discrepancies in estimates as a resource rather than as noise,' Maibakh suggests.
Another unexpected finding was the 'forecastability pit' effect, where the accuracy of forecasts does not correlate with the stage of a technology’s maturity. Intuitively, one might expect that the closer a technology is to practical deployment, the easier it would be to assess its prospects. However, the scientists observed that technologies in the middle stages—when they are first introduced into practical use or undergoing initial improvements—exhibit the lowest forecasting accuracy. In contrast, forecasts for technologies at earlier stages of research and development, as well as those in later stages of adoption and scale-up, were much more accurate.
Alexey Sukharev
'The low accuracy of medium-term forecasts may reflect the so-called "valley of death" effect, where technologies fail to reach the market for economic rather than technological reasons. The frequent errors made by Delphi survey experts in medium-term predictions may stem from the difficulty of determining which of several similar technological solutions will succeed commercially. For example, predicting the dominance of battery electric vehicles over hydrogen fuel cell vehicles proved challenging,' says Alexey Sukharev, an expert at the Foresight Centre.
According to the authors, improving the accuracy of long-term forecasts requires a reassessment of traditional approaches to expert analysis. Forecasting should primarily focus on industry models that account for sector-specific regulatory and infrastructural constraints. Additionally, it is important to combine multiple foresight methods to improve predictive success. The classical Delphi method should be complemented by big data analysis, system dynamics modelling, and scenario planning to help mitigate experts’ cognitive biases.
See also:
HSE Scientists Uncover Mechanism Behind Placental Lipid Metabolism Disorders in Preeclampsia
Scientists at HSE University have discovered that in preeclampsia—one of the most severe complications of pregnancy—the placenta remodels its lipid metabolism, reducing its own cholesterol synthesis while increasing cholesterol transfer to the foetus. This compensatory mechanism helps sustain foetal nutrition but accelerates placental deterioration and may lead to preterm birth. The study findings have been published in Frontiers in Molecular Biosciences.
Wearable Device Data and Saliva Biomarkers Help Assess Stress Resilience
A team of scientists, including researchers from HSE University, has proposed a method for assessing stress resilience using physiological markers derived from wearable devices and saliva samples. The participants who adapted better to stress showed higher heart rate variability, higher zinc concentrations in saliva, and lower potassium levels. The findings were published in the Journal of Molecular Neuroscience.
When Circumstances Are Stronger Than Habits: How Financial Stress Affects Smoking Cessation
HSE researchers have found that the likelihood of quitting smoking rises with increasing financial struggles. While low levels of financial difficulties do not affect smoking behaviour, moderate financial stress can increase the probability of quitting by 13% to 21%. Responses to high financial stress differ by gender: men are almost 1.5 times more likely to give up cigarettes than under normal conditions, whereas no significant effect is observed on women’s decisions to quit smoking. These conclusions are based on data from the Russia Longitudinal Monitoring Survey (RLMS-HSE) for 2000–2023 and have been published in Monitoring of Public Opinion: Economic and Social Changes.
HSE Researchers Propose New Method of Verbal Fluency Analysis for Early Detection of Cognitive Impairment
Researchers from the HSE Center for Language and Brain and the Mental Health Research Centre have proposed a new method of linguistic analysis that enables the distinction between normal and pathological ageing. Using this approach, they showed that patterns in patients’ word choices during verbal fluency tests allow clinicians to more accurately differentiate clinically significant impairments from subjective memory complaints. Incorporating this type of analysis into clinical practice could improve the accuracy of early dementia diagnosis. The results have been published in Applied Neuropsychology: Adult.
How the Brain Processes a Word: HSE Researchers Compare Reading Routes in Adults and Children
Researchers from the HSE Center for Language and Brain used magnetoencephalography to study how the brains of adults and children respond to words during reading. They showed that in children the brain takes longer to process words that are frequently used in everyday speech, while rare words and pseudowords are processed in the same way—slowly and in parts. With age, the system is reorganised: high-frequency words shift to a fast route, whereas new letter combinations are still analysed slowly. The study was published in the journal Psychophysiology.
How Neural Networks Detect and Interpret Wordplay: New Insights from HSE Researchers
An international team including researchers from the HSE Faculty of Computer Science has presented KoWit-24, an annotated dataset of 2,700 Russian-language Kommersant news headlines containing wordplay. The dataset enables an assessment of how artificial intelligence detects and interprets wordplay. Experiments with five large language models show that even advanced systems still make mistakes, and that interpreting wordplay is more challenging for them than detecting it. The results were presented at the RANLP conference; the paper is available on Arxiv.org, and the dataset and the code for reproducing the experiments are available on GitHub.
HSE Economists Find That Auction Prices Depend on Artist’s Life Story
Researchers from the Centre for Big Data in Economics and Finance at the HSE Faculty of Economic Sciences have found that facts from an artist’s life are statistically significant in pricing a painting, alongside such traditional characteristics as the material, the size of the canvas, or the presence of the artist’s signature. This conclusion is based on an analysis of prices for 15,000 works by 158 artists sold since 1999 by the major auction houses Sotheby’s and Christie’s. The article has been published in the journal Empirical Studies of the Arts.
HSE Physicists Propose Unified Theory for Describing Electric Double Layer
To develop more efficient batteries and catalysts, it is essential to understand the processes occurring at the metal–solution interface in the electric double layer (EDL). Physicists at HSE MIEM have proposed a unified theoretical model of the EDL that simultaneously accounts for selective adsorption of ions on the surface and partial charge transfer between ions and the metal—phenomena that had previously been described separately. The model’s predictions are consistent with experimental data. In the future, it may be used in the development of batteries, supercapacitors, and catalysts. The study has been published in Electrochimica Acta.
HSE Researchers Experimentally Demonstrate Positive Effects of Urban Parks on the Brain
Scientists at HSE University have investigated the effect of parks on the cognitive and emotional resources of city dwellers. The researchers compared brain electrical activity in 30 participants while they watched videos of walks through parks and along busy highways. The results showed that green urban environments with trees produce a consistent effect across individuals, helping the brain calm down and relax. By contrast, walks along busy streets were found to be distracting. The findings have been published in Scientific Reports.
HSE University Scholars Uncover E-Learning Preferences of Top Students
HSE University experts have analysed students’ digital footprints and shown for the first time that final grades depend on one’s personal approach to an online course. Balanced students have proven to be more successful than those who follow a more traditional and practical approach. The findings from this study will help create a more adaptive and personalised educational system. This research has been published in the journal The Internet and Higher Education.