HSE Experts Reveal Low Accuracy of Technology Forecasts in Transportation
HSE researchers evaluated the accuracy of technology forecasts in the transportation sector over the past 50 years and found that the average accuracy rate does not exceed 25%, with the lowest accuracy observed in aviation and rail transport. According to the scientists, this is due to limitations of the forecasting method and the inherent complexities of the sector. The study findings have been published in Technological Forecasting and Social Change.
Today, foresight methods are widely used to inform science and technology policies, national strategies, and investment programmes. Delphi surveys are a key forecasting tool; they involve a structured process for reaching consensus among a group of experts through anonymous, multi-round surveys with controlled feedback. However, the question of how accurate such forecasts are—and whether they can reliably inform decision-making—remains open.
A team of scientists from the Foresight Centre at the Institute for Statistical Studies and Economics of Knowledge and the Institute of Transport Economics and Transport Policy Studies of HSE University analysed several rounds of Japan's Delphi surveys on technology foresight in the transportation sector. The analysis included 647 observations across 167 topics, ranging from high-speed rail to autonomous vehicles.
Japan presents a unique case: since the 1970s, the country has regularly conducted large-scale Delphi surveys of experts on the prospects of science and technology, making it possible not only to analyse current expectations but also to compare past forecasts with actual outcomes.
The researchers’ conclusions were unexpected: the accuracy of predictions about technological developments in transport made using the classical Delphi method is only 25%, meaning that three out of four forecasts have not been realised. The scientists suggest that the low accuracy rate may result from both the structural complexities inherent in the sector and the limitations of the Delphi method.
Tatiana Kulakova
'Transport can be described as a system of systems: it consists of numerous heterogeneous infrastructure facilities and different modes of transport that are managed and operated independently, yet together form a unified system that is continuously evolving through innovation,' says Tatiana Kulakova, Director of the Institute for Transport Economics and Transport Policy Studies at the HSE Faculty of Urban and Regional Development.
However, environmental constraints, institutional inertia, and the long lifecycle of transport infrastructure significantly limit the sector’s development and delay the adoption of innovations beyond a reasonable planning horizon.
The second reason for the low accuracy of forecasts is the systemic limitation of the Delphi method. It was found that the second round of a Delphi survey—intended to refine and confirm forecasts—may not bring experts closer to consensus but instead increase the dispersion of their estimates.
Olesia Maibakh
'Traditionally, the Delphi method is regarded as the most reliable expert-based forecasting tool, which creates inflated expectations about the accuracy of its predictions. The observed decrease in accuracy in the second round (23.4% compared to 26.4% in the first round) calls into question one of the method’s key assumptions—that iteration automatically improves the accuracy of estimates,' explains Olesia Maibakh, Head of the Foresight Research Methodology and Organisation Unit at the HSE Foresight Centre, and the study author.
According to Maibakh, in practice, feedback can increase conformist pressure by suppressing unconventional but potentially accurate assessments. 'As an alternative to the classic second round, it may be more effective to hold foresight sessions that discuss disagreements, treating discrepancies in estimates as a resource rather than as noise,' Maibakh suggests.
Another unexpected finding was the 'forecastability pit' effect, where the accuracy of forecasts does not correlate with the stage of a technology’s maturity. Intuitively, one might expect that the closer a technology is to practical deployment, the easier it would be to assess its prospects. However, the scientists observed that technologies in the middle stages—when they are first introduced into practical use or undergoing initial improvements—exhibit the lowest forecasting accuracy. In contrast, forecasts for technologies at earlier stages of research and development, as well as those in later stages of adoption and scale-up, were much more accurate.
Alexey Sukharev
'The low accuracy of medium-term forecasts may reflect the so-called "valley of death" effect, where technologies fail to reach the market for economic rather than technological reasons. The frequent errors made by Delphi survey experts in medium-term predictions may stem from the difficulty of determining which of several similar technological solutions will succeed commercially. For example, predicting the dominance of battery electric vehicles over hydrogen fuel cell vehicles proved challenging,' says Alexey Sukharev, an expert at the Foresight Centre.
According to the authors, improving the accuracy of long-term forecasts requires a reassessment of traditional approaches to expert analysis. Forecasting should primarily focus on industry models that account for sector-specific regulatory and infrastructural constraints. Additionally, it is important to combine multiple foresight methods to improve predictive success. The classical Delphi method should be complemented by big data analysis, system dynamics modelling, and scenario planning to help mitigate experts’ cognitive biases.
See also:
Team Success: Aligning Means with Objectives
In corporations, sports, and academia, people often face challenges they cannot handle alone. In such cases, selecting the right team is crucial. Tatiana Mayskaya, Associate Professor at the HSE Faculty of Economic Sciences and the International College of Economics and Finance, together with colleagues from foreign universities, examined team characteristics and found that less diverse teams are better suited to objectives where a high average performance is important, whereas more diverse teams are preferable when avoiding failure is critical. The paper has been published in Economic Theory.
Economists Propose More Effective Approach to Reducing Smoking
Economists at HSE University have examined how smokers respond to changes in cigarette prices. When tobacco prices increase, cigarette consumption does not always decline. In fact, spending on tobacco may even rise: according to the researchers, a 1% decrease in cigarette affordability leads to a 0.28% increase in per capita tobacco expenditure. The findings suggest that to reduce smoking rates, tobacco prices must rise faster than household incomes. The study has been published in Voprosy Statistiki.
Biologists Discover Unique Properties of MiR-93-5p MicroRNA in Prostate Cancer
Researchers at the International Laboratory of Microphysiological Systems of the HSE Faculty of Biology and Biotechnology investigated how different isoforms of the same microRNA influence gene function in prostate adenocarcinoma. The study found that in some cases, microRNAs can reinforce each other’s effects by targeting and suppressing the same genes. This finding offers a fresh perspective on the molecular mechanisms underlying tumour development and on the search for disease biomarkers. The results have been published in PeerJ.
HSE Researchers Provide the World’s First Legal Definition of a Digital Ecosystem
Digital ecosystems have evolved from a technological innovation into a fundamental institution of the modern economy over the past few years. According to HSE University’s latest estimates, they account for 8.5% of Russia’s GDP. Previously, no jurisdiction had a statutory definition of what constitutes a digital ecosystem. HSE University researchers have addressed this gap by proposing the first legal concept of a digital ecosystem. Their article, ‘The Digital Ecosystem as a Novel Economic Phenomenon and Legal Concept,’ has been published in the BRICS Law Journal.
HSE Economists Use Search Queries to Forecast Birth Rates
Researchers from the HSE Faculty of Economic Sciences have shown that the accuracy of birth rate forecasts for Russia can be improved by almost 50% by incorporating the dynamics of online search queries related to pregnancy and childbirth into forecasting models. In the best-performing models, the forecasting error fell from 4.6% to 3.2%. The findings have been published in Populations and Economics.
When Looking at Their Own Faces, Men Forget Everything
In an experiment involving 15 healthy men, scientists at HSE University investigated how different phases of the cardiac cycle influence the excitability of the motor cortex when participants viewed either their own photograph or the faces of strangers. The researchers found that when participants looked at their own image, the brain’s response to signals from the heart was weaker, meaning that the influence of cardiac activity on the motor cortex decreased. This finding came contrary to expectations, as self-focused attention was thought to enhance the brain's sensitivity to internal bodily signals. The study has been published in Frontiers in Signal Processing.
HSE Researchers Discover Who Eats Out in Russia—And Why
Around one-third of Russians (31.3%) rarely eat out or buy ready-made meals. The core group of active consumers—those who eat out or purchase prepared food almost every day or several times a week—accounts for only about 9% of the population. These are the findings of a study conducted by the HSE Institute for Social Policy. According to the researchers eating out is no longer a marker of high social status in Russia.
Scientists Model How Interactions Between Societies Can Trigger Chaotic Behaviour
Scientists at HSE MIEM have proposed a mathematical model explaining how interactions between societies can influence their stability. Based on the classical theory of evolutionary games, the study reveals an unexpected effect: even a weak informational influence of one society on another can cause one society to remain stable while the other exhibits chaotic behaviour among its individual members. The study has been published in the International Journal of Bifurcation and Chaos.
Ancient Craniiform Brachiopod: A Newly Discovered Species with a Unique Shell Shape and Lifestyle
Scientists from HSE University, MSU, and Tallinn University of Technology have studied a fossil species of ancient brachiopods that lived in a warm sea in what is now northern Estonia more than 445 million years ago. These ancient brachiopods developed a cup-shaped shell with a protective 'cap' that shielded them from overgrowth by other marine organisms. The study has been published in Palaeogeography, Palaeoclimatology, Palaeoecology.
Scientists Develop Bacterium-Sized Microlaser
An international team of researchers, including scientists from HSE University–St Petersburg, has developed microlasers that emit deep-ultraviolet light at a wavelength of 255 nanometres. The devices operate at room temperature, and the smallest of them measures just two micrometres in diameter—roughly the size of a bacterium. These microlasers could be used in sensors, spectroscopic systems, photonic chips, and communication devices. The paper has been published in Optics & Laser Technology.