Can Everything in Science Be Measured?
Giorgio Sirilli, Associate Research Director at Italy’s Research Institute on Sustainable Economic Growth of National Research Council (IRCrES), an active participant and former chair of the OECD Working Party of National Experts on Science and Technology Indicators (NESTI), and author of over 200 academic publications, gave an open lecture at HSE on January 21, 2015, as part of the Governance of Science, Technology and Innovation MA programme.
Russia takes an active part in NESTI’s work since 1992. Delegates from Russia – Leonid Gokhberg, and Konstantin Fursov, – are actively involved in numerous NESTI projects on development and use of indicators for statistical measurement of science and technology.
Giorgio Sirilli highlighted the importance of providing information that is as objective and value-neutral as possible. Based on general methodological principles, statistics always follows the political agenda. If, initially, the statistical measurement of research and development was mainly focused on scientific and technological activity in order to strengthen its role in improving the national welfare and security, then today it is those very processes of innovative development, including those focused on identifying and responding to societal and global environmental challenges, that are the subject of regulation and statistical analysis.
On the un-measurable
Statistics cannot encompass the entire field of science, technology and innovation, argues Sirilli. The mass of information that is subject to systematized description and measurement is just the tip of the iceberg. Most processes that push scientific development forward and define its success in any country will remain hidden. Therefore, interpreting the results received and making decisions based on them, especially political ones, requires the utmost care. Sirilli illustrated this with an example of using bibliometric indicators for evaluating scientific productivity of research and educational institutions.
For much of the lecture, Sirilli focused on complex indexes making it possible to evaluate strong and weak sides of innovative systems in any particular country, and to compare different aspects of different economies.
Data visualization and the magic of numbers
The ways in which information is presented largely determine its perception by users.
Consequently, in order to ensure the widest possible audience gets an accurate picture of development in science, technology, and innovation in a country, statistics should be based on a broad arsenal of data visualization tools. At the same time, it is desirable that the figures should be presented without involving subjective evaluations.
In studying complex systems such as science, technology and innovation, Sirilli concluded, it is important to be particularly careful when selecting statistical units and interpreting the results – taking into account the method’s limitations. Statistics prepares data for decision-making, opens up new horizons and opportunities, but the figures never give us a full representation of an object or a phenomenon under analysis.
Maxim Kotsemir, Konstantin Fursov
See also:
‘Statistics Should Be Available and Comprehensible to Everyone’
Implementing a digital analytical platform, opportunities for Big Data, and other prospects for the development of Russian statistics were discussed by participants at a plenary session of the XX April International Academic Conference.
Entering the Big Data Era — Will Traditional Statistics Still Be in Demand?
The development of a national data management system, along with its architecture and ontology, is one of the key issues for a future cabinet, believes Maxim Akimov, First Deputy of the Chief of the Government Staff of the Russian Federation. A discussion at a panel session on data in the digital era at the XIX April International Academic Conference at HSE looked into the key challenges in regards to Russian statistics and possible responses to them.
How Can Science Be Governed and Evaluated?
Giorgio Sirilli, former chairman of the OECD Working Party of National Experts on Science and Technology Indicators (NESTI), is offering lectures to students in the Master’s programme in Governance of Science, Technology and Innovation (STI).
Foresight Becomes a Part of Government Policy
Foresight, a system of future studies in science and technology, is being institutionalized, brings together different levels of ‘scanning’ the future, and is branching out into new sectors. These trends were among those experts identified at the 4th annual international academic conference ‘Foresight and STI Policy’, organized by the HSE Institute for Statistical Studies and Economics of Knowledge (ISSEK), which opened on November 6.
Russians Respect Doctors and Lawyers
Many Russians, when asked whether certain occupations, particularly those of a politician or an academic, are prestigious or desirable,will give a different answer depending on whether they are refering to their own attitudes, perceived societal attitudes, or preferred career choices for their children. So Konstantin Fursov and Valentina Polyakova, research fellows at the HSE's ISSEK, found in their study Monitoring Innovative Behaviour in the Russian Population.
Giulio Perani: ‘I am always very happy to meet students and researchers from the HSE’
On June 14, 2013 a visiting expert Giulio Perani delivered a lecture on 'Measuring Innovation beyond Enterprises: Options and Challenges' at the National Research University – Higher School of Economics (HSE). The event was organised by the HSE ISSEK Research Laboratory for Economics of Innovation.
HSE and the International Year of Statistics
This year HSE is taking part in the International Year of Statistics. We asked Vice Dean of the Faculty of Economics Alexey Ponomarenko to tell us about the events which are planned in connection with it, including those at the April Conference.
'New' Economy Ignored by Statistics
Official statistics fail to capture – in fact, they simply ignore – the development of Russia’s high-tech industry. This distorts macroeconomic indicators and negatively impacts the quality of the government's decisions. Vladimir Bessonov, Head of HSE Expert Institute's Laboratory for Studies of Inflation and Economic Growth, has authored the report: 'In Search of Information and Communication Technologies: The Quirks of Russian Statistics and Economic Measurements'.
Science and Technology Indicators in the Russian Federation
The data book is the continuation of the series of publications on various aspects of S&T and innovation development in the Russian Federation. It presents statistical data reflecting the current state and trends in R&D and innovation. A specific chapter is devoted to international comparisons.
Indicators of Innovation in the Russian Federation
The data book presents the results of statistical innovation surveys in the Russian Federation.