• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

AI Helps Discover New Space Anomalies

AI Helps Discover New Space Anomalies

© iStock

The SNAD team, an international network of researchers including Matvey Kornilov, Associate Professor of the HSE University Faculty of Physics, has discovered 11 previously undetected space anomalies, seven of which are supernova candidates. The researchers analysed digital images of the Northern sky taken in 2018 using a k-D tree to detect anomalies through the ‘nearest neighbour’ method. Machine learning algorithms helped automate the search. The paper is published in New Astronomy.

Most astronomical discoveries have been based on observations with subsequent computations. While the total number of observations in the 20th century was still relatively small, the volumes of data drastically increased with the arrival of large-scale astronomical surveys. For example, the Zwicky Transient Facility (ZTF), which uses a wide-field view camera to survey the Northern sky, generates ∼1.4 TB of data per night of observation and its catalogue contains billions of objects. Manually processing such enormous amounts of data is both expensive and time consuming, so the SNAD team of researchers from Russia, France and the US came together to develop an automated solution.

When scientists examine astronomical objects, they observe their light curves, which show variations of an object’s brightness as a function of time. The observers first identify a flash of light in the sky and then follow its evolution to see whether the light becomes brighter or weaker over time, or goes out. In this study, the researchers examined a million real light curves from the ZTF's 2018 catalogue and seven simulated live curve models of the types of objects under study. In total, they followed some 40 parameters, including the amplitude of an object's brightness and the timeframe. 

Konstantin Malanchev, co-author of the paper and postdoc at the University of Illinois at Urbana-Champaign

'We described the properties of our simulations using a set of characteristics expected to be observed in real astronomical bodies. In the dataset of approximately a million objects, we were looking for super-powerful supernovae, Type Ia supernovae, Type II supernovae, and tidal disruption events. We refer to such classes of objects as anomalies. They are either very rare, with little-known properties, or appear interesting enough to merit further study.'

The light curve data from real objects was then compared to that of simulations using the k-D tree algorithm. A k-D tree is a geometric data structure for splitting space into smaller parts by cutting it with hyperplanes, planes, lines or points. In the current research, this algorithm was used to narrow down the search range when looking for real objects with properties similar to those described in the seven simulations.

Subsequently, the team identified 15 nearest neighbours, ie real objects from the ZTF database, for each simulation—105 matches in total, which the researchers then examined visually to check for anomalies. The manual verification confirmed 11 anomalies, of which seven were supernova candidates, and four were active galactic nuclei candidates where tidal disruption events could occur. 

Maria Pruzhinskaya, a co-author of the paper and research fellow at the Sternberg Astronomical Institute

'This is a very good result. In addition to the already-discovered rare objects, we were able to detect several new ones previously missed by astronomers. This means that existing search algorithms can be improved to avoid missing such objects.'

This study demonstrates that the method is highly effective, while relatively easy to apply. The proposed algorithm for detecting space phenomena of a certain type is universal and can be used to discover any interesting astronomical objects, not limited to rare types of supernovae. 

Matvey Kornilov, Associate Professor of the HSE University Faculty of Physics

'Astronomical and astrophysical phenomena which have not yet been discovered are in fact anomalies. Their observed manifestations are expected to differ from the properties of known objects. In the future, we will try using our method to discover new classes of objects.'

See also:

'I Believe That at HSE University, You Can Grow Bigger'

Tharaa Ali, from Syria, got her Master’s in Moscow and is now a first-year PhD student in informatics and computer engineering at HSE University. Below, she talks about the use of AI in learning, winning scholarships, and doing research at HSE University.

From Covid-19 to Risk Appetite: How HSE University’s Supercomputer Helps Researchers

Whether researching how the human brain works, identifying the source of COVID-19, running complex calculations or testing scientific hypotheses, supercomputers can help us solve the most complex tasks. One of the most powerful supercomputers in the CIS is cHARISMa, which is now in its third year of operation at HSE University.Pavel Kostenetskiy, Head of the HSE UniversitySupercomputer Modeling Unit, talks about how the supercomputer works and what kind of projects it works on.

From Drones to Diagnosing Dyslexia in Children: The Activities of the HSE AI Centre

The HSE Centre for Artificial Intelligence, together with its partners in industry, is working on 25 applied projects in the fields of telecommunications, finance, education, medicine, etc. The results of the work by researchers and developers were recently presented at a meeting of a Russian government working group. That meeting summed up the initial results of the federal Artificial Intelligence project, part of the national Digital Economy programme.

Helping the Homeless with AI Technology

A research team from the HSE University Artificial Intelligence Centre led by Ivan Yamshchikov has developed a model to predict the success of efforts to rehabilitate homeless people. The model can predict the effectiveness of the work of organisations for the homeless with about 80% accuracy. The project was presented at a conference dedicated to the activities of social centres.

HSE Neural Interface Technology to Be Introduced in Hospitals

The Federal Brain and Neural Technology Centre at the Federal Medical and Biological Agency is launching the Laboratory of Medical Neural Interfaces and Artificial Intelligence for Clinical Applications, which has been created by employees of HSE University. Read below to find out about the Laboratory and its objectives.

Justice 'Ex Machina': Using Artificial Intelligence to Fight Corruption

In Mexico, a pilot project applying artificial intelligence (AI) algorithms enabled the Tax Administration Service to detect 1200 tax-evading companies and 3500 fraudulent transactions within three months – a task that would have taken 18 months using conventional methods. Despite some obvious benefits, the use of AI-based solutions to counter corruption also entails several challenges, according to experts of the HSE Laboratory for Anti-Corruption Policy (LAP) and the HSE Faculty of Law who have examined the relevant experience of several countries. A report based on the study’s* findings was presented at the XXIII Yasin (April) International Academic Conference hosted by the Higher School of Economics.

‘I Like to Think that the Solutions We Find Can Help People in the Future’

Innopolis University has announced the results of Global Al Challenge, an international AI industry online hackathon in which teams of developers compete to create new materials using artificial intelligence. The DrugANNs team, which included students from the HSE University Faculty of Computer Science, took third place.

How to Film Bruce Willis in His Absence: Deepfake Creation and Application

In recent years, advanced technologies for creating deepfake images have made it almost impossible to distinguish them from real photos and videos. Researchers discussed the future development of deepfakes and how to protect yourself from new types of fraud during the round-table discussion ‘Fake News: An Interdisciplinary Approach’ as part of the XXIII Yasin (April) International Academic Conference on Economic and Social Development.

Flexible Yet Stable: What a Legal System in a Digital Era Should Look Like

The transformation of all aspects of economic and public life due to new technologies necessitates the development of a legal framework for the application of innovation. The HSE Faculty of Law has hosted the 10th international scientific-practical conference ‘Law in the Digital Era’ online. The participants included a wide range of experts from Russian and international universities, public bodies and other organisations.

HSE University Take Part in Developing and Signing AI Code of Ethics in Russia

HSE University Rector Nikita Anisimov, along with the heads of many other leading Russian universities and tech companies signed the National Code of Ethics in the field of Artificial Intelligence. HSE University experts took part in the development of this document. The presentation of the code and the signing ceremony took place at the first International Forum on "Ethics of Artificial Intelligence: the Beginning of Trust".