The Seminar of the International Center for Analysis and Choice of Decisions
On Wednesday, April 7, the National Research University Higher School of Economics hosted the Seminar of the International Center for Analysis and Choice of Decisions
Speaker: Bakhtin P.D. (NRU HSE, Sberbank)
The report presents a number of methods for training neural network models for vectorization of scientific and technical texts based on knowledge transfer. In particular, a method is proposed for transferring knowledge from the citation graph of scientific articles to the SciBERT language model. The quality of the models is assessed both on the own benchmark of the research fronts, and on the foreign benchmark SciDocs.