Max Ryabinin
- Senior Lecturer:Faculty of Computer Science / Big Data and Information Retrieval School / Joint Department with Yandex
- Junior Research Fellow:Faculty of Computer Science / Big Data and Information Retrieval School / Yandex Laboratory
- Max Ryabinin has been at HSE University since 2017.
Courses (2022/2023)
- Deep Learning (Bachelor’s programme; Faculty of Computer Science; 4 year, 1, 2 module)Rus
- Efficient Deep Learning Systems (Bachelor’s programme; Faculty of Computer Science; 4 year, 3 module)Rus
- Research Seminar "Applied problems of data analysis" (Master’s programme; Faculty of Computer Science; 2 year, 1 module)Rus
- Research Seminar ''Internet Data Analysis'' (Master’s programme; Faculty of Computer Science; 2 year, 1, 2 module)Rus
- Past Courses
Courses (2021/2022)
- Deep Learning (Bachelor’s programme; Faculty of Computer Science; 4 year, 1, 2 module)Rus
- Efficient Deep Learning Systems (Bachelor’s programme; Faculty of Computer Science; 4 year, 3 module)Rus
Courses (2019/2020)
Publications10
- Chapter Beznosikov A., Richtarik P., Diskin M., Ryabinin M., Alexander Gasnikov. Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees, in: Thirty-Sixth Conference on Neural Information Processing Systems : NeurIPS 2022. Curran Associates, Inc., 2022. (in press)
- Chapter Pestova A., Ryabinin M., Mikhailov V., Shamardina T., Smurov I., Artemova E. RuCoLA: Russian Corpus of Linguistic Acceptability, in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2022. (in press)
- Chapter Gorbunov E., Borzunov A., Diskin M., Ryabinin M. Secure Distributed Training at Scale, in: Proceedings of the 39th International Conference on Machine Learning Vol. 162. PMLR, 2022. P. 7679-7739.
- Chapter Borzunov A., Ryabinin M., Dettmers T., Lhoest Q., Saulnier L., Diskin M., Jernite Y., Wolf T. Training Transformers Together, in: Proceedings of the NeurIPS 2021 Competitions and Demonstrations Track. PMLR, 2022. P. 335-342. doi
- Chapter Diskin M., Bukhtiyarov A., Ryabinin M., Saulnier L., Lhoest Q., Anton Sinitsin, Popov D., Pyrkin Dmitriy, Kashirin Maxim, Borzunov A., Villanova del Moral A., Mazur D., Kobelev I., Jernite Y., Wolf T., Pekhimenko G. Distributed Deep Learning In Open Collaborations, in: Advances in Neural Information Processing Systems 34 (NeurIPS 2021). Curran Associates, Inc., 2021. P. 7879-7897.
- Chapter Tikhonov A., Ryabinin M. It’s All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning, in: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. Association for Computational Linguistics, 2021. P. 3534-3546. doi
- Chapter Ryabinin M., Gorbunov E., Plokhotnyuk V., Pekhimenko G. Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices, in: Advances in Neural Information Processing Systems 34 (NeurIPS 2021). Curran Associates, Inc., 2021. P. 18195-18211.
- Chapter Ryabinin M., Malinin A., Gales M. Scaling Ensemble Distribution Distillation to Many Classes with Proxy Targets, in: Advances in Neural Information Processing Systems 34 (NeurIPS 2021). Curran Associates, Inc., 2021. P. 6023-6035.
- Chapter Ryabinin M., Sergei Popov, Liudmila Prokhorenkova, Voita E. Embedding Words in Non-Vector Space with Unsupervised Graph Learning, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 2020. P. 7317-7331. doi
- Chapter Ryabinin M., Gusev A. Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts, in: Advances in Neural Information Processing Systems 33 (NeurIPS 2020). Curran Associates, Inc., 2020. P. 3659-3672.
17 Articles by Researchers of HSE Faculty of Computer Science Accepted at NeurIPS
In 2022, 17 articles by the researchers of HSE Faculty of Computer Science were accepted at the NeurIPS (Conference and Workshop on Neural Information Processing Systems), one of the world’s most prestigious events in the field of machine learning and artificial intelligence. The 36th conference will be held in a hybrid format from November 28th to December 9th in New Orleans (USA).
Faculty Submits Ten Papers to NeurIPS 2021
35th Conference on Neural Information Processing Systems (NeurIPS 2021) is one of the world's largest conferences on machine learning and neural networks. It takes place on December 6-14, 2021.
NeurIPS — 2020 Accepts Three Articles from Faculty of Computer Science’s Researchers
34th conference on neural information processing systems NeurIPS 2020 is one of the largest conferences on machine learning in the world, taking place since 1989. It was going to take place in Vancouver, Canada on December 6-12, but takes place online.NeurIPS is as prestigious as ever, with 9,454 articles submitted and 1,300 articles accepted by the conference. Among those accepted are three articles by the researchers of the Faculty of Computer Science: