Translating Sign Language to Natural Language Text using Deep Learning

Student: Chertkov Maksim

Supervisor: Ilya Makarov

Faculty: HSE Tikhonov Moscow Institute of Electronics and Mathematics (MIEM HSE)

Educational Programme: Applied Mathematics (Bachelor)

Year of Graduation: 2019

Pattern recognition and object detection technologies are widely distributed today, and are applied in different fields: from driving to recognizing people on the street. One of the most effective technologies in this direction is Yolo (you only look once). At the same time, a medium-level convolution network is enough to separate images into classes.Today a lot of research is devoted to American sign language, the purpose of this research is to create a gesture recognition system for the Russian sign language and let it work with data from arbitrary conditions on resource-limited devices. Furthermore, the task also consists in creating a model that won't be dependent on any sign language that let further methods be expanded and accessible to people from different countries.

Student Theses at HSE must be completed in accordance with the University Rules and regulations specified by each educational programme.

Summaries of all theses must be published and made freely available on the HSE website.

The full text of a thesis can be published in open access on the HSE website only if the authoring student (copyright holder) agrees, or, if the thesis was written by a team of students, if all the co-authors (copyright holders) agree. After a thesis is published on the HSE website, it obtains the status of an online publication.

Student theses are objects of copyright and their use is subject to limitations in accordance with the Russian Federation’s law on intellectual property.

In the event that a thesis is quoted or otherwise used, reference to the author’s name and the source of quotation is required.

Search all student theses