• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Deep-Learning Neural Nets as a Model of Saccadic Generation

Student: Krasovskaya Sofia

Supervisor: W.Joseph MacInnes

Faculty: Faculty of Social Sciences

Educational Programme: Cognitive Sciences and Technologies: From Neuron to Cognition (Master)

Year of Graduation: 2018

20 years ago, Laurent Itti and Christof Koch created a model of saliency in an attempt to recreate the work of biological pyramidal neurons by mimicking neurons with centre-surround receptive fields. The aim of the current study is to improve this model by using an artificial neural network that generates saccades similar to how humans make saccadic eye movements. The proposed model uses a Leaky Integrate-and-Fire layer for temporal predictions, and replaces parallel feature maps with a deep learning network in order to create a generative model, precise for both spatial and temporal predictions. Our deep neural network was able to predict eye movements based on unsupervised learning from raw images, as well as supervised learning from fixation maps retrieved during an eye-tracking experiment conducted with 35 participants at later stages in order to train a 2D softmax layer. The results imply that it is possible to match the spatial and temporal distributions of the model to corresponding human distributions.

Student Theses at HSE must be completed in accordance with the University Rules and regulations specified by each educational programme.

Summaries of all theses must be published and made freely available on the HSE website.

The full text of a thesis can be published in open access on the HSE website only if the authoring student (copyright holder) agrees, or, if the thesis was written by a team of students, if all the co-authors (copyright holders) agree. After a thesis is published on the HSE website, it obtains the status of an online publication.

Student theses are objects of copyright and their use is subject to limitations in accordance with the Russian Federation’s law on intellectual property.

In the event that a thesis is quoted or otherwise used, reference to the author’s name and the source of quotation is required.

Search all student theses