• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Using TMS to Identify Links Between Deep Neural Networks and Visual Cortex

Student: Kirill Korotaev

Supervisor: W.Joseph MacInnes

Faculty: Faculty of Social Sciences

Educational Programme: Cognitive Sciences and Technologies: From Neuron to Cognition (Master)

Year of Graduation: 2018

CNN revolutionized machine learning by becoming state of art in object recognition. Aside from being very accurate, these models have claimed to share similarities with human visual cortex. But the question of whether the same computational mechanisms are used in visual cortex remains unclear. Here, instead of simple accuracy comparison between human and model, we investigate if CNN commit same errors as our participants during identification task. We trained a CNN to discriminate between same and different pairs of faces and houses and compared performance to experimental data. We established that CNN could reach the same accuracy as our participants, and that it was capable of reproducing FIE. Next, we applied TMS to our subjects during the same task over OFA and OPA. Finally, we attempt to mimic TMS effects onto CNN by knocking out weights in the medium convlayer. We have proven that it is possible to knockout weights that are exclusively sensitive to either faces or scenes. Our results show that it is possible for CNN to reproduce human errors in an identification task and that knocking out weights in specific CNN layers can reproduce artificial lesions from TMS.

Student Theses at HSE must be completed in accordance with the University Rules and regulations specified by each educational programme.

Summaries of all theses must be published and made freely available on the HSE website.

The full text of a thesis can be published in open access on the HSE website only if the authoring student (copyright holder) agrees, or, if the thesis was written by a team of students, if all the co-authors (copyright holders) agree. After a thesis is published on the HSE website, it obtains the status of an online publication.

Student theses are objects of copyright and their use is subject to limitations in accordance with the Russian Federation’s law on intellectual property.

In the event that a thesis is quoted or otherwise used, reference to the author’s name and the source of quotation is required.

Search all student theses