• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Student
Title
Supervisor
Faculty
Educational Programme
Final Grade
Year of Graduation
Rodion Laptsuev
Importance Sampling for Generative Adversarial Networks
Data Science
(Master’s programme)
8
2018
Generative adversarial network is strong tool for data generation purposes. This model uses two networks of a generator and discriminator and it reduces Jensen Shanon distance between distribution of the generated data and the distribution of real data on each iteration. This leads to a case of strongly overlapping distributions which slows learning speed of model as a lot of observations have already reached the correct solution in the intersection but the discriminator gets big value of loss function and continues to change parameters. To solve this problem a novel technique is introduced. In this work it is demonstrated that by combining samples into pairs and applying importance sampling technique, that change the data distribution law to decrease variance of gradient evaluation, provides efficient solution for this problem. The result is confirmed on different cases beginning with simple 1d GAN on two Gaussian distributions and concluding with image classification on MNIST dataset.

Student Theses at HSE must be completed in accordance with the University Rules and regulations specified by each educational programme.

Summaries of all theses must be published and made freely available on the HSE website.

The full text of a thesis can be published in open access on the HSE website only if the authoring student (copyright holder) agrees, or, if the thesis was written by a team of students, if all the co-authors (copyright holders) agree. After a thesis is published on the HSE website, it obtains the status of an online publication.

Student theses are objects of copyright and their use is subject to limitations in accordance with the Russian Federation’s law on intellectual property.

In the event that a thesis is quoted or otherwise used, reference to the author’s name and the source of quotation is required.

Search all student theses