• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site
For visually-impairedFor visually-impairedUser profile (HSE staff only)Search
Advanced search
Menu
HSE University
User profile (HSE staff only)Search
Advanced search

Course Syllabus

Master 2022/2023

Deep Learning

Category 'Best Course for Career Development'
Category 'Best Course for Broadening Horizons and Diversity of Knowledge and Skills'
Category 'Best Course for New Knowledge and Skills'
Type: Elective course (Machine Learning and Data Analysis)
Area of studies: Applied Mathematics and Informatics
Delivered by: Department of Informatics
Where: St. Petersburg School of Physics, Mathematics, and Computer Science
When: 1 year, 3, 4 module
Mode of studies: offline
Open to: students of one campus
Instructors: Aleksei Shpilman
Master’s programme: Machine Learning and Data Analysis
Language: English
ECTS credits: 6
Contact hours: 48

Course Syllabus

Full Syllabus

Abstract

The discipline of choice. Deep learning is a popular area that uses neural networks of complex architecture. Such systems give better results in areas such as image and video processing, sound and text. The course will cover the main types of architectures and the principles of operation and training of deep neural networks and conduct practice in the above areas of application. To master the discipline, the student must have knowledge in the field of machine learning and optimization methods.
Learning Objectives

Learning Objectives

  • The objectives of mastering the discipline "Deep Learning" are the formation of students' theoretical knowledge and practical skills on the basics of building large neural networks for deep learning.
Expected Learning Outcomes

Expected Learning Outcomes

  • He knows the general, general scientific and business vocabulary used in the field of deep learning. It receives from articles (including in English) information about the structure of the neural network and the features used to solve a specific problem. Describes, presents and analyzes the results of applying deep learning methods to solve applied problems.
  • He knows the main types of tasks solved using deep learning. Develops architecture, implements, trains and optimizes the parameters of neural networks. It solves applied problems from various fields using deep learning.
  • Knows optimization algorithms for deep neural networks based on various variations of gradient descent. Configures such algorithms based on the conditions of a specific task
  • Knows the basic architecture of neural networks used to classify images. Modifies layers and various parameters to solve applied problems. It uses networks to solve the problems of image classification, image segmentation and video stream.
Course Contents

Course Contents

  • Optimization and Regularization Algorithms
  • Image Processing and Analysis
  • Natural Language Processing, Competitive and Generative Neural Networks
  • Hyperparameter Optimization, Reinforcement Learning
Assessment Elements

Assessment Elements

  • non-blocking Homework №1
    Homework №1 is given to students in one version and consists of 3 tasks. Homework completion time is 4 weeks. The form of presentation of homework is an algorithm implemented in any programming language.
  • non-blocking Homework №2
    Homework №2 is given to students in one version and consists of 3 tasks. Homework completion time is 4 weeks. The form of presentation of homework is an algorithm implemented in any programming language.
  • non-blocking Homework №3
    Homework №3 is given to students in one version and consists of 3 tasks. Homework completion time is 4 weeks. The form of presentation of homework is an algorithm implemented in any programming language.
  • blocking Exam №1
    The oral examination is conducted in the form of answers to the questions of the examination ticket. The exam ticket contains two questions from the list of questions for the exam. Additional questions are possible if the examinee did not answer the ticket questions in sufficient detail. 2.5 hours are allotted for the preparation of the answer.
  • blocking Exam №2
    The oral examination is conducted in the form of answers to the questions of the examination ticket. The exam ticket contains two questions from the list of questions for the exam. Additional questions are possible if the examinee did not answer the ticket questions in sufficient detail. 2.5 hours are allotted for the preparation of the answer.
Interim Assessment

Interim Assessment

  • 2022/2023 3rd module
    The teacher takes into account the assessment for the current control (homework). Accumulated = 0.5 * Oh/m1 + 0.5 * Oh/w2 The resulting grade for the discipline is calculated as follows: Result = 0.5 * Accumulated + 0.5 * Exam
  • 2022/2023 4th module
    0.5 * Homework №3 + 0.5 * Exam №2
Bibliography

Bibliography

Recommended Core Bibliography

  • Iba, H. (2018). Evolutionary Approach to Machine Learning and Deep Neural Networks : Neuro-Evolution and Gene Regulatory Networks. Singapore: Springer. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1833749

Recommended Additional Bibliography

  • Taweh Beysolow II. (2017). Introduction to Deep Learning Using R. Springer. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsrep&AN=edsrep.b.spr.sprbok.978.1.4842.2734.3