• A
  • A
  • A
  • АБB
  • АБB
  • АБB
  • А
  • А
  • А
  • А
  • А
Обычная версия сайта
Бакалавриат 2024/2025

Распределенные базы и хранилища данных

ID 791761

Статус: Курс по выбору (Программная инженерия)
Направление: 09.03.04. Программная инженерия
Когда читается: 3-й курс, 3, 4 модуль
Формат изучения: без онлайн-курса
Охват аудитории: для своего кампуса
Язык: английский
Кредиты: 5

Course Syllabus

Abstract

Course presents a detailed introduction into distributed data processing, relational data ware-houses, multidimensional OLAP tools and massive parallel data processing systems (Hadoop, Cassandra, MongoDB). Students will develop understanding in the design methodology for distributed databases and data warehouses. Practice studies include implementing databases and applications software in map/reduce paradigm and in several NoSQL data models
Learning Objectives

Learning Objectives

  • The objective of the course is to form professional competencies related to design and imple-mentation of several kinds of distributed databases, including data warehouses, online analyti-cal data processing and big data management tools. Students will get a grasp on strengths and weaknesses of wide spectrum of approaches to data storage, search and retrieval, resulting in informed choice of database model. This course studies different conceptual database models and their properties. The models that will be discussed are: • Relational data warehouse; • Multidimensional data warehouse; • Online analytical processing; • Map/reduce massive parallel data processing; • Key/value, document, graph and wide columnar database models; • Data stream processing. For these conceptual models the course will concentrate on the following points: Why was the database model introduced? Which of the shortcomings of other models does it address? What are the most important concepts and notions for the database model? How is the model imple-mented? Which are the main techniques? The importance of understanding the internals of a particular database model cannot be overemphasized as it is closely connected to its limitations.
Expected Learning Outcomes

Expected Learning Outcomes

  • Compare databases and data warehouses
  • Construct Data Cleaning Pipelines
  • Construct MapReduce programs for execution under YARN
  • Construct Streaming Processing Programs
  • Create data models for Cassandra
  • Create Data Models for Streams
  • Create document databases, fill it with data, retrieve documents
  • Create multidimensional models
  • Describe implementation of in-memory database operations
  • Describe storage details of in-memory databases
  • Design Data Integration Solutions
  • Discuss applicability of in-memory databases
  • Discuss Cassandra concepts and architecture
  • Discuss the basic concepts of Data warehousing and OLAP technology
  • Discuss the multidimensional model and present its main characteristics, components and operations
  • Employ HDFS for file storage and retrieval
  • Explain distributed database systems architecture and design
  • Understand use cases for HDFS and Hadoop
  • Use key/value data storages
  • Write Queries and Statements in CQL
Course Contents

Course Contents

  • Data Warehousing and Big Data Management
  • Data Warehousing Architectures and Models
  • Data Cleaning And Integration
  • Key/Value and Document Databases
  • Map/Reduce and Hadoop
  • Large-scale Distributed Databases
  • In-memory Databases
  • Data Streams Management
Assessment Elements

Assessment Elements

  • non-blocking Групповой проект
  • non-blocking Эссе
  • Partially blocks (final) grade/grade calculation Экзамен
  • non-blocking Контрольная работа
  • non-blocking Работа на семинарах
Interim Assessment

Interim Assessment

  • 2024/2025 4th module
    0.14 * Эссе + 0.21 * Работа на семинарах + 0.3 * Экзамен + 0.14 * Контрольная работа + 0.21 * Групповой проект
Bibliography

Bibliography

Recommended Core Bibliography

  • Распределенные системы и алгоритмы - Миков А.И., Замятина Е.Б. - Национальный Открытый Университет "ИНТУИТ" - - - 2016 - русский - https://e.lanbook.com/book/100446 - ЛАНЬ - 100446

Recommended Additional Bibliography

  • Big Data Analytics. By: Mondal; Hofmann. Springer International Publishing
  • Kimball, Ralph, and Margy Ross. The data warehouse toolkit: The definitive guide to dimensional modeling. John Wiley & Sons, 2013.
  • Большие данные. Big Data - Макшанов А. В., Журавлев А. Е., Тындыкарь Л. Н. - Издательство "Лань" - 978-5-507-47346-5 - 2024 - русский - https://e.lanbook.com/book/362318 - ЛАНЬ - 362318
  • Распределенные базы и хранилища данных - Марасанов А.М., Аносова Н.П., Бородин О.О., Гаврилов Е.С. - Национальный Открытый Университет "ИНТУИТ" - - - 2016 - русский - https://e.lanbook.com/book/100445 - ЛАНЬ - 100445

Authors

  • Breiman Aleksandr Davidovich
  • MELIKYAN ALISA VALEREVNA