• A
  • A
  • A
  • АБB
  • АБB
  • АБB
  • А
  • А
  • А
  • А
  • А
Обычная версия сайта
2024/2025

Анализ неструктурированных данных

Статус: Маго-лего
Когда читается: 1, 2 модуль
Охват аудитории: для своего кампуса
Преподаватели: Карпов Илья Андреевич
Язык: русский
Кредиты: 6

Программа дисциплины

Аннотация

This course focuses on applied methods and existing tools for information retrieval: web scrap-ing, data preprocessing, natural language processing. All methods considered in this course require basic knowledge of discrete mathematics and probabilistic theory. For instance, most NLP and IR methods use conditional probability. In this course, we show the implementation of contemporary approaches in existing software packages (preferably in the python frameworks), and demonstrate how these methods can be used for the solution of some real-world problems.
Цель освоения дисциплины

Цель освоения дисциплины

  • to show the implementation of contemporary approaches in existing software packages (preferably in the python frameworks), and demonstrate how these methods can be used for the solution of some real-world problems.
Планируемые результаты обучения

Планируемые результаты обучения

  • be able to criticize constructively and determine existing issues with applied nlp tasks
  • be able to get necessary data for research and applied projects
  • be able to perform basic ETL operations with datasets and unstructured data
  • have an understanding of the basic principles of information retrieval
  • have the skill to meaningfully develop an appropriate data analysis pipeline
  • have the skill to work unstructured text data
  • know advantages of existing natural language processing packages
  • know the basic principles behind the the existing deep learning approaches
Содержание учебной дисциплины

Содержание учебной дисциплины

  • IR tasks overview, Python dive in
  • Web information extraction
  • Text normalisation
  • Syntax parsing, fact extraction
  • Language modelling, text classification and clustering
  • Sentiment detection
  • Large Language Models
  • Machine translation, question answering
  • Summarization and Domain adaptation
  • Vector Databases. Semantic search and indexing
  • Additional topics and course projects defense
Элементы контроля

Элементы контроля

  • неблокирующий Homework
  • неблокирующий Final test
  • неблокирующий Final Project Defense
Промежуточная аттестация

Промежуточная аттестация

  • 2024/2025 2nd module
    0.4 * Final Project Defense + 0.2 * Final test + 0.4 * Homework
Список литературы

Список литературы

Рекомендуемая основная литература

  • Shay Cohen. (2019). Bayesian Analysis in Natural Language Processing : Second Edition. San Rafael: Morgan & Claypool Publishers. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=2102157

Рекомендуемая дополнительная литература

  • Manning, C. D., & Schèutze, H. (1999). Foundations of Statistical Natural Language Processing. Cambridge, Mass: The MIT Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=24399

Авторы

  • Павлова Ирина Анатольевна
  • Паринов Андрей Андреевич