2024/2025
Анализ неструктурированных данных
Статус:
Маго-лего
Когда читается:
1, 2 модуль
Охват аудитории:
для своего кампуса
Преподаватели:
Карпов Илья Андреевич
Язык:
русский
Кредиты:
6
Программа дисциплины
Аннотация
This course focuses on applied methods and existing tools for information retrieval: web scrap-ing, data preprocessing, natural language processing. All methods considered in this course require basic knowledge of discrete mathematics and probabilistic theory. For instance, most NLP and IR methods use conditional probability. In this course, we show the implementation of contemporary approaches in existing software packages (preferably in the python frameworks), and demonstrate how these methods can be used for the solution of some real-world problems.
Цель освоения дисциплины
- to show the implementation of contemporary approaches in existing software packages (preferably in the python frameworks), and demonstrate how these methods can be used for the solution of some real-world problems.
Планируемые результаты обучения
- be able to criticize constructively and determine existing issues with applied nlp tasks
- be able to get necessary data for research and applied projects
- be able to perform basic ETL operations with datasets and unstructured data
- have an understanding of the basic principles of information retrieval
- have the skill to meaningfully develop an appropriate data analysis pipeline
- have the skill to work unstructured text data
- know advantages of existing natural language processing packages
- know the basic principles behind the the existing deep learning approaches
Содержание учебной дисциплины
- IR tasks overview, Python dive in
- Web information extraction
- Text normalisation
- Syntax parsing, fact extraction
- Language modelling, text classification and clustering
- Sentiment detection
- Large Language Models
- Machine translation, question answering
- Summarization and Domain adaptation
- Vector Databases. Semantic search and indexing
- Additional topics and course projects defense
Промежуточная аттестация
- 2024/2025 2nd module0.4 * Final Project Defense + 0.2 * Final test + 0.4 * Homework
Список литературы
Рекомендуемая основная литература
- Shay Cohen. (2019). Bayesian Analysis in Natural Language Processing : Second Edition. San Rafael: Morgan & Claypool Publishers. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=2102157
Рекомендуемая дополнительная литература
- Manning, C. D., & Schèutze, H. (1999). Foundations of Statistical Natural Language Processing. Cambridge, Mass: The MIT Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=24399