Магистратура
2026/2027
Искусственный интеллект в аудиовизуальном медиапроизводстве
Статус:
Курс по выбору (Медиапроизводство и медиааналитика)
Кто читает:
Департамент медиа
Где читается:
Санкт-Петербургская школа гуманитарных наук и искусств
Когда читается:
2-й курс, 2 модуль
Охват аудитории:
для своего кампуса
Язык:
английский
Кредиты:
3
Контактные часы:
28
Course Syllabus
Abstract
The course is designed to master innovative solutions in the field of artificial intelligence aimed at developing high-quality content products. Students will acquire practical knowledge and skills in digital image synthesis and video content creation based on modern methodologies and technologies. The program includes studying the fundamentals of directing and compositional mastery necessary for creating visually appealing and expressive media structures. Special attention is given to sound design issues, enabling participants to effectively integrate musical elements and sound effects into their projects. The final stage of the course involves independent development of an original audiovisual product with a unique creative solution that incorporates an original concept, stylistics, and professional sound design.
Learning Objectives
- This course focuses on common techniques for applying Generative Artificial Intelligence in audiovisual media production. Students will learn to harness AI for creative industries and develop their own multi-agent system throughout the implementation of a creative media project.
Expected Learning Outcomes
- create and securely store and transfer API keys and tokens for using artificial intelligence services
- distinguish types of generative neural network models
- use AI aggregators
- manage access restrictions to artificial intelligence models, such as rate limits
- use prompt engineering techniques to agent systems
- set system instructions for agents
- analyze changing trends in the development of artificial intelligence systems
- design a media visual product with AI
- create sets of images to represent an idea using generative AI in a unified style
- create frames for video generation
- generate and edit video using AI
- create sound effects for videos using AI
- ensure the accessibility of the audiovisual project for people with disabilities
- present the result of a project created using AI, taking into account ethical considerations
- describe the technology stack behind the developed AI product
- apply the basics of psychoacoustics to create prompts for audio generation
- develop an audio brand using generative AI
- create audio effects using generative AI
- configure audio generation models to build an audiovisual narrative
- use composition techniques when generating images and videos
- develop prompts using knowledge from the theory of narrative construction and composition
- build agent systems for generating visual material
- conduct a security audit of the artificial intelligence system
- analyze the risks of introducing an artificial intelligence system
- mitigate the risks of introducing an artificial intelligence system
- analyze the components of a multi-agent system
- distinguish between areas of application of multi-agent systems
- design multi-agent systems for media
- create a set of tools for programming multi-agent systems
Course Contents
- Installing Dependencies, Setting Up Infrastructure
- Prompt Engineering: From Magic Words to Context Engineering
- Agentic Systems: Architecture, Orchestration, and Control
- AI Safety, Security, and Responsible Deployment
- Visual Grammar, Composition, and Audiovisual Narrative
- Sound Design
- Final Project
Assessment Elements
- HometaskWritten homework in the format of an essay, a practical project, or question answering
- Final ProjectOral presentation of projects and a written report or slides
Bibliography
Recommended Core Bibliography
- A creator's guide to transmedia storytelling : how to captivate and engage audiences across multi..., Phillips, A., 2012
- Alexis Bogroff, & Dominique Guégan. (2019). Artificial Intelligence, Data, Ethics: An Holistic Approach for Risks and Regulation. Documents de Travail Du Centre d’Economie de La Sorbonne.
- All-in on AI : how smart companies win big with artificial intelligence, Davenport, T. H., 2023
- An introduction to multiagent systems, Wooldridge, M., 2009
- Digital storytelling : capturing lives, creating community, Lambert, J., 2013
- Dunin-Kȩplicz, B. (2005). Monitoring, Security, and Rescue Techniques in Multiagent Systems (Vol. 1st ed). New York, NY: Springer. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=170880
- Sound design : the expressive power of music, voice, and sound effects in cinema, Sonnenschein, D., 2001
- The international encyclopedia of media studies. Vol. 2: Media production, , 2013
Recommended Additional Bibliography
- Aaker, D. A. (2014). Building Strong Brands. [Place of publication not identified]: Free Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1977313
- Artificial intelligence : law and regulation, , 2022
- Generative artificial intelligence : what everyone needs to know®, Kaplan, J., 2024
- Haenlein, M., & Kaplan, A. (2019). A Brief History of Artificial Intelligence: On the Past, Present, and Future of Artificial Intelligence. California Management Review, 61(4), 5–14. https://doi.org/10.1177/0008125619864925
- How to build a great screenplay : a master class in storytelling for film, Howard, D., 2004
- Human compatible : artificial intelligence and the problem of control, Russell, S., 2019
- Introduction to media production : from analog to digital, Kindem, G., 2001
- Multiagent systems : algorithmic, game-theoretic, and logical foundations, Shoham, Y., 2009
- Shoham, Y., & Leyton-Brown, K. (2009). Multiagent Systems : Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge: Cambridge University Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=269245