Improving Analytical DBMS ClickHouse

Student: Bardukov Anatoly

Supervisor: Ivan Vitalyevich Puzyrevskiy

Educational Programme: Applied Mathematics and Information Science (Bachelor)

Final Grade: 8

Year of Graduation: 2018

The work is devoted to the improvement and expansion of the data compression capabilities in the ClickHouse column database. The developed modules will become part of the open source project of ClickHouse and allow users to specify compression methods for separate columns in tables. In addition, the solution allows application of several codecs to one data block, which positively affects the quality of data compression and, therefore, increases the bandwidth of the DBMS by reducing the number of operations with the hard disk. The solution will complement the existing compression system, which is currently unified for all columns of all tables and does not offer the ability to combine compression algorithms and filters. Also, the current system does not allow changes of the compression algorithm without restarting the ClickHouse server, which is considered in the work and available in the data definition language. In addition, work has been done to study competing systems of column databases, internal performance tests and independent studies have been considered. The proposed solution is based on the experience of other companies and takes into account their best aspects, while broadening and generalizing their approach in the application of codecs to data. Keywords: column-oriented database, DBMS, open source, compression algorithms, filters, OLAP.

Full text (added May 21, 2018)

Student Theses at HSE must be completed in accordance with the University Rules and regulations specified by each educational programme.

Summaries of all theses must be published and made freely available on the HSE website.

The full text of a thesis can be published in open access on the HSE website only if the authoring student (copyright holder) agrees, or, if the thesis was written by a team of students, if all the co-authors (copyright holders) agree. After a thesis is published on the HSE website, it obtains the status of an online publication.

Student theses are objects of copyright and their use is subject to limitations in accordance with the Russian Federation’s law on intellectual property.

In the event that a thesis is quoted or otherwise used, reference to the author’s name and the source of quotation is required.

Search all student theses