Integration of Expert and Automated Metrics for Evaluating Translation Quality

The research is dedicated to evaluating the quality of translation; considered are the applied and pragmatic aspects of such evaluation in the conditions of the current rapid increase in the number of texts to be translated. The work summarizes a plethora of assessment principles, each having its merits and drawbacks, and examines the correlation between the categories of adequacy and equivalence as the basic assessment parameters. It is concluded that equivalence is oriented towards the result of translation, whereas adequacy indicates whether translation as a process corresponds to the communicative situation given. The article also investigates the possibility of applying these assessment criteria to the automated evaluation of translation quality, and compares the specific computer metrics or, algorithms: Cosine Similarity, Word Error Rate, BLEU, ROUGE, NIST, METEOR, STM. Analyzed is the potential for applying these metrics to man-made rather than machine translated. A new metric is developed which integrates the described fields of the translation evaluation. Alongside the STM-Augmented, a web application is created that provides an interface to measure the performance of the translation with the help of automatic metrics. It is concluded that in the future it is possible to apply other expert categories, in particular semantic ones, to automatic metrics for obtaining a more accurate translation evaluation result.