"Using technology in the translation quality assessment"

by Dr Konstantinos Chatzitheodorou, Strategic Agenda

Update: the event has now finished (Mar 19th 2021).


The process of determining translation quality is subjective and relies on human judgments. Translation quality is affected by a variety of factors that are weighted differently in each translation task and can be viewed from different perspectives. Hence, it is not equally measurable or assessable (Almutairi, 2018). The talk will emphasize the importance of measuring translation quality and how it can be accomplished. The first part of the presentation will introduce different frameworks and software used in the process of translation evaluation focusing on error classification schemes available in both professional and academic word. The second part of the presentation will include a demonstration of Træval which is a Software-as-a-Service (SaaS) that allows humans to evaluate translation outputs. By providing an easy-to-use graphical interface, it assists researchers and users in this process. In particular, three different scenarios will be presented using the Dynamic Quality Framework - Multidimensional Quality Metrics (DQF-MQM) error typology (Lommel, 2018): an evaluation of a simple translation task, an evaluation task focused on the assessment of multi-word units, and, finally, a technology-aided evaluation task aiming to reduce subjectivity.


  • Almutairi, M.O.L., 2018. The objectivity of the two main academic approaches of translation quality assessment: arab spring presidential speeches as a case study (Doctoral dissertation, University of Leicester).
  • Chatzitheodorou, K. and Chatzistamatis, S, 2013. COSTA MT evaluation tool: An open toolkit for human machine translation evaluation. The Prague Bulletin of Mathematical Linguistics, 100(2013), pp.83-89.
  • Lommel, A., 2018. Metrics for translation quality assessment: a case for standardising error typologies. In Translation Quality Assessment (pp. 109-127). Springer, Cham.
  • Secară, A., 2005, March. Translation evaluation: A state of the art survey. In Proceedings of the eCoLoRe/MeLLANGE workshop, Leeds (Vol. 39, p. 44).

Speaker’s bio

Dr Konstantinos Chatzitheodorou is a postdoctoral researcher at the Department of Foreign Languages, Translation and Interpreting, Ionian University. He received his PhD in Applied Translation Studies and Computational Linguistics from the Aristotle University of Thessaloniki. He holds a BA in Italian Language and Literature from the School of Italian Language and Literature, Aristotle University of Thessaloniki and an MSc in Informatics in Humanities from the Department of Informatics, Ionian University. He is also ECQA Certified Terminology Manager – Engineering. He is employed as a Computational Linguist in the private sector, assisting organizations to use language data to gain strategic insights. He has also worked as a Machine Translation Expert and Terminologist at the European Parliament – Directorate-General for Translation in Luxembourg. Over the years, Konstantinos has also contributed as a researcher to several EU projects in areas of his interest.


University of Wolverhampton
Wulfruna Street
Wolverhampton, WV1 1LY
United Kingdom