L. Specia, F. Blain, M. Fomicheva, C. Zerva, Z. Li, V. Chaudhary, and A. Martins. (2021)We report the results of the WMT 2021 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word and sentence levels. This edition focused on two main novel additions: (i) prediction for unseen languages, i.e. zero-shot settings, and (ii) prediction of sentences with catastrophic errors. In addition, new data was released for a number of languages, especially post-edited data. Participating teams from 19 institutionssubmitted altogether 1263 systems to different task variants and language pairs..
S. Strassel, and J. Tracey. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), page 3273--3280. Portoroz, Slovenia, European Language Resources Association (ELRA), (May 2016)
K. Duh, P. McNamee, M. Post, and B. Thompson. Proceedings of the 12th Language Resources and Evaluation Conference, page 2667--2675. Marseille, France, European Language Resources Association, (May 2020)
{. Agić, and I. Vulić. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, page 3204--3210. Florence, Italy, Association for Computational Linguistics, (July 2019)
J. Tiedemann, and S. Thottingal. Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, page 479--480. Lisboa, Portugal, European Association for Machine Translation, (November 2020)