Findings of the WMT 2021 Shared Task on Quality Estimation

Lucia Specia; Frédéric Blain; Marina Fomicheva; Chrysoula Zerva; Zhenhao Li; Vishrav Chaudhary; André F. T. Martins

Findings of the WMT 2021 Shared Task on Quality Estimation

Lucia Specia, Frédéric Blain, Marina Fomicheva, Chrysoula Zerva, Zhenhao Li, Vishrav Chaudhary, André F. T. Martins

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific

Abstract

We report the results of the WMT 2021 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word and sentence levels. This edition focused on two main novel additions: (i) prediction for unseen languages, i.e. zero-shot settings, and (ii) prediction of sentences with catastrophic errors. In addition, new data was released for a number of languages, especially post-edited data. Participating teams from 19 institutions submitted altogether 1263 systems to different task variants and language pairs.

Original language	English
Title of host publication	Proceedings of the Sixth Conference on Machine Translation
Place of Publication	Online
Publisher	Association for Computational Linguistics
Pages	684-725
Number of pages	42
Publication status	Published - 1 Nov 2021
Externally published	Yes

Access to Document

https://aclanthology.org/2021.wmt-1.71

Cite this

@inproceedings{abb2114cfd754262b42b2bdb2a167070,

title = "Findings of the WMT 2021 Shared Task on Quality Estimation",

abstract = "We report the results of the WMT 2021 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word and sentence levels. This edition focused on two main novel additions: (i) prediction for unseen languages, i.e. zero-shot settings, and (ii) prediction of sentences with catastrophic errors. In addition, new data was released for a number of languages, especially post-edited data. Participating teams from 19 institutions submitted altogether 1263 systems to different task variants and language pairs.",

author = "Lucia Specia and Fr{\'e}d{\'e}ric Blain and Marina Fomicheva and Chrysoula Zerva and Zhenhao Li and Vishrav Chaudhary and Martins, {Andr{\'e} F. T.}",

year = "2021",

month = nov,

day = "1",

language = "English",

pages = "684--725",

booktitle = "Proceedings of the Sixth Conference on Machine Translation",

publisher = "Association for Computational Linguistics",

}

TY - GEN

T1 - Findings of the WMT 2021 Shared Task on Quality Estimation

AU - Specia, Lucia

AU - Blain, Frédéric

AU - Fomicheva, Marina

AU - Zerva, Chrysoula

AU - Li, Zhenhao

AU - Chaudhary, Vishrav

AU - Martins, André F. T.

PY - 2021/11/1

Y1 - 2021/11/1

N2 - We report the results of the WMT 2021 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word and sentence levels. This edition focused on two main novel additions: (i) prediction for unseen languages, i.e. zero-shot settings, and (ii) prediction of sentences with catastrophic errors. In addition, new data was released for a number of languages, especially post-edited data. Participating teams from 19 institutions submitted altogether 1263 systems to different task variants and language pairs.

AB - We report the results of the WMT 2021 shared task on Quality Estimation, where the challenge is to predict the quality of the output of neural machine translation systems at the word and sentence levels. This edition focused on two main novel additions: (i) prediction for unseen languages, i.e. zero-shot settings, and (ii) prediction of sentences with catastrophic errors. In addition, new data was released for a number of languages, especially post-edited data. Participating teams from 19 institutions submitted altogether 1263 systems to different task variants and language pairs.

M3 - Conference contribution

SP - 684

EP - 725

BT - Proceedings of the Sixth Conference on Machine Translation

PB - Association for Computational Linguistics

CY - Online

ER -

Findings of the WMT 2021 Shared Task on Quality Estimation

Abstract

Access to Document

Fingerprint

Cite this