Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.

Markus Freitag; Nitika Mathur; Daniel Deutsch; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson; Frédéric Blain; Tom Kocmi; Jiayi Wang; David Ifeoluwa Adelani; Marianna Buchicchio; Chrysoula Zerva; Alon Lavie

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.

Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie

Cognitive Science and AI

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Original language	English
Title of host publication	WMT
Pages	47-81
Number of pages	35
Publication status	Published - 2024

Access to Document

Cite this

@inproceedings{35768f99c21e4289bdd902fe01530f4e,

title = "Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.",

author = "Markus Freitag and Nitika Mathur and Daniel Deutsch and Chi-kiu Lo and Eleftherios Avramidis and Ricardo Rei and Brian Thompson and Fr{\'e}d{\'e}ric Blain and Tom Kocmi and Jiayi Wang and Adelani, {David Ifeoluwa} and Marianna Buchicchio and Chrysoula Zerva and Alon Lavie",

note = "DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.",

year = "2024",

language = "English",

pages = "47--81",

booktitle = "WMT",

}

TY - GEN

T1 - Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.

AU - Freitag, Markus

AU - Mathur, Nitika

AU - Deutsch, Daniel

AU - Lo, Chi-kiu

AU - Avramidis, Eleftherios

AU - Rei, Ricardo

AU - Thompson, Brian

AU - Blain, Frédéric

AU - Kocmi, Tom

AU - Wang, Jiayi

AU - Adelani, David Ifeoluwa

AU - Buchicchio, Marianna

AU - Zerva, Chrysoula

AU - Lavie, Alon

N1 - DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

PY - 2024

Y1 - 2024

M3 - Conference contribution

SP - 47

EP - 81

BT - WMT

ER -