44  Last view: 2024-06-135  Last update: 2018-03-02

QT21 WMT17 Human Error-Annotated data set

http://www.qt21.eu/,

https://lindat.mff.cuni.cz/

Training of Automatic Post-editing and Quality Estimation components / Quality Estimation / Error Analysis.

Set of 1,800 WMT17 Human Error-Annotated (HEA) quintuplets for three language pairs and nine translation engines. Each quadruplet consists of (source, target, HPE, HEA1, HEA2). The source data comes from the WMT17 news task. A total of nine translation engines have been used to produce the targets that have been post-edited: Translations (targets) have been generated using, “1 62.0 0.308 uedin-nmt”,”3 55.9 0.111 limsi-factored-norm”, “54.1 0.050 CU-Chimera” for En-Cz, “69.8 0.139 uedin-nmt”,”66.7 0.022 KIT”, “66.0 0.003 RWTH-nmt-ensemb” for En-De and “54.4 0.196 tilde-nc-nmt-smt”, “50.8 0.075 limsi-fact-norm”,”50.0 0.058 usfd-cons-qt21” for En-Lv. From each translation engine, 200 target segments have been post-edited which further have been error-annotated by two different professional translators. En-De HEAs have been collected by professional translators from Text&Form. En-Lv HEAs have been collected by professional translators from Tilde. En-Cz HEAs have been collected by professional translators from Aspena.

IMPORTANT LEGAL NOTICE (This dataset is provided under the following terms of use)
TAUS Terms of Use (https://lindat.mff.cuni.cz/repository/xmlui/page/licence-TAUS_QT21).
TAUS grants to QT21 User access to the WMT Data Set with the following rights:
i) the right to use the target side of the translation units into a commercial product, provided that QT21 User may not resell the WMT Data Set as if it is its own new translation;
ii) the right to make Derivative Works; and
iii) the right to use or resell such Derivative Works commercially and for the following goals:
i) research and benchmarking;
ii) piloting new solutions; and
iii) testing of new commercial services.