54  Last view: 2024-06-136  Last update: 2018-03-02

QT21 Domain Specific Human Error-Annotated data set

http://www.qt21.eu/,

https://lindat.mff.cuni.cz/

Training of Automatic Post-editing and Quality Estimation components / Quality Estimation / Error Analysis.
Set of 10,800 domain-specific Human Error-Annotated (HEA) tuplets for four language pairs and six translation engines. The set consists of 8,800 quadruplets made of (source, target, HPE, HEA) and 2,000 quintuplets which contain a second HEA produced by a different annotator i.e. (source, target, HPE, HEA1, HEA2). The domain for En-De and En-Cz is IT, the domain for En-Lv and De-En is Pharma. This HEA data set is based on the HPE in the QT21 Domain-Specific Human Post-Edited data set. A total of six translation engines have been used to produce the targets that have been post-edited: PBMT from KIT and NMT (Nematus) for En-De, PBMT from KIT for De-En, PBMT from CUNI for En-Cz and both PBMT and NMT systems from Tilde for En-Lv. For each language pair, one unique set of source segments has been used as input to the different translation engines. From each translation engine, 1,800 target segments have been error-annotated. From each subset of 1,800 HEA segments, 400 are annotated by two different professional translators (except for the two En-LV engines for which only 200 have been doubly annotated). En-De and De-En HEAs have been collected by professional translators from Text & Form. En-Lv HEAs have been collected by professional translators from Tilde. En-Cz HEAs have been collected by professional translators from Aspena.

IMPORTANT LEGAL NOTICE (This dataset is provided under the following terms of use)
TAUS Terms of Use (https://lindat.mff.cuni.cz/repository/xmlui/page/licence-TAUS_QT21).
TAUS grants to QT21 User access to the WMT Data Set with the following rights:
i) the right to use the target side of the translation units into a commercial product, provided that QT21 User may not resell the WMT Data Set as if it is its own new translation;
ii) the right to make Derivative Works; and
iii) the right to use or resell such Derivative Works commercially and for the following goals:
i) research and benchmarking;
ii) piloting new solutions; and
iii) testing of new commercial services.