Manual Re-evaluation of Translation Quality of WMT 2018 English-Czech systems

Title:

Manual Re-evaluation of Translation Quality of WMT 2018 English-Czech systems

Creator:

Popel, Martin, Tomková, Markéta, and Tomek, Jakub

Contributor:

Ministerstvo školství, mládeže a tělovýchovy České republiky@@LM2015071@@LINDAT/CLARIN: Institut pro analýzu, zpracování a distribuci lingvistických dat@@nationalFunds@@

Publisher:

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

Identifier:

http://hdl.handle.net/11234/1-3209

Subject:

machine translation, manual evaluation, fluency, adequacy, and Translation Turing test

Type:

text and corpus

Description:

This data set contains four types of manual annotation of translation quality, focusing on the comparison of human and machine translation quality (aka human-parity). The machine translation system used is English-Czech CUNI Transformer (CUBBITT). The annotations distinguish adequacy, fluency and overall quality. One of the types is Translation Turing test - detecting whether the annotators can distinguish human from machine translation. All the sentences are taken from the English-Czech test set newstest2018 (WMT2018 News translation shared task www.statmt.org/wmt18/translation-task.html), but only from the half with originally English sentences translated to Czech by a professional agency.

Language:

Czech and English

Rights:

Creative Commons - Attribution 4.0 International (CC BY 4.0)
http://creativecommons.org/licenses/by/4.0/
PUB

Harvested from:

LINDAT/CLARIAH-CZ repository

Metadata only:

false

Date:

2020-04-08