Eye-Tracking Recordings from a Pilot Study of WMT-style MT Outputs Ranking

  Authors

Bojar, Ondřej ; Děchtěrenko, Filip and Zelenina, Maria

  Item identifier

http://hdl.handle.net/11234/1-1679

 Date issued

2016-03-31

 Type

corpus, image

 Language(s)

Czech , English

 Description

This package contains the eye-tracker recordings of 8 subjects evaluating English-to-Czech machine translation quality using the WMT-style ranking of sentences. We provide the set of sentences evaluated, the exact screens presented to the annotators (including bounding box information for every area of interest and even for individual letters in the text) and finally the raw EyeLink II files with gaze trajectories. The description of the experiment can be found in the paper: Ondřej Bojar, Filip Děchtěrenko, Maria Zelenina. A Pilot Eye-Tracking Study of WMT-Style Ranking Evaluation. Proceedings of the LREC 2016 Workshop “Translation Evaluation – From Fragmented Tools and Data Sets to an Integrated Ecosystem”, Georg Rehm, Aljoscha Burchardt et al. (eds.). pp. 20-26. May 2016, Portorož, Slovenia. This work has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement no. 645452 (QT21). This work was partially financially supported by the Government of Russian Federation, Grant 074-U01. This work has been using language resources developed, stored and distributed by the LINDAT/CLARIN project of the Ministry of Education, Youth and Sports of the Czech Republic (project LM2010013).

 Publisher

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 Acknowledgement

European Union

Project code: H2020-ICT-2014-1-645452

Project name: QT21: Quality Translation 21

 

Government of Russian Federation

Project code: 074-U01

Project name: n/a

 Subject(s)

eye-tracking MT evaluation

 Collection(s)

LINDAT / CLARIAH-CZ Data & Tools

Show full item record