WMT16 Tuning Shared Task Models (Czech-to-English)

Title:

WMT16 Tuning Shared Task Models (Czech-to-English)

Creator:

Kamran, Amir, Jawaid, Bushra, Bojar, Ondřej, and Stanojevic, Milos

Contributor:

European Union@@H2020-ICT-2014-1-645452@@QT21: Quality Translation 21@@euFunds@@info:eu-repo/grantAgreement/EC/H2020/645452 and Technology Foundation STW@@12271@@Data-Powered Domain-Specific Translation Services On Demand (DatAptor)@@Other@@

Publisher:

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL) and University of Amsterdam, ILLC

Identifier:

http://hdl.handle.net/11372/LRT-1671

Subject:

WMT16, machine translation, tuning, baseline models, and shared task

Type:

text and corpus

Description:

The item contains models to tune for the WMT16 Tuning shared task for Czech-to-English. CzEng 1.6pre (http://ufal.mff.cuni.cz/czeng/czeng16pre) corpus is used for the training of the translation models. The data is tokenized (using Moses tokenizer), lowercased and sentences longer than 60 words and shorter than 4 words are removed before training. Alignment is done using fast_align (https://github.com/clab/fast_align) and the standard Moses pipeline is used for training. Two 5-gram language models are trained using KenLM: one only using the CzEng English data and the other is trained using all available English mono data for WMT except Common Crawl. Also included are two lexicalized bidirectional reordering models, word based and hierarchical, with msd conditioned on both source and target of processed CzEng.

Language:

Czech and English

Rights:

Creative Commons - Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)
http://creativecommons.org/licenses/by-nc-sa/4.0/
PUB

Relation:

info:eu-repo/grantAgreement/EC/H2020/645452

Source:

http://www.statmt.org/wmt16/tuning-task/

Harvested from:

LINDAT/CLARIAH-CZ repository

Metadata only:

false

Date:

2016-03-21