WMT16 Tuning Shared Task Models (English-to-Czech)

  Autoři

Kamran, Amir ; Jawaid, Bushra ; Bojar, Ondřej and Stanojevic, Milos

  Identifikátor

http://hdl.handle.net/11372/LRT-1672

 URL projektu

http://www.statmt.org/wmt16/tuning-task/

 Datum vydání

2016-03-21

 Typ

corpus, text

 Jazyky

Czech , English

 Popis

This item contains models to tune for the WMT16 Tuning shared task for English-to-Czech. CzEng 1.6pre (http://ufal.mff.cuni.cz/czeng/czeng16pre) corpus is used for the training of the translation models. The data is tokenized (using Moses tokenizer), lowercased and sentences longer than 60 words and shorter than 4 words are removed before training. Alignment is done using fast_align (https://github.com/clab/fast_align) and the standard Moses pipeline is used for training. Two 5-gram language models are trained using KenLM: one only using the CzEng Czech data and the other is trained using all available Czech mono data for WMT except Common Crawl. Also included are two lexicalized bidirectional reordering models, word based and hierarchical, with msd conditioned on both source and target of processed CzEng.

 Nakladatel

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 

University of Amsterdam, ILLC

 Sponzoři

European Union

Kód projektu: H2020-ICT-2014-1-645452

Jméno projektu: QT21: Quality Translation 21

 

Technology Foundation STW

Kód projektu: 12271

Jméno projektu: Data-Powered Domain-Specific Translation Services On Demand (DatAptor)

 Klíčová slova

WMT16 machine translation tuning baseline models shared task

 Kolekce

LRT + Open Submissions Data & Tools

Zobrazit celý záznam