Slavic Forest, Norwegian Wood (models)

  Autoři

Rosa, Rudolf ; Zeman, Daniel ; Mareček, David and Žabokrtský, Zdeněk

  Identifikátor

http://hdl.handle.net/11234/1-1971

 Odkaz na záznam v

http://web.science.mq.edu.au/~smalmasi/vardial4/pdf/VarDial26.pdf

 Datum vydání

2017-01-28

 Typ

toolService

 Jazyky

Croatian , Norwegian , Slovak

 Popis

Trained models for UDPipe used to produce our final submission to the Vardial 2017 CLP shared task (https://bitbucket.org/hy-crossNLP/vardial2017). The SK model was trained on CS data, the HR model on SL data, and the SV model on a concatenation of DA and NO data. The scripts and commands used to create the models are part of separate submission (http://hdl.handle.net/11234/1-1970). The models were trained with UDPipe version 3e65d69 from 3rd Jan 2017, obtained from https://github.com/ufal/udpipe -- their functionality with newer or older versions of UDPipe is not guaranteed. We list here the Bash command sequences that can be used to reproduce our results submitted to VarDial 2017. The input files must be in CoNLLU format. The models only use the form, UPOS, and Universal Features fields (SK only uses the form). You must have UDPipe installed. The feats2FEAT.py script, which prunes the universal features, is bundled with this submission. SK -- tag and parse with the model: udpipe --tag --parse sk-translex.v2.norm.feats07.w2v.trainonpred.udpipe sk-ud-predPoS-test.conllu A slightly better after-deadline model (sk-translex.v2.norm.Case-feats07.w2v.trainonpred.udpipe), which we mention in the accompanying paper, is also included. It is applied in the same way (udpipe --tag --parse sk-translex.v2.norm.Case-feats07.w2v.trainonpred.udpipe sk-ud-predPoS-test.conllu). HR -- prune the Features to keep only Case and parse with the model: python3 feats2FEAT.py Case < hr-ud-predPoS-test.conllu | udpipe --parse hr-translex.v2.norm.Case.w2v.trainonpred.udpipe NO -- put the UPOS annotation aside, tag Features with the model, merge with the left-aside UPOS annotation, and parse with the model (this hassle is because UDPipe cannot be told to keep UPOS and only change Features): cut -f1-4 no-ud-predPoS-test.conllu > tmp udpipe --tag no-translex.v2.norm.tgttagupos.srctagfeats.Case.w2v.udpipe no-ud-predPoS-test.conllu | cut -f5- | paste tmp - | sed 's/^\t$//' | udpipe --parse no-translex.v2.norm.tgttagupos.srctagfeats.Case.w2v.udpipe

 Nakladatel

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 Sponzoři

European Union

Kód projektu: EC/H2020/644402

Jméno projektu: HimL - Health in my Language

 

Univerzita Karlova (mimo GAUK)

Kód projektu: SVV 260 333

Jméno projektu: Specifický vysokoškolský výzkum

 

Grantová agentura České republiky

Kód projektu: 15-10472S

Jméno projektu: Morphologically and Syntactically Annotated Corpora of Many Languages

 

Ministerstvo školství, mládeže a tělovýchovy České republiky

Kód projektu: LM2015071

Jméno projektu: LINDAT/CLARIN: Institut pro analýzu, zpracování a distribuci lingvistických dat

 

Grantová agentura Univerzity Karlovy v Praze

Kód projektu: GAUK 15723/2014

Jméno projektu: Modelování závislostní syntaxe napříč jazyky

 Klíčová slova

parsing dependency parser cross-lingual parsing universal dependencies

 Kolekce

LINDAT / CLARIAH-CZ Data & Tools

Zobrazit celý záznam