This is a new version of the repository. Do let us know (lindat-help at ufal.mff.cuni.cz) if you encounter any issues.
 

Package of word embeddings of Czech from a large corpus

Please use the following text to cite this item or export to a predefined format:
Kyjánek, Lukáš and Bonami, Olivier, 2022, Package of word embeddings of Czech from a large corpus, LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), http://hdl.handle.net/11234/1-4920.
Date issued
2022-11-07
Size
8 files
Language(s)
Description
This package comprises eight models of Czech word embeddings trained by applying word2vec (Mikolov et al. 2013) to the currently most extensive corpus of Czech, namely SYN v9 (Křen et al. 2022). The minimum frequency threshold for including a word in the model was 10 occurrences in the corpus. The original lemmatisation and tagging included in the corpus were used for disambiguation. In the case of word embeddings of word forms, units comprise word forms and their tag from a positional tagset (cf. https://wiki.korpus.cz/doku.php/en:pojmy:tag) separated by '>', e.g., kočka>NNFS1-----A----. The published package provides models trained on both tokens and lemmas. In addition, the models combine training algorithms (CBOW and Skipgram) and dimensions of the resulting vectors (100 or 500), while the training window and negative sampling remained the same during the training. The package also includes files with frequencies of word forms (vocab-frequencies.forms) and lemmas (vocab-frequencies.lemmas).
Acknowledgement
 Files in this item
Name
lemmas.sg-vectors-d500-w5-ns5.txt.gz
Size
1.39 GB
Format
application/x-gzip
Description
gzip Archive
MD5
28a62944e140d9740a4a784e5641e9f6
Preview
  File Preview
Name
forms.cbow-vectors-d100-w5-ns5.txt.gz
Size
902.78 MB
Format
application/x-gzip
Description
gzip Archive
MD5
1a5cdee28cd5a4d97c3f5932e087c5e7
Preview
  File Preview
Name
lemmas.sg-vectors-d100-w5-ns5.txt.gz
Size
306.94 MB
Format
application/x-gzip
Description
gzip Archive
MD5
ffaa2f18e8c132550866d367878e79f3
Preview
  File Preview
Name
lemmas.cbow-vectors-d100-w5-ns5.txt.gz
Size
306.42 MB
Format
application/x-gzip
Description
gzip Archive
MD5
8e179c1f139254fcbd165aefb1112cf7
Preview
  File Preview
Name
forms.sg-vectors-d100-w5-ns5.txt.gz
Size
905.41 MB
Format
application/x-gzip
Description
gzip Archive
MD5
6e08b320f2804819122208d4ea92c634
Preview
  File Preview
Name
lemmas.cbow-vectors-d500-w5-ns5.txt.gz
Size
1.41 GB
Format
application/x-gzip
Description
gzip Archive
MD5
d9ffd677972b80418e3661cd2f4bc310
Preview
  File Preview
Name
vocab-frequencies.lemmas.txt.gz
Size
4.98 MB
Format
application/x-gzip
Description
gzip Archive
MD5
7203d3d396dd052142e5c53c83183227
Preview
  File Preview
Name
forms.cbow-vectors-d500-w5-ns5.txt.gz
Size
4.11 GB
Format
application/x-gzip
Description
gzip Archive
MD5
49c909b3bb126c653d3c00c52888e15f
Preview
  File Preview
Name
forms.sg-vectors-d500-w5-ns5.txt.gz
Size
4.05 GB
Format
application/x-gzip
Description
gzip Archive
MD5
475bb337324f2ba3422e96c35b63da1d
Preview
  File Preview
Name
vocab-frequencies.forms.txt.gz
Size
17.98 MB
Format
application/x-gzip
Description
gzip Archive
MD5
47238e26437ac73ccdc08dc7a5464e2c
Preview
  File Preview