Package of word embeddings of Czech from a large corpus

Name: Package of word embeddings of Czech from a large corpus
License: http://creativecommons.org/licenses/by-nc-sa/4.0/

Kyjánek, Lukáš; Bonami, Olivier

Show simple item record

dc.contributor.author	Kyjánek, Lukáš
dc.contributor.author	Bonami, Olivier
dc.date.accessioned	2022-11-11T09:25:05Z
dc.date.available	2022-11-11T09:25:05Z
dc.date.issued	2022-11-07
dc.identifier.uri	http://hdl.handle.net/11234/1-4920
dc.description	This package comprises eight models of Czech word embeddings trained by applying word2vec (Mikolov et al. 2013) to the currently most extensive corpus of Czech, namely SYN v9 (Křen et al. 2022). The minimum frequency threshold for including a word in the model was 10 occurrences in the corpus. The original lemmatisation and tagging included in the corpus were used for disambiguation. In the case of word embeddings of word forms, units comprise word forms and their tag from a positional tagset (cf. https://wiki.korpus.cz/doku.php/en:pojmy:tag) separated by '>', e.g., kočka>NNFS1-----A----. The published package provides models trained on both tokens and lemmas. In addition, the models combine training algorithms (CBOW and Skipgram) and dimensions of the resulting vectors (100 or 500), while the training window and negative sampling remained the same during the training. The package also includes files with frequencies of word forms (vocab-frequencies.forms) and lemmas (vocab-frequencies.lemmas).
dc.language.iso	ces
dc.publisher	Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)
dc.rights	Creative Commons - Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)
dc.rights.uri	http://creativecommons.org/licenses/by-nc-sa/4.0/
dc.subject	word embeddings
dc.subject	word vectors
dc.subject	large corpus
dc.subject	word2vec
dc.subject	skipgram
dc.subject	cbow
dc.title	Package of word embeddings of Czech from a large corpus
dc.type	lexicalConceptualResource
metashare.ResourceInfo#ContentInfo.mediaType	text
metashare.ResourceInfo#ContentInfo.detailedType	computationalLexicon
dc.rights.label	PUB
has.files	yes
branding	LINDAT / CLARIAH-CZ
contact.person	Lukáš Kyjánek kyjanek@ufal.mff.cuni.cz Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)
sponsor	Charles University START/HUM/010 A data-based approach to competition in word-formation: selected semantic categories across seven languages nationalFunds
sponsor	Ministerstvo školství, mládeže a tělovýchovy České republiky LM2018101 LINDAT/CLARIAH-CZ: Digitální výzkumná infrastruktura pro jazykové technologie, umění a humanitní vědy nationalFunds
size.info	8 files
files.size	14332468293
files.count	10