Extended Morphosyntactic Testset for Word2Vec

Title:

Extended Morphosyntactic Testset for Word2Vec

Creator:

Kocmi, Tom and Bojar, Ondřej

Contributor:

Charles University@@8502/2016@@GAUK 8502/2016@@Other@@

Publisher:

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

Identifier:

http://hdl.handle.net/11234/1-1730

Subject:

syntactic questions

Type:

text, other, and lexicalConceptualResource

Description:

We have created test set for syntactic questions presented in the paper [1] which is more general than Mikolov's [2]. Since we were interested in morphosyntactic relations, we extended only the questions of the syntactic type with exception of nationality adjectives which is already covered completely in Mikolov's test set. We constructed the pairs more or less manually, taking inspiration in the Czech side of the CzEng corpus [3], where explicit morphological annotation allows to identify various pairs of Czech words (different grades of adjectives, words and their negations, etc.). The word-aligned English words often shared the same properties. Another sources of pairs were acquired from various webpages usually written for learners of English. For example for verb tense, we relied on a freely available list of English verbs and their morphological variations. We have included 100-1000 different pairs for each question set. The questions were constructed from the pairs similarly as by Mikolov: generating all possible pairs of pairs. This leads to millions of questions, so we randomly selected 1000 instances per question set, to keep the test set in the same order of magnitude. Additionally, we decided to extend set of questions on opposites to cover not only opposites of adjectives but also of nouns and verbs.

Language:

English

Rights:

Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
http://creativecommons.org/licenses/by-sa/4.0/
PUB

Harvested from:

LINDAT/CLARIAH-CZ repository

Metadata only:

false

Date:

2016-05-30