Automatically generated spelling correction corpus for Czech (Czech-SEC-AG)

  Authors

Hajič, Jan ; Náplava, Jakub and Straka, Milan

  Item identifier

http://hdl.handle.net/11234/1-2144

 Date issued

2017-04-30

 Type

corpus, text

 Size

231688 words, 6 entries

 Language(s)

Czech

 Description

Automatically generated spelling correction corpus for Czech (Czesl-SEC-AG) is a corpus containg text with automatically generated spelling errors. To create spelling errors, a character error model containing probabilities of character substitution, insertion, deletion and probabilities of swaping two adjacent characters is used. Besides these probabilities, also the probabilities of changing character casing are considered. The original clean text on which the spelling errors were generated is PDT3.0 (http://hdl.handle.net/11858/00-097C-0000-0023-1AAF-3). The original train/dev/test sentence split of PDT3.0 corpus is preserved in this dataset. Besides the data with artificial spelling errors, we also publish texts from which the character error model was created. These are the original manual transcript of an audiobook Švejk and its corrected version performed by authors of Korektor (http://ufal.mff.cuni.cz/korektor). These data are similarly to CzeSL Grammatical Error Correction Dataset (CzeSL-GEC: http://hdl.handle.net/11234/1-2143) processed into four sets based on error difficulty present.

 Publisher

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 Acknowledgement

Ministerstvo školství, mládeže a tělovýchovy České republiky

Project code: LM2015071

Project name: LINDAT/CLARIN: Institut pro analýzu, zpracování a distribuci lingvistických dat

 Subject(s)

spelling correction natural language correction

 Collection(s)

LINDAT / CLARIAH-CZ Data & Tools

Show full item record