Automatically generated spelling correction corpus for Czech (Czech-SEC-AG)

  Autoři

Hajič, Jan ; Náplava, Jakub and Straka, Milan

  Identifikátor

http://hdl.handle.net/11234/1-2144

 Datum vydání

2017-04-30

 Typ

corpus, text

 Velikost

231688 words, 6 entries

 Jazyky

Czech

 Popis

Automatically generated spelling correction corpus for Czech (Czesl-SEC-AG) is a corpus containg text with automatically generated spelling errors. To create spelling errors, a character error model containing probabilities of character substitution, insertion, deletion and probabilities of swaping two adjacent characters is used. Besides these probabilities, also the probabilities of changing character casing are considered. The original clean text on which the spelling errors were generated is PDT3.0 (http://hdl.handle.net/11858/00-097C-0000-0023-1AAF-3). The original train/dev/test sentence split of PDT3.0 corpus is preserved in this dataset. Besides the data with artificial spelling errors, we also publish texts from which the character error model was created. These are the original manual transcript of an audiobook Švejk and its corrected version performed by authors of Korektor (http://ufal.mff.cuni.cz/korektor). These data are similarly to CzeSL Grammatical Error Correction Dataset (CzeSL-GEC: http://hdl.handle.net/11234/1-2143) processed into four sets based on error difficulty present.

 Nakladatel

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 Sponzoři

Ministerstvo školství, mládeže a tělovýchovy České republiky

Kód projektu: LM2015071

Jméno projektu: LINDAT/CLARIN: Institut pro analýzu, zpracování a distribuci lingvistických dat

 Klíčová slova

spelling correction natural language correction

 Kolekce

LINDAT / CLARIAH-CZ Data & Tools

Zobrazit celý záznam