Large-Scale Colloquial Persian 0.5

  Autoři

Abdi Khojasteh, Hadi ; Ansari, Ebrahim and Bohlouli, Mahdi

  Identifikátor

http://hdl.handle.net/11234/1-3195

 URL projektu

https://iasbs.ac.ir/~ansari/lscp/

 Odkaz na záznam v

https://arxiv.org/abs/2003.06499

 Datum vydání

2020-02-02

 Typ

corpus, text

 Velikost

120000000 sentences, 19.6 gb

 Jazyky

Czech , English , German , Hindi , Italian , Persian

 Popis

"Large Scale Colloquial Persian Dataset" (LSCP) is hierarchically organized in asemantic taxonomy that focuses on multi-task informal Persian language understanding as a comprehensive problem. LSCP includes 120M sentences from 27M casual Persian tweets with its dependency relations in syntactic annotation, Part-of-speech tags, sentiment polarity and automatic translation of original Persian sentences in five different languages (EN, CS, DE, IT, HI).

 Nakladatel

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 

Institute for Advanced Studies in Basic Sciences (IASBS)

 Sponzoři

Czech Science Foundation

Kód projektu: 19-26934X

Jméno projektu: Neural Representations in Multi-modal and Multi-lingual Modelling

 Klíčová slova

PoS tagging corpus annotated corpus multilingual derivation dependency parser machine translation informal language spoken language monolingual corpus bilingual corpus annotation

 Kolekce

LINDAT / CLARIAH-CZ Data & Tools

Zobrazit celý záznam