Large-Scale Colloquial Persian 0.5

  Authors

Abdi Khojasteh, Hadi ; Ansari, Ebrahim and Bohlouli, Mahdi

  Item identifier

http://hdl.handle.net/11234/1-3195

 Project URL

https://iasbs.ac.ir/~ansari/lscp/

 Referenced by

https://arxiv.org/abs/2003.06499

 Date issued

2020-02-02

 Type

corpus, text

 Size

120000000 sentences, 19.6 gb

 Language(s)

Czech , English , German , Hindi , Italian , Persian

 Description

"Large Scale Colloquial Persian Dataset" (LSCP) is hierarchically organized in asemantic taxonomy that focuses on multi-task informal Persian language understanding as a comprehensive problem. LSCP includes 120M sentences from 27M casual Persian tweets with its dependency relations in syntactic annotation, Part-of-speech tags, sentiment polarity and automatic translation of original Persian sentences in five different languages (EN, CS, DE, IT, HI).

 Publisher

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 

Institute for Advanced Studies in Basic Sciences (IASBS)

 Acknowledgement

Czech Science Foundation

Project code: 19-26934X

Project name: Neural Representations in Multi-modal and Multi-lingual Modelling

 Subject(s)

PoS tagging corpus annotated corpus multilingual derivation dependency parser machine translation informal language spoken language monolingual corpus bilingual corpus annotation

 Collection(s)

LINDAT / CLARIAH-CZ Data & Tools

Show full item record