HinDialect 1.1: 26 Hindi-related languages and dialects of the Indic Continuum in North India

  Authors

Bafna, Niyati ; et al.show everyone

Bafna, Niyati ; Žabokrtský, Zdeněk ; España-Bonet, Cristina ; van Genabith, Josef ; Kumar, Lalit "Samyak Lalit" ; Suman, Sharda ; Shivay, Rahul

  Item identifier

http://hdl.handle.net/11234/1-4839

 Project URL

https://github.com/niyatibafna/north-indian-dialect-modelling

 Date issued

2022-07-14

 Type

corpus, text

 Size

356037 tokens

 Language(s)

Angika , Awadhi , Bengali , Bhadrawahi , Bhili , Bhojpuri , Braj , Bundeli , Chhattisgarhi , Garhwali , Gujarati , Haryanvi , Hindi , Kanauji , Korku , Kumaoni , Magahi , Malvi , Marathi , Nimadi , Panjabi , Rajasthani , Sanskrit , Uncoded languages

 Description

HinDialect: 26 Hindi-related languages and dialects of the Indic Continuum in North India Languages This is a collection of folksongs for 26 languages that form a dialect continuum in North India and nearby regions. Namely Angika, Awadhi, Baiga, Bengali, Bhadrawahi, Bhili, Bhojpuri, Braj, Bundeli, Chhattisgarhi, Garhwali, Gujarati, Haryanvi, Himachali, Hindi, Kanauji, Khadi Boli, Korku, Kumaoni, Magahi, Malvi, Marathi, Nimadi, Panjabi, Rajasthani, Sanskrit. This data is originally collected by the Kavita Kosh Project at http://www.kavitakosh.org/ . Here are the main characteristics of the languages in this collection: - They are all Indic languages except for Korku. - The majority of them are closely related to the standard Hindi dialect genealogically (such as Hariyanvi and Bhojpuri), although the collection also contains languages such as Bengali and Gujarati which are more distant relatives. - They are all primarily spoken in (North) India (Bengali is also spoken in Bangladesh) - All except Sanksrit are alive languages Data Categorising them by pre-existing available NLP resources, we have: * Band 1 languages : Hindi, Panjabi, Gujarati, Bengali, Nepali. These languages already have other large standard datasets available. Kavita Kosh may have very little data for these languages. * Band 2 languages: Bhojpuri, Magahi, Awadhi, Braj. These languages have growing interest and some datasets of a relatively small size as compared to Band 1 language resources. * Band 3 languages: All other languages in the collection are previously zero-resource languages. These are the languages for which this dataset is the most relevant. Script This dataset is entirely in Devanagari. Content in the case of languages not written in Devanagari (such as Bengali and Gujarati) has been transliterated by the Kavita Kosh Project. Format The dataset contains a single text file containing folksongs per language. Folksongs are separated from each other by an empty line. The first line of a new piece is the title of the folksong, and line separation within folksongs is preserved.

 Publisher

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 

Kavita Kosh Project

 Subject(s)

dialect continuum dialect variation Indic Indo-Aryan Indian Hindi

 Collection(s)

LINDAT / CLARIAH-CZ Data & Tools

 Other versions

List all versions  

Show full item record