Urdu Monolingual Corpus

 
LINDAT / CLARIAH-CZ
  Authors
Jawaid, Bushra ; Kamran, Amir and Bojar, Ondřej
  Item identifier
http://hdl.handle.net/11858/00-097C-0000-0023-65A9-5
 Date issued
2014-03-22
 Type
lexicalConceptualResource, text
 Size
5464575 sentences
 Language(s)
Urdu
 Description
We release a sizeable monolingual Urdu corpus automatically tagged with part-of-speech tags. We extend the work of Jawaid and Bojar (2012) who use three different taggers and then apply a voting scheme to disambiguate among the different choices suggested by each tagger. We run this complex ensemble on a large monolingual corpus and release the both plain and tagged corpora.
 Publisher
Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)
 Acknowledgement

European Union

Project code: FP7-ICT-2011-7-288487

Project name: MosesCore

 Subject(s)
Urdu monolingual data annotated data corpus
 Collection(s)
LINDAT / CLARIAH-CZ Data & Tools
Show full item record
 

 Files in this item

 Download all files in item (468.16 MB)
This item is
Publicly Available
and licensed under:
Attribution-NonCommercial-ShareAlike 3.0 Unported (CC BY-NC-SA 3.0)
Distributed under Creative Commons Attribution Required Noncommercial Share Alike
Icon
Name
urdu-tagged-corpus.gz
Size
253.82 MB
Format
application/x-gzip
Description
Urdu Monolingual Tagged Corpus
MD5
63d61d9ebae592598c41a6746ec9938b
 Download file
Icon
Name
urdu-plain-text-corpus.gz
Size
213.46 MB
Format
application/x-gzip
Description
Urdu Monolingual Plain Text Corpus
MD5
100b1db9efd403ee677683b3268084d9
 Download file
Icon
Name
urmono-lrec-2014.pdf
Size
152.86 KB
Format
PDF
Description
Urdu data description
MD5
528b61b0dd860aff9e3fe8d9b3c31b80
 Download file
Icon
Name
cleaning-tools.tar.gz
Size
748.74 KB
Format
application/x-gzip
Description
Cleaning tools
MD5
469377de9bbb6f900a2322547d2566d8
 Download file  Preview
 File Preview  
  • cleaning-tools
    • del_sentences_with_missing_spaces.pl879 B
    • detectLanguage.pl1 kB
    • filter_arabic_sentences.pl619 B
    • del_invalid_utf8.pl417 B
    • README796 B
    • remove_repeated_chars.pl1 kB
    • tok-dan.pl1 kB
    • remove_sindhi_sentences.pl857 B
    • detect_en_sentence.pl440 B
    • langfeatures.dat3 MB
    • convert-urNum-to-enNum.pl754 B
    • clean-corpus.sh4 kB