• Home
  • Repository
  • Corpus Search
  • TreeQuery
  • Treex
  • More Apps
  • About
  • CLARIN
  •  Login
  • English čeština
  • LINDAT/CLARIAH-CZ Repository Home
  • View Item
  •  
  • LINDAT/CLARIAH-CZ logo
    CLARIN logo
  •   Browse  
    •    All of the Repository  
      •   Issue Date
      •   Authors
      •   Titles
      •   Subjects
      •   Publisher
      •   Language
      •   Type
      •   Rights Label
  •   My Account  
    •    Login
  •   Statistics  
    •    StatisticsBETA
  •   General Information  
    •    Deposit
    •    Cite
    •    Submission Lifecycle
    •    FAQ
    •    About
    •    Help Desk
 
 

BulTreeBank Tokenizer

 
LRT + Open Submissions
  Authors
Simov, Kiril ; Simov, Kiril
  Item identifier
http://hdl.handle.net/11372/LRT-1240
 Project URL
http://www.bultreebank.org/clark/index.html
 Date issued
2014-07-30
 Type
toolService
 Description
The tokenizer is covering all languages that use Latin1, Laitn2, Latin3 and Cyrillic tables of Unicode. Can be extended to cover other tables in Unicode if necessary. The implementation is as a cascaded regular grammar in CLaRK. It recognizes over 60 token categories. It is easy to be adapted to new token categories.
 Publisher
Linguistic Modeling Department, IPP, Bulgarian Academy of Sciences
 Collection(s)
LRT + Open Submissions Data & Tools
Show full item record
 
 

Partners, Coordination, Funding

  • Dept. of Cybernetics, Univ. of West Bohemia
  • Institute of Formal and Applied Linguistics (Prague)
  • Institute of Czech Language (Prague)
  • NLP Centre, Masaryk University (Brno)
  • Ministry of Education, Sports and Youth of the Czech Republic

Repository

  • Main page
  • Contact
  • Submission Lifecycle
  • FAQ
  • About and Policies

More

  • CLARIN Knowledge Centre | INESS
  • CLARIN
  • META-Net
  • Service Status
  • How to Sign in
  • Terms of Use

THE LINDAT/CLARIAH-CZ PROJECT (LM2018101; which is a direct legal successor of the LINDAT/CLARIN projects LM2010013 and LM2015071)
IS FULLY SUPPORTED BY THE MINISTRY OF EDUCATION, SPORTS AND YOUTH OF THE CZECH REPUBLIC
UNDER THE PROGRAMME LM OF "LARGE INFRASTRUCTURES".

Copyright (c) 2020 UFAL MFF UK. All rights reserved.