huntoken - tokenizer and sentence splitter
Please use the following text to cite this item or export to a predefined format:
Németh, László; Halácsy, Péter and Kornai, András, 2014,
huntoken - tokenizer and sentence splitter, LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL),
http://hdl.handle.net/11372/LRT-1338.
Authors
Item identifier
Date issued
2014-07-30
Type
Description
HunToken is a rule based tokenizer and sentence boundary detector for Hungarian (and English) texts.
Subject(s)
Collections
This item isPublicly Available
and licensed under:
