UDPipe

Straka, Milan; Straková, Jana

UDPipe

LINDAT / CLARIAH-CZ

Authors: Straka, Milan and Straková, Jana

Item identifier: http://hdl.handle.net/11234/1-1702

Project URL: http://ufal.mff.cuni.cz/udpipe

Demo URL: http://lindat.mff.cuni.cz/services/udpipe/

Date issued: 2016-05-23

Type: toolService

Language(s): English

Description: UDPipe is an trainable pipeline for tokenization, tagging, lemmatization and dependency parsing of CoNLL-U files. UDPipe is language-agnostic and can be trained given only annotated data in CoNLL-U format. Trained models are provided for nearly all UD treebanks. UDPipe is available as a binary, as a library for C++, Python, Perl, Java, C#, and as a web service. UDPipe is a free software under Mozilla Public License 2.0 (http://www.mozilla.org/MPL/2.0/) and the linguistic models are free for non-commercial use and distributed under CC BY-NC-SA (http://creativecommons.org/licenses/by-nc-sa/4.0/) license, although for some models the original data used to create the model may impose additional licensing conditions. UDPipe is versioned using Semantic Versioning (http://semver.org/). UDPipe website http://ufal.mff.cuni.cz/udpipe contains download links of both the released packages and trained models, hosts documentation and offers online demo. UDPipe development repository http://github.com/ufal/udpipe is hosted on GitHub.

Publisher: Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

Subject(s): tokenizer POS tagger tagger lemmatization parser dependency parser CoNLL-U

Collection(s): LINDAT / CLARIAH-CZ Data & Tools

Show full item record

Files in this item

This item is

Publicly Available

and licensed under:
Mozilla Public License 2.0

Name: udpipe-1.0.0-bin.zip
Size: 10.51 MB
Format: application/zip
Description: Binaries, sources and documentation
MD5: 440b06f8c743ab352d1502c0876baef9

Download file Preview

File Preview

udpipe-1.0.0-bin
- src
  - .editorconfig133 B
  - parsito
    - parser
      - parser_nn_trainer.h1 kB
      - parser.h1 kB
      - parser_nn.h2 kB
      - parser.cpp1 kB
      - parser_nn.cpp8 kB
      - parser_nn_trainer.cpp20 kB
    - CHANGES232 B
    - configuration
      - node_extractor.cpp4 kB
      - value_extractor.h951 B
      - value_extractor.cpp2 kB
      - configuration.cpp939 B
      - node_extractor.h1 kB
      - configuration.h740 B
    - README1 kB
    - network
      - neural_network_trainer.cpp15 kB
      - neural_network.cpp5 kB
      - neural_network.h1 kB
      - network_parameters.h1 kB
      - activation_function.h880 B
      - neural_network_trainer.h3 kB
    - AUTHORS82 B
    - embedding
      - embedding.cpp3 kB
      - embedding_encode.cpp1 kB
      - embedding.h1 kB
    - Makefile.include1000 B
    - version
      - version.h886 B
      - version.cpp1 kB
    - transition
      - transition_system_projective.h824 B
      - transition_system.h1 kB
      - transition.cpp3 kB
      - transition_system_link2.h814 B
      - transition_system_swap.cpp7 kB
      - transition_system_projective.cpp10 kB
      - transition.h2 kB
      - transition_oracle.h1 kB
      - transition_system.cpp1 kB
      - transition_system_swap.h812 B
      - transition_system_link2.cpp4 kB
    - LICENSE16 kB
    - tree
      - tree_format_conllu.cpp7 kB
      - tree_format.h1 kB
      - tree.h847 B
      - tree_format.cpp1 kB
      - node.h1 kB
      - tree_format_conllu.h1 kB
      - tree.cpp1 kB
  - Makefile1 kB
  - .clang_complete15 B
  - udpipe.cpp7 kB
  - rest_server
    - udpipe_service.h2 kB
    - microrestd
      - libmicrohttpd
        platform_interface.h10 kB
        response.cpp14 kB
        connection.h3 kB
        microhttpd.h84 kB
        memorypool.h3 kB
        MHD_config.h3 kB
        response.h1 kB
        platform.h5 kB
        README429 B
        tsearch.h1 kB
        postprocessor.cpp35 kB
        w32functions.cpp19 kB
        autoinit_funcs.h1 kB
        w32functions.h5 kB
        reason_phrase.h1 kB
        internal.h33 kB
        COPYING26 kB
        connection.cpp97 kB
        memorypool.cpp7 kB
        daemon.cpp132 kB
        reason_phrase.cpp3 kB
        internal.cpp5 kB
        AUTHORS2 kB
      - CHANGES82 B
      - README827 B
      - AUTHORS39 B
      - rest_server
        xml_builder.h3 kB
        xml_response_generator.cpp794 B
        string_piece.h1 kB
        response_generator.h752 B
        rest_server.h2 kB
        version.h710 B
        version.cpp623 B
        json_response_generator.h809 B
        json_builder.h3 kB
        rest_service.h664 B
        rest_request.h1 kB
        rest_server.cpp23 kB
        json_builder.cpp2 kB
        xml_response_generator.h805 B
        json_response_generator.cpp801 B
        xml_builder.cpp1 kB
      - pugixml.h473 B
      - Makefile.include957 B
      - pugixml
        pugiconfig.h2 kB
        LICENSE1 kB
        pugixml.cpp158 kB
        pugixml.h35 kB
        README368 B
        AUTHORS624 B
      - LICENSE16 kB
      - microrestd.h796 B
    - udpipe_server.cpp3 kB
    - udpipe_service.cpp8 kB
  - morphodita
    - tagset_converter
      - strip_lemma_id_tagset_converter.cpp1 kB
      - identity_tagset_converter.cpp879 B
      - identity_tagset_converter.h932 B
      - pdt_to_conll2009_tagset_converter.h1 kB
      - tagset_converter.cpp3 kB
      - strip_lemma_comment_tagset_converter.cpp1 kB
      - strip_lemma_id_tagset_converter.h1 kB
      - strip_lemma_comment_tagset_converter.h1 kB
      - tagset_converter.h1 kB
      - pdt_to_conll2009_tagset_converter.cpp2 kB
    - CHANGES1 kB
    - README1 kB
    - derivator
      - derivator_dictionary.cpp6 kB
      - derivator.h1 kB
      - derivation_formatter.h1 kB
      - derivator_dictionary.h1 kB
      - derivator_dictionary_encoder.h726 B
      - derivation_formatter.cpp3 kB
      - derivator_dictionary_encoder.cpp7 kB
    - AUTHORS82 B
    - morpho
      - morpho_statistical_guesser.cpp4 kB
      - external_morpho.cpp4 kB
      - generic_lemma_addinfo.h1 kB
      - small_stringops.h1 kB
      - morpho.cpp2 kB
      - tag_filter.h1 kB
      - czech_lemma_addinfo.h4 kB
      - czech_morpho.h1 kB
      - english_lemma_addinfo.h2 kB
      - english_morpho_guesser_encoder.h770 B
      - persistent_unordered_map_encoder.h3 kB
      - morpho_prefix_guesser_encoder.cpp2 kB
      - Makefile572 B
      - morpho_dictionary.h9 kB
      - english_morpho_guesser.h2 kB
      - persistent_unordered_map.h7 kB
      - english_morpho_guesser.rl20 kB
      - morpho_dictionary_encoder.h9 kB
      - czech_morpho_encoder.h803 B
      - morpho_prefix_guesser.h4 kB
      - morpho_statistical_guesser.h980 B
      - english_morpho_encoder.cpp1 kB
      - casing_variants.h2 kB
      - czech_morpho.cpp9 kB
      - raw_morpho_dictionary_reader.cpp1 kB
      - external_morpho_encoder.h708 B
      - external_morpho.h1 kB
      - morpho.h4 kB
      - morpho_statistical_guesser_encoder.cpp3 kB
      - english_morpho.h1 kB
      - morpho_prefix_guesser_encoder.h734 B
      - english_morpho.cpp8 kB
      - morpho_statistical_guesser_trainer.h1 kB
      - generic_morpho.h1 kB
      - morpho_statistical_guesser_trainer.cpp8 kB
      - generic_morpho_encoder.cpp1 kB
      - tag_filter.cpp1 kB
      - generic_morpho.cpp6 kB
      - morpho_statistical_guesser_encoder.h739 B
      - morpho_ids.h1 kB
      - czech_morpho_encoder.cpp1 kB
      - english_morpho_guesser.cpp63 kB
      - english_morpho_encoder.h752 B
      - external_morpho_encoder.cpp1 kB
      - raw_morpho_dictionary_reader.h862 B
      - english_morpho_guesser_encoder.cpp3 kB
      - generic_morpho_encoder.h861 B
    - tagger
      - tagger.h1 kB
      - czech_elementary_features.h9 kB
      - feature_sequences_optimizer.h7 kB
      - tagger_ids.h2 kB
      - perceptron_tagger.h3 kB
      - generic_elementary_features.h12 kB
      - conllu_elementary_features.h14 kB
      - feature_sequences_encoder.h4 kB
      - training_maps.h1 kB
      - perceptron_tagger_trainer.h9 kB
      - elementary_features_encoder.h874 B
      - tagger.cpp2 kB
      - vli.h1 kB
      - tagger_trainer.h4 kB
      - viterbi.h4 kB
      - elementary_features.h2 kB
      - feature_sequences.h8 kB
    - Makefile.include1 kB
    - version
      - version.h912 B
      - version.cpp1 kB
    - tokenizer
      - czech_tokenizer.cpp12 kB
      - ragel_tokenizer.h1 kB
      - vertical_tokenizer.h809 B
      - ragel_tokenizer.rl4 kB
      - english_tokenizer.h930 B
      - generic_tokenizer_factory.cpp832 B
      - tokenizer_factory.cpp1 kB
      - english_tokenizer.cpp16 kB
      - gru_tokenizer_trainer.h1 kB
      - czech_tokenizer.rl6 kB
      - gru_tokenizer_network.cpp839 B
      - generic_tokenizer_factory.h849 B
      - tokenizer_ids.h1 kB
      - Makefile661 B
      - gru_tokenizer.cpp3 kB
      - tokenizer.h1 kB
      - generic_tokenizer_factory_encoder.cpp708 B
      - gru_tokenizer_network_trainer.h20 kB
      - gru_tokenizer_factory.cpp1 kB
      - unicode_tokenizer.cpp2 kB
      - generic_tokenizer.cpp9 kB
      - gru_tokenizer_network.h7 kB
      - ragel_tokenizer.cpp15 kB
      - gru_tokenizer_trainer.cpp2 kB
      - english_tokenizer.rl5 kB
      - tokenizer_factory.h880 B
      - generic_tokenizer.rl2 kB
      - gru_tokenizer_factory.h951 B
      - gru_tokenizer.h1 kB
      - generic_tokenizer.h817 B
      - .gru_tokenizer_network_trainer.h.swp4 kB
      - czech_tokenizer.h1 kB
      - tokenizer.cpp1 kB
      - unicode_tokenizer.h1 kB
      - vertical_tokenizer.cpp1 kB
      - generic_tokenizer_factory_encoder.h701 B
    - LICENSE16 kB
  - Makefile.builtem13 kB
  - model
    - model.h997 B
    - .pipeline.cpp.swp20 kB
    - evaluator.h1 kB
    - model_morphodita_parsito.h2 kB
    - pipeline.cpp2 kB
    - model_morphodita_parsito.cpp5 kB
    - model.cpp1019 B
    - pipeline.h1 kB
    - evaluator.cpp9 kB
  - sentence
    - sentence.cpp1 kB
    - word.h1 kB
    - input_format.h1 kB
    - output_format.h951 B
    - sentence.h925 B
    - output_format.cpp3 kB
    - multiword_token.h947 B
    - input_format.cpp9 kB
  - version
    - version.h849 B
    - version.cpp1 kB
  - Makefile.include2 kB
  - unilib
    - unicode.cpp177 kB
    - utf8.cpp2 kB
    - utf16.cpp1 kB
    - CHANGES898 B
    - README816 B
    - AUTHORS82 B
    - version.h789 B
    - unistrip.h1 kB
    - version.cpp702 B
    - utf16.h6 kB
    - uninorms.cpp224 kB
    - uninorms.h1 kB
    - Makefile.include534 B
    - utf8.h8 kB
    - LICENSE16 kB
    - unicode.h3 kB
    - unistrip.cpp35 kB
  - common.h598 B
  - utils
    - url_detector.cpp48 kB
    - binary_decoder.h3 kB
    - binary_encoder.h2 kB
    - parse_double.h3 kB
    - process_args.h4 kB
    - split.h1 kB
    - compressor_load.cpp38 kB
    - common.h1 kB
    - threadsafe_stack.h1 kB
    - compressor_save.cpp92 kB
    - url_detector.h948 B
    - string_piece.h1 kB
    - README628 B
    - CHANGES675 B
    - pointer_decoder.h1 kB
    - options.h1 kB
    - getpara.h1022 B
    - parse_int.h3 kB
    - compressor.h778 B
    - xml_encoded.h1 kB
    - named_values.h3 kB
    - LICENSE16 kB
    - new_unique_ptr.h755 B
    - options.cpp2 kB
    - AUTHORS39 B
    - iostreams.h1 kB
  - tokenizer
    - multiword_splitter_trainer.cpp2 kB
    - multiword_splitter_trainer.h694 B
    - detokenizer.h2 kB
    - multiword_splitter.cpp3 kB
    - multiword_splitter.h905 B
    - detokenizer.cpp5 kB
  - trainer
    - training_failure.cpp696 B
    - training_failure.h844 B
    - trainer.h1 kB
    - trainer_morphodita_parsito.h3 kB
    - trainer_morphodita_parsito.cpp39 kB
    - trainer.cpp2 kB
- src_lib_only
  - udpipe.cpp989 kB
  - udpipe.h5 kB
- bindings
  - README.PERL4 kB
  - java
    - examples
      - Makefile589 B
      - RunUDPipe.java1 kB
    - Makefile1 kB
    - udpipe_java.i318 B
  - perl
    - std_common.i795 B
    - examples
      - run_udpipe.pl1 kB
    - udpipe_perl.i103 B
    - Makefile1 kB
    - perlstrings.swg1 kB
  - README.CS4 kB
  - common
    - udpipe_stl.i527 B
    - udpipe.i8 kB
    - Makefile.common979 B
  - README.PYTHON4 kB
  - python
    - examples
      - run_udpipe.py1 kB
    - pystrings.swg3 kB
    - Makefile1 kB
    - udpipe_python.i509 B
  - README.JAVA5 kB
  - csharp
    - examples
      - RunUDPipe.cs1 kB
      - Makefile546 B
    - Makefile1 kB
    - udpipe_csharp.i3 kB
- bin-win32
  - java
    - udpipe_java.dll951 kB
    - udpipe.jar20 kB
  - csharp
    - udpipe_csharp.dll992 kB
    - Ufal
      - UDPipe
        Sentence.cs3 kB
        Model.cs3 kB
        Evaluator.cs3 kB
        OutputFormat.cs2 kB
        Comments.cs11 kB
        udpipe_csharp.cs454 B
        ProcessingError.cs2 kB
        MultiwordTokens.cs10 kB
        InputFormat.cs3 kB
        Children.cs10 kB
        Version.cs2 kB
        Sentences.cs10 kB
        Words.cs10 kB
        MultiwordToken.cs3 kB
        Pipeline.cs3 kB
        Trainer.cs2 kB
        Word.cs5 kB
        udpipe_csharpPINVOKE.cs78 kB
  - udpipe.exe932 kB
- CHANGES78 B
- README1 kB
- MANUAL.pdf191 kB
- MANUAL40 kB
- AUTHORS82 B
- bin-linux64
  - java
    - udpipe.jar20 kB
    - libudpipe_java.so1 MB
  - udpipe1 MB
  - csharp
    - libudpipe_csharp.so1 MB
    - Ufal
      - UDPipe
        Sentence.cs3 kB
        Model.cs3 kB
        Evaluator.cs3 kB
        OutputFormat.cs2 kB
        Comments.cs11 kB
        udpipe_csharp.cs454 B
        ProcessingError.cs2 kB
        MultiwordTokens.cs10 kB
        InputFormat.cs3 kB
        Children.cs10 kB
        Version.cs2 kB
        Sentences.cs10 kB
        Words.cs10 kB
        MultiwordToken.cs3 kB
        Pipeline.cs3 kB
        Trainer.cs2 kB
        Word.cs5 kB
        udpipe_csharpPINVOKE.cs78 kB
- INSTALL3 kB
- bin-osx
  - java
    - libudpipe_java.dylib2 MB
    - udpipe.jar20 kB
  - udpipe2 MB
  - csharp
    - libudpipe_csharp.dylib2 MB
    - Ufal
      - UDPipe
        Sentence.cs3 kB
        Model.cs3 kB
        Evaluator.cs3 kB
        OutputFormat.cs2 kB
        Comments.cs11 kB
        udpipe_csharp.cs454 B
        ProcessingError.cs2 kB
        MultiwordTokens.cs10 kB
        InputFormat.cs3 kB
        Children.cs10 kB
        Version.cs2 kB
        Sentences.cs10 kB
        Words.cs10 kB
        MultiwordToken.cs3 kB
        Trainer.cs2 kB
        Pipeline.cs3 kB
        Word.cs5 kB
        udpipe_csharpPINVOKE.cs78 kB
- LICENSE16 kB
- bin-linux32
  - java
    - udpipe.jar20 kB
    - libudpipe_java.so1 MB
  - udpipe1 MB
  - csharp
    - libudpipe_csharp.so1 MB
    - Ufal
      - UDPipe
        Sentence.cs3 kB
        Model.cs3 kB
        Evaluator.cs3 kB
        OutputFormat.cs2 kB
        Comments.cs11 kB
        udpipe_csharp.cs454 B
        ProcessingError.cs2 kB
        MultiwordTokens.cs10 kB
        InputFormat.cs3 kB
        Children.cs10 kB
        Version.cs2 kB
        Sentences.cs10 kB
        Words.cs10 kB
        Pipeline.cs3 kB
        MultiwordToken.cs3 kB
        Trainer.cs2 kB
        Word.cs5 kB
        udpipe_csharpPINVOKE.cs78 kB
- MANUAL.html60 kB
- bin-win64
  - java
    - udpipe_java.dll1 MB
    - udpipe.jar20 kB
  - csharp
    - udpipe_csharp.dll1 MB
    - Ufal
      - UDPipe
        Sentence.cs3 kB
        Model.cs3 kB
        Evaluator.cs3 kB
        OutputFormat.cs2 kB
        Comments.cs11 kB
        udpipe_csharp.cs454 B
        ProcessingError.cs2 kB
        MultiwordTokens.cs10 kB
        InputFormat.cs3 kB
        Children.cs10 kB
        Version.cs2 kB
        Sentences.cs10 kB
        Words.cs10 kB
        Trainer.cs2 kB
        MultiwordToken.cs3 kB
        Pipeline.cs3 kB
        Word.cs5 kB
        udpipe_csharpPINVOKE.cs78 kB
  - udpipe.exe1 MB