========= EVALD 1.0 ========= EVALD 1.0 is a software for automatic evaluation of surface coherence (cohesion) in Czech texts written by native speakers of Czech. The evaluation part (the server) is implemented in Treex (http://ufal.cz/treex), a highly modular NLP framework written in the Perl programming language, and uses the Weka toolkit (http://www.cs.waikato.ac.nz/ml/weka/) for the final prediction of a coherence mark. It can be used directly from a command line or as a backend server for a client. The client part is implemented as a web server, accessible with a web browser. ================================================= There are three possible ways of using EVALD 1.0: ================================================= 1. as a web demo and RESTful web service hosted at the LINDAT/CLARIN server, 2. locally with both the server and the client running on the same machine (or two machines in the same network), 3. from a command line; the Treex scenario is run directly on the local machine. ================================================= Ad 1) No installation is needed in this case; in a web browser (such as Firefox or Chrome), go to https://lindat.mff.cuni.cz/services/evald/. ================================================= Ad 2) Both the server and the client components are distributed via the Docker software (https://www.docker.com/), which needs to be installed first. Docker greatly simplifies the installation process of the two components and allows them to be run on Linux-based operating systems, Windows 10, as well as Mac OS X. To download both the server and the client, run the following commands: docker pull ufal/evald.treex-server:1.0 docker pull ufal/evald.php-server:1.0 See the EVALD 1.0 project web pages (http://ufal.mff.cuni.cz/evald/documentation) for further instructions. ================================================= Ad 3) The dockerized backend component can be run and queried directly from a command line, too. In order (for more experienced users) to gain better control over the processing pipeline, the server application can be installed also without being wrapped by a Docker container. Treex (http://ufal.cz/treex) needs to be installed on the local machine, along with all (mostly CPAN) dependencies for the Czech text analysis (please note that in this case, some parts of the Czech analysis can only be run on Linux-based systems). Treex must be in the revision 8785eee60754ce914818aa8ca0b40ef5c8ebe6bd, cloned from https://github.com/ufal/treex. In addition, Vowpal Wabbit 8.1.1 (https://github.com/JohnLangford/vowpal_wabbit/releases/tag/8.1.1) must be installed to the location installed_tools/ml/vowpal_wabbit-v8.1-3cf3f692/ relative to the Treex Share directory. The Treex scenario to be run is a part of this Lindat EVALD 1.0 distribution (file Evald-1.0.scen). See the EVALD 1.0 project web pages (http://ufal.mff.cuni.cz/evald/documentation) for further instructions. ============ Further Info ============ EVALD 1.0 project web pages: https://ufal.mff.cuni.cz/evald If you have questions or need technical support, please contact evald@ufal.mff.cuni.cz. ===================== How to Cite EVALD 1.0 ===================== Rysová Kateřina, Mírovský Jiří, Novák Michal, Rysová Magdaléna: EVALD 1.0. Data/software, LINDAT/CLARIN digital library, Prague, Czech Republic, http://hdl.handle.net/11234/1-1820, Nov 2016. There is also a paper describing the related research and experiments: Rysová Kateřina, Rysová Magdaléna, Mírovský Jiří: Automatic Evaluation of Surface Coherence in L2 Texts in Czech. In: Proceedings of the 28th Conference on Computational Linguistics and Speech Processing ROCLING XXVIII (2016), The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), Taipei, Taiwan, ISBN 978-957-30792-9-3, pp. 214-228, 2016 =============== Acknowledgement =============== EVALD 1.0 was developed at the Institute of Formal and Applied Linguistics (ÚFAL, http://ufal.mff.cuni.cz/), Faculty of Mathematics and Physics, Charles University, with the financial support of the Ministry of Culture of the Czech Republic, project Automatic Evaluation of Text Coherence in Czech (DG16P02B016, http://ufal.mff.cuni.cz/grants/evald-evaluator-discourse).