Question Dialogs Dataset

==========================
 QUESTION DIALOGS DATASET
==========================
For more details see the paper:
    "Data Collection for Interactive Learning through the Dialog", 2016,
        Vodolán Miroslav, Filip Jurčíček,  
        http://arxiv.org/abs/1603.09631


The dataset consists of standard data split into training, development and test files:
    1) question_dialogs-train.json
    2) question_dialogs-dev.json
    3) question_dialogs-test.json

Dataset files contain one dialog per line. The dialogs are stored in json format. 

Three python scripts are released with the dataset:
    a) interactive_learning_evaluator.py - Evaluates given model in interactive manner on dialogs simmulated from conversations in dataset.
    b) interactive_model_base.py - Base class which simplifies developement of interactive models by providing standard routines for communication with interactive_learning_evaluator.py simulator.
    c) simple_interactive_model.py - Simple implementation of interactive model that can be used for testing of interactive_learning_evaluator.py environment.

==============SCRIPTS USAGE==============
The interactive_learning_evaluator.py script can be run with simple_interactive_model.py in this way (for more info about its parameters use --help):

> python interactive_learning_evaluator.py "python simple_interactive_model.py" --train_dialogs dataset/question_dialogs-train.json
    which results in output similar to:
        Training dialogs from files ['question_dialogs-train.json']
            dialog_count: 950               # Count of dialogs in whole dataset
            turn_count: 4237                # Count of turns in all dialogs
            simulation_wall_time: 1s        # How long the simulation took
            avg_dialog_wall_time: 1ms       # How long the simulation took per dialog in average
            answer_correct_count: 3         # How many of answers provided by the model were correct 
            answer_incorrect_count: 2 . . .