Skip to content
Snippets Groups Projects
user avatar
Benoit Favre authored
02ba6756
History
Deps
----

- gtk3 for python2 (package is python2-gobject in archlinux)
- liblo with python2 bindings (OSC library)

Install
-------

1) ./download-models.sh

2) get and build gst plugin from https://gitlab.lif.univ-mrs.fr/benoit.favre/gst-kaldi-nnet2-online-rocio

3) copy libgstkaldionline2.so to ./asr/ or change GST_PLUGIN_PATH in main.py to point to its directory

4) go to slu/src and build the slu library with make (requires openfst)

Run
---

1) The main program:
./start.sh

2) The osc server (optional):
python2 osc.py

Documentation
-------------

Some doc for gtk development:
developing with pygtk3: http://lazka.github.io/pgi-docs/, https://python-gtk-3-tutorial.readthedocs.org/en/latest/

Todo
----

DONE configuration for osc
DONE non intrusive animated scrolling
DONE make configuration box options persistant
DONE push words through osc
DONE global action send which deals with
DONE - show a warning (optional)
DONE - send action through osc
DONE - show an action performed message (message log with timing?)
DONE click section = select that section
DONE click action = perform action 
DONE add thread for slu
DONE remove section changer UI
DONE change xml view to reflect already performed actions, already recognized text
DONE add global keybindings (1-9 for sections, y/n)...
DONE events = click action or words to resynchronize ?

add slu model selector
add UI to edit phonetizations

insert timer in main ui, use it for logger
add logger
move slu to asr
make selector a proper window
allow sequence advance in slu, add UI for that