-
- Downloads
defined separate tokenization rules for french and english. Fixed some bugs in maca_lexer.
Showing
- maca_common/include/trie.h 13 additions, 0 deletionsmaca_common/include/trie.h
- maca_lexer/src/context.c 1 addition, 0 deletionsmaca_lexer/src/context.c
- maca_lexer/src/context.h 1 addition, 0 deletionsmaca_lexer/src/context.h
- maca_lexer/src/maca_lexer.c 23 additions, 8 deletionsmaca_lexer/src/maca_lexer.c
- maca_tokenizer/CMakeLists.txt 16 additions, 2 deletionsmaca_tokenizer/CMakeLists.txt
- maca_tokenizer/main.c 0 additions, 10 deletionsmaca_tokenizer/main.c
- maca_tokenizer/src/context.c 149 additions, 0 deletionsmaca_tokenizer/src/context.c
- maca_tokenizer/src/context.h 33 additions, 0 deletionsmaca_tokenizer/src/context.h
- maca_tokenizer/src/en_tok_rules.l 27 additions, 0 deletionsmaca_tokenizer/src/en_tok_rules.l
- maca_tokenizer/src/fr_tok_rules.l 4 additions, 0 deletionsmaca_tokenizer/src/fr_tok_rules.l
- maca_tokenizer/src/maca_tokenizer.c 43 additions, 0 deletionsmaca_tokenizer/src/maca_tokenizer.c
Loading
Please register or sign in to comment