Commits · fixhelp · Alexis Nasr / macaon2 · GitLab

Snippets Groups Projects

Dec 08, 2017
- added length as a word feature · 1dd223d1
  Alexis Nasr authored 7 years ago
  
  1dd223d1
Nov 10, 2017
- fixed bug in tokenization rules for french · 55796a1c
  Alexis Nasr authored 7 years ago
  
  55796a1c
Nov 06, 2017
- modified tokenizer so that it outputs last token (with the help of yywrap) · b564c719
  Alexis Nasr authored 7 years ago
  
  b564c719
- modified some tokenization rules for french · 0ee666eb
  Alexis Nasr authored 7 years ago
  
  0ee666eb
Oct 20, 2017
- maca_trans_chunker a new tool for chunking · cee7f975
  Alexis Nasr authored 7 years ago
  
  cee7f975
Oct 16, 2017
- modified maca_tokenizer so that it can output offset and token length · f0babb73
  Alexis Nasr authored 7 years ago
  
  f0babb73
Apr 28, 2017
- prevent the parser to produce an EOS at one point when segmentation is given... · aa5addef
  Alexis Nasr authored 8 years ago
  aa5addef
Jan 05, 2017
- ajout de regles de tokenisation · 363c1bde
  Johannes Heinecke authored 8 years ago
  
  363c1bde
Jan 04, 2017
- added some rules in french tokenizer · 821ec273
  Alexis Nasr authored 8 years ago
  
  821ec273
Dec 01, 2016
- code refactoring of maca_lexer and maca_tokenizer · 8c017b36
  Alexis Nasr authored 8 years ago
  
  8c017b36
Nov 22, 2016
- defined separate tokenization rules for french and english. Fixed some bugs in maca_lexer. · 0442bfb6
  Alexis Nasr authored 8 years ago
  
  0442bfb6
Nov 17, 2016
- added maca_lexer a program that recoginzes non ambiguous mwe · ad8f50f8
  Alexis Nasr authored 8 years ago
  
  ad8f50f8
Nov 14, 2016
- added maca_tokenizer an extremely basic tokenizer · 44a96605
  Alexis Nasr authored 8 years ago
  
  44a96605