Skip to content
Snippets Groups Projects
Commit 6951ccfc authored by Franck Dary's avatar Franck Dary
Browse files

Updated tokeparsers

parent e858bf64
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
UD_any/tokeparser_base/machine.rm
+ 16
− 30
View file @ 6951ccfc
Name : Tokenizer, Tagger, Morpho and Parser Machine Name : Tokenizer, Tagger, Morpho and Parser Machine
Classifier : tokeparser Classifier : tokeparser
{ {
Transitions : {tokenizer,data/tokenizer.ts tagger,data/tagger.ts morpho,data/morpho_parts.ts parser,data/parser.ts} Transitions : {tokenizer,data/tokenizer.ts tagger,data/tagger.ts morpho,data/morpho_parts.ts parser,data/parser.ts}
Network type : LSTM Network type : Modular
Unknown value threshold : 1 StateName : States{tokenizer tagger morpho parser} Out{128}
Buffer context : {-3 -2 -1} Context : Buffer{-3 -2 -1} Stack{2 1 0} Columns{FORM UPOS} GRU{1 1 0.0 1} In{128} Out{128}
Stack context : {2 1 0} Focused : Column{ID} NbElem{1} Buffer{0} Stack{0} GRU{1 1 0.0 1} In{128} Out{128}
Columns : {FORM UPOS} Focused : Column{EOS} NbElem{1} Buffer{-1} Stack{} GRU{1 1 0.0 1} In{128} Out{128}
Focused buffer : {-1 0} Focused : Column{FORM} NbElem{10} Buffer{-1 0} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Focused stack : {2 1 0} Focused : Column{FEATS} NbElem{10} Buffer{-1 0} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Focused columns : {ID EOS FORM FEATS DEPREL} Focused : Column{DEPREL} NbElem{1} Buffer{} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Max nb elements : {1 1 10 10 1} RawInput : Left{5} Right{5} GRU{1 1 0.0 1} In{64} Out{64}
Raw input left window : 5 SplitTrans : GRU{1 1 0.0 1} In{128} Out{128}
Raw input right window : 5 DepthLayerTree : Columns{DEPREL} Buffer{} Stack{2 1 0} LayerSizes{3} GRU{1 1 0.0 1} In{128} Out{128}
Embeddings size : 128 InputDropout : 0.4
MLP : {2048 0.3} MLP : {2048 0.3 512 0.1}
Context LSTM size : 512 End
Focused LSTM size : 256 Optimizer : Adam {0.0005 0.9 0.999 0.00000001 0.00001 true}
Rawinput LSTM size : 32
Split trans LSTM size : 256
Num layers : 3
BiLSTM : true
LSTM dropout : 0.1
Total input dropout : 0.3
Embeddings dropout : 0.3
Dropout 2d : false
Tree embedding columns : {DEPREL}
Tree embedding buffer : {-1}
Tree embedding stack : {0 1 2}
Tree embedding nb : {6}
Tree embedding size : 128
Optimizer : Adam {0.0005 0.9 0.999 0.00000001 0.00001 true}
} }
Splitwords : data/splitwords.ts Splitwords : data/splitwords.ts
Predictions : ID FORM UPOS FEATS HEAD DEPREL EOS Predictions : ID FORM UPOS FEATS HEAD DEPREL EOS
......
UD_any/tokeparser_incr/machine.rm
+ 16
− 30
View file @ 6951ccfc
Name : Tokenizer, Tagger, Morpho and Parser Machine Name : Tokenizer, Tagger, Morpho and Parser Machine
Classifier : tokeparser Classifier : tokeparser
{ {
Transitions : {tokenizer,data/tokenizer.ts tagger,data/tagger.ts morpho,data/morpho_parts.ts parser,data/parser.ts} Transitions : {tokenizer,data/tokenizer.ts tagger,data/tagger.ts morpho,data/morpho_parts.ts parser,data/parser.ts}
Network type : LSTM Network type : Modular
Unknown value threshold : 1 StateName : States{tokenizer tagger morpho parser} Out{128}
Buffer context : {-3 -2 -1} Context : Buffer{-3 -2 -1} Stack{2 1 0} Columns{FORM UPOS} GRU{1 1 0.0 1} In{128} Out{128}
Stack context : {2 1 0} Focused : Column{ID} NbElem{1} Buffer{0} Stack{0} GRU{1 1 0.0 1} In{128} Out{128}
Columns : {FORM UPOS} Focused : Column{EOS} NbElem{1} Buffer{-1} Stack{} GRU{1 1 0.0 1} In{128} Out{128}
Focused buffer : {-1 0} Focused : Column{FORM} NbElem{10} Buffer{-1 0} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Focused stack : {2 1 0} Focused : Column{FEATS} NbElem{10} Buffer{-1 0} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Focused columns : {ID EOS FORM FEATS DEPREL} Focused : Column{DEPREL} NbElem{1} Buffer{} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Max nb elements : {1 1 10 10 1} RawInput : Left{5} Right{5} GRU{1 1 0.0 1} In{64} Out{64}
Raw input left window : 5 SplitTrans : GRU{1 1 0.0 1} In{128} Out{128}
Raw input right window : 5 DepthLayerTree : Columns{DEPREL} Buffer{} Stack{2 1 0} LayerSizes{3} GRU{1 1 0.0 1} In{128} Out{128}
Embeddings size : 128 InputDropout : 0.4
MLP : {2048 0.3} MLP : {2048 0.3 512 0.1}
Context LSTM size : 512 End
Focused LSTM size : 256 Optimizer : Adam {0.0005 0.9 0.999 0.00000001 0.00001 true}
Rawinput LSTM size : 32
Split trans LSTM size : 256
Num layers : 3
BiLSTM : true
LSTM dropout : 0.1
Total input dropout : 0.3
Embeddings dropout : 0.3
Dropout 2d : false
Tree embedding columns : {DEPREL}
Tree embedding buffer : {-1}
Tree embedding stack : {0 1 2}
Tree embedding nb : {6}
Tree embedding size : 128
Optimizer : Adam {0.0005 0.9 0.999 0.00000001 0.00001 true}
} }
Splitwords : data/splitwords.ts Splitwords : data/splitwords.ts
Predictions : ID FORM UPOS FEATS HEAD DEPREL EOS Predictions : ID FORM UPOS FEATS HEAD DEPREL EOS
......
UD_any/tokeparser_seq/machine.rm
+ 16
− 30
View file @ 6951ccfc
Name : Tokenizer, Tagger, Morpho and Parser Machine Name : Tokenizer, Tagger, Morpho and Parser Machine
Classifier : tokeparser Classifier : tokeparser
{ {
Transitions : {tokenizer,data/tokenizer.ts tagger,data/tagger.ts morpho,data/morpho_parts.ts parser,data/parser.ts} Transitions : {tokenizer,data/tokenizer.ts tagger,data/tagger.ts morpho,data/morpho_parts.ts parser,data/parser.ts}
Network type : LSTM Network type : Modular
Unknown value threshold : 1 StateName : States{tokenizer tagger morpho parser} Out{128}
Buffer context : {-3 -2 -1 1 2 3} Context : Buffer{-3 -2 -1 1 2} Stack{2 1 0} Columns{FORM UPOS} GRU{1 1 0.0 1} In{128} Out{128}
Stack context : {2 1 0} Focused : Column{ID} NbElem{1} Buffer{0} Stack{0} GRU{1 1 0.0 1} In{128} Out{128}
Columns : {FORM UPOS} Focused : Column{EOS} NbElem{1} Buffer{-1} Stack{} GRU{1 1 0.0 1} In{128} Out{128}
Focused buffer : {-1 0 1 2} Focused : Column{FORM} NbElem{10} Buffer{-1 0 1} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Focused stack : {2 1 0} Focused : Column{FEATS} NbElem{10} Buffer{-1 0 1} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Focused columns : {ID EOS FORM FEATS DEPREL} Focused : Column{DEPREL} NbElem{1} Buffer{} Stack{2 1 0} GRU{1 1 0.0 1} In{128} Out{128}
Max nb elements : {1 1 10 10 1} RawInput : Left{5} Right{5} GRU{1 1 0.0 1} In{64} Out{64}
Raw input left window : 5 SplitTrans : GRU{1 1 0.0 1} In{128} Out{128}
Raw input right window : 5 DepthLayerTree : Columns{DEPREL} Buffer{} Stack{2 1 0} LayerSizes{3} GRU{1 1 0.0 1} In{128} Out{128}
Embeddings size : 128 InputDropout : 0.4
MLP : {2048 0.3} MLP : {2048 0.3 512 0.1}
Context LSTM size : 512 End
Focused LSTM size : 256 Optimizer : Adam {0.0005 0.9 0.999 0.00000001 0.00001 true}
Rawinput LSTM size : 32
Split trans LSTM size : 256
Num layers : 3
BiLSTM : true
LSTM dropout : 0.1
Total input dropout : 0.3
Embeddings dropout : 0.3
Dropout 2d : false
Tree embedding columns : {DEPREL}
Tree embedding buffer : {-1}
Tree embedding stack : {0 1 2}
Tree embedding nb : {6}
Tree embedding size : 128
Optimizer : Adam {0.0005 0.9 0.999 0.00000001 0.00001 true}
} }
Splitwords : data/splitwords.ts Splitwords : data/splitwords.ts
Predictions : ID FORM UPOS FEATS HEAD DEPREL EOS Predictions : ID FORM UPOS FEATS HEAD DEPREL EOS
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment