Skip to content
Snippets Groups Projects
Commit 17fce072 authored by Franck Dary's avatar Franck Dary
Browse files

FQB language is working

parent e0826949
No related branches found
No related tags found
No related merge requests found
Expand all Show whitespace changes
Inline Side-by-side
Showing
with 9600 additions and 9423 deletions
FQB/data/Makefile
+ 1
− 1
View file @ 17fce072
......@@ -6,7 +6,7 @@ TEST=$(FQB_DIR)/FQB.v1.Deep.conll-like.test
MCD=wpmlgfs.mcd
#This part is for lemmatizer rules and excpetions computation
THRESHOLD=50
THRESHOLD=5
STRICT=-s
FPLM_FILENAME=fplm
FP_FILENAME=fP
......
FQB/lemmatizer/lemmatizer_rules.as
+ 2
− 216
View file @ 17fce072
Default : RULE LEMMA ON FORM @@
RULE LEMMA ON FORM @ierez@yer
RULE LEMMA ON FORM @îmes@re
RULE LEMMA ON FORM @lerai@er
RULE LEMMA ON FORM @terai@er
RULE LEMMA ON FORM @îtes@re
RULE LEMMA ON FORM @ierais@yer
RULE LEMMA ON FORM @ierait@yer
RULE LEMMA ON FORM @_@
RULE LEMMA ON FORM @a@
RULE LEMMA ON FORM @e@
RULE LEMMA ON FORM @s@
RULE LEMMA ON FORM @x@
RULE LEMMA ON FORM @z@
RULE LEMMA ON FORM @çai@cer
RULE LEMMA ON FORM @aient@re
RULE LEMMA ON FORM @isses@re
RULE LEMMA ON FORM @âmes@er
RULE LEMMA ON FORM @çâmes@cer
RULE LEMMA ON FORM @ères@er
RULE LEMMA ON FORM @irent@re
RULE LEMMA ON FORM @leras@er
RULE LEMMA ON FORM @@r
RULE LEMMA ON FORM @âtes@er
RULE LEMMA ON FORM @teras@er
RULE LEMMA ON FORM @sions@re
RULE LEMMA ON FORM @ças@cer
RULE LEMMA ON FORM @assent@r
RULE LEMMA ON FORM @ieriez@yer
RULE LEMMA ON FORM @îmes@ir
RULE LEMMA ON FORM @ssions@r
RULE LEMMA ON FORM @assiez@r
RULE LEMMA ON FORM @asses@er
RULE LEMMA ON FORM @aient@er
RULE LEMMA ON FORM @çâtes@cer
RULE LEMMA ON FORM @ierons@yer
RULE LEMMA ON FORM @îtes@ir
RULE LEMMA ON FORM @ieront@yer
RULE LEMMA ON FORM @lerez@er
RULE LEMMA ON FORM @terez@er
RULE LEMMA ON FORM @aient@ir
RULE LEMMA ON FORM @¨re@©rer
RULE LEMMA ON FORM @le@
RULE LEMMA ON FORM @ne@
RULE LEMMA ON FORM @ai@
RULE LEMMA ON FORM @te@
RULE LEMMA ON FORM @as@
RULE LEMMA ON FORM @es@
RULE LEMMA ON FORM @çaient@cer
RULE LEMMA ON FORM @ez@
RULE LEMMA ON FORM @'@e
RULE LEMMA ON FORM @leraient@er
RULE LEMMA ON FORM @teraient@er
RULE LEMMA ON FORM @a@e
RULE LEMMA ON FORM @çasses@cer
RULE LEMMA ON FORM @iera@yer
RULE LEMMA ON FORM @rice@eur
RULE LEMMA ON FORM @a@r
RULE LEMMA ON FORM @e@r
RULE LEMMA ON FORM @s@r
RULE LEMMA ON FORM @t@r
RULE LEMMA ON FORM @z@r
RULE LEMMA ON FORM @u@e
RULE LEMMA ON FORM @@re
RULE LEMMA ON FORM @ient@yer
RULE LEMMA ON FORM @gnions@ndre
RULE LEMMA ON FORM @les@
RULE LEMMA ON FORM @nes@
RULE LEMMA ON FORM @ais@
RULE LEMMA ON FORM @tes@
RULE LEMMA ON FORM @ait@
RULE LEMMA ON FORM @ent@
RULE LEMMA ON FORM @ons@
RULE LEMMA ON FORM @ont@
RULE LEMMA ON FORM @iez@
RULE LEMMA ON FORM @ai@e
RULE LEMMA ON FORM @ve@f
RULE LEMMA ON FORM @as@e
RULE LEMMA ON FORM @ux@l
RULE LEMMA ON FORM @ai@r
RULE LEMMA ON FORM @se@r
RULE LEMMA ON FORM @as@r
RULE LEMMA ON FORM @es@r
RULE LEMMA ON FORM @nt@r
RULE LEMMA ON FORM @ez@r
RULE LEMMA ON FORM @e@re
RULE LEMMA ON FORM @__prep@
RULE LEMMA ON FORM @s@re
RULE LEMMA ON FORM @t@re
RULE LEMMA ON FORM @se@x
RULE LEMMA ON FORM @u@re
RULE LEMMA ON FORM @a@er
RULE LEMMA ON FORM @e@ir
RULE LEMMA ON FORM @u@ir
RULE LEMMA ON FORM @aient@e
RULE LEMMA ON FORM @ierions@yer
RULE LEMMA ON FORM @çassions@cer
RULE LEMMA ON FORM @âmes@r
RULE LEMMA ON FORM @âtes@r
RULE LEMMA ON FORM @isse@re
RULE LEMMA ON FORM @ère@er
RULE LEMMA ON FORM @ssais@r
RULE LEMMA ON FORM @lera@er
RULE LEMMA ON FORM @ssait@r
RULE LEMMA ON FORM @tera@er
RULE LEMMA ON FORM @sais@re
RULE LEMMA ON FORM @sait@re
RULE LEMMA ON FORM @asses@r
RULE LEMMA ON FORM @aient@r
RULE LEMMA ON FORM @ées@er
RULE LEMMA ON FORM @ssant@r
RULE LEMMA ON FORM @sant@re
RULE LEMMA ON FORM @ça@cer
RULE LEMMA ON FORM @sent@re
RULE LEMMA ON FORM @asse@er
RULE LEMMA ON FORM @ions@re
RULE LEMMA ON FORM @ssent@r
RULE LEMMA ON FORM @sons@re
RULE LEMMA ON FORM @siez@re
RULE LEMMA ON FORM @ssiez@r
RULE LEMMA ON FORM @ssons@r
RULE LEMMA ON FORM @tes@dre
RULE LEMMA ON FORM @lent@er
RULE LEMMA ON FORM @tent@er
RULE LEMMA ON FORM @ions@er
RULE LEMMA ON FORM @ies@yer
RULE LEMMA ON FORM @ions@
RULE LEMMA ON FORM @ais@e
RULE LEMMA ON FORM @ait@e
RULE LEMMA ON FORM @ves@f
RULE LEMMA ON FORM @ons@e
RULE LEMMA ON FORM @ont@e
RULE LEMMA ON FORM @iez@e
RULE LEMMA ON FORM @ât@r
RULE LEMMA ON FORM @sse@r
RULE LEMMA ON FORM @ais@r
RULE LEMMA ON FORM @ses@r
RULE LEMMA ON FORM @ait@r
RULE LEMMA ON FORM @se@re
RULE LEMMA ON FORM @te@re
RULE LEMMA ON FORM @ue@re
RULE LEMMA ON FORM @é@er
RULE LEMMA ON FORM @ant@r
RULE LEMMA ON FORM @ons@r
RULE LEMMA ON FORM @es@re
RULE LEMMA ON FORM @is@re
RULE LEMMA ON FORM @it@re
RULE LEMMA ON FORM @ts@re
RULE LEMMA ON FORM @us@re
RULE LEMMA ON FORM @ez@re
RULE LEMMA ON FORM @le@er
RULE LEMMA ON FORM @ai@er
RULE LEMMA ON FORM @te@er
RULE LEMMA ON FORM @ses@x
RULE LEMMA ON FORM @as@er
RULE LEMMA ON FORM @s@dre
RULE LEMMA ON FORM @t@dre
RULE LEMMA ON FORM @ue@ir
RULE LEMMA ON FORM @us@ir
RULE LEMMA ON FORM @ez@ir
RULE LEMMA ON FORM @s@tre
RULE LEMMA ON FORM @çassent@cer
RULE LEMMA ON FORM @çassiez@cer
RULE LEMMA ON FORM @' __prep@e
RULE LEMMA ON FORM @ieraient@yer
RULE LEMMA ON FORM @çât@cer
RULE LEMMA ON FORM @aient@
RULE LEMMA ON FORM @saient@re
RULE LEMMA ON FORM @ions@e
RULE LEMMA ON FORM @ssaient@r
RULE LEMMA ON FORM @lerais@er
RULE LEMMA ON FORM @çasse@cer
RULE LEMMA ON FORM @terais@er
RULE LEMMA ON FORM @çais@cer
RULE LEMMA ON FORM @çait@cer
RULE LEMMA ON FORM @lerait@er
RULE LEMMA ON FORM @terait@er
RULE LEMMA ON FORM @issent@re
RULE LEMMA ON FORM @çant@cer
RULE LEMMA ON FORM @issiez@re
RULE LEMMA ON FORM @èrent@er
RULE LEMMA ON FORM @çons@cer
RULE LEMMA ON FORM @asse@r
RULE LEMMA ON FORM @ît@re
RULE LEMMA ON FORM @assent@er
RULE LEMMA ON FORM @leriez@er
RULE LEMMA ON FORM @ée@er
RULE LEMMA ON FORM @assions@r
RULE LEMMA ON FORM @teriez@er
RULE LEMMA ON FORM @assiez@er
RULE LEMMA ON FORM @sses@r
RULE LEMMA ON FORM @lerons@er
RULE LEMMA ON FORM @terons@er
RULE LEMMA ON FORM @ais@re
RULE LEMMA ON FORM @ses@re
RULE LEMMA ON FORM @tes@re
RULE LEMMA ON FORM @ues@re
RULE LEMMA ON FORM @ait@re
RULE LEMMA ON FORM @leront@er
RULE LEMMA ON FORM @issions@re
RULE LEMMA ON FORM @teront@er
RULE LEMMA ON FORM @ant@re
RULE LEMMA ON FORM @ent@re
RULE LEMMA ON FORM @ons@re
RULE LEMMA ON FORM @és@er
RULE LEMMA ON FORM @iez@re
RULE LEMMA ON FORM @sez@re
RULE LEMMA ON FORM @ât@er
RULE LEMMA ON FORM @ssez@r
RULE LEMMA ON FORM @te@dre
RULE LEMMA ON FORM @ît@ir
RULE LEMMA ON FORM @les@er
RULE LEMMA ON FORM @ais@er
RULE LEMMA ON FORM @tes@er
RULE LEMMA ON FORM @ait@er
RULE LEMMA ON FORM @ant@er
RULE LEMMA ON FORM @ts@dre
RULE LEMMA ON FORM @ons@er
RULE LEMMA ON FORM @iez@er
RULE LEMMA ON FORM @lerions@er
RULE LEMMA ON FORM @terions@er
RULE LEMMA ON FORM @ais@ir
RULE LEMMA ON FORM @¨res@©rer
RULE LEMMA ON FORM @ues@ir
RULE LEMMA ON FORM @ait@ir
RULE LEMMA ON FORM @assions@er
RULE LEMMA ON FORM @ant@ir
RULE LEMMA ON FORM @ent@ir
RULE LEMMA ON FORM @ons@ir
RULE LEMMA ON FORM @gnez@ndre
RULE LEMMA ON FORM @¨rent@©rer
RULE LEMMA ON FORM @gniez@ndre
RULE LEMMA ON FORM @gnons@ndre
RULE LEMMA ON FORM @ierai@yer
RULE LEMMA ON FORM @ie@yer
RULE LEMMA ON FORM @rices@eur
RULE LEMMA ON FORM @ieras@yer
RULE LEMMA ON FORM @iens@enir
RULE LEMMA ON FORM @i@e
RULE LEMMA ON FORM @ate@te
RULE LEMMA ON FORM @l'on@on
RULE LEMMA ON FORM @ient@enir
FQB/morpho/morpho.as
+ 3243
− 126
View file @ 17fce072
This diff is collapsed.
FQB/parser/parser.as
+ 325
− 29
View file @ 17fce072
SHIFT
Default : SHIFT
REDUCE
EOS
LEFT abbrev
LEFT aff
LEFT a_obj
LEFT a_obj:a_obj
LEFT a_obj:a_obj|D:suj:suj
LEFT arg
LEFT ato
LEFT ats
LEFT aux_caus
LEFT aux_pass
LEFT aux_tps
LEFT comp
LEFT ato:ato
LEFT ats:ato
LEFT ats:ats
LEFT ats:ats|D:obj:obj
LEFT ats:ats|D:suj:obj
LEFT ats:ats|D:suj:obj|D:suj:suj
LEFT ats:ats|D:suj:suj
LEFT ats:ats|D:suj:suj|D:arg
LEFT ats:ats|D:suj:suj|D:obj:obj
LEFT ats:ats|D:suj:suj|D:suj:suj
LEFT ats:ats|D:suj:suj|D:suj:suj|D:obj:obj
LEFT ats:ats|D:suj:suj|D:suj:suj|D:suj:suj
LEFT coord
LEFT de_obj
LEFT de_obj:de_obj|D:suj:suj
LEFT dep
LEFT dep_coord
LEFT dep.coord
LEFT dep.coord|D:suj:suj
LEFT dep|D:dep
LEFT det
LEFT missinghead
LEFT mod
LEFT mod_rel
LEFT obj
LEFT mod.cleft
LEFT mod.dloc
LEFT mod|D:mod
LEFT mod|D:suj:suj
LEFT mod.loc
LEFT mod.loc|D:mod.loc
LEFT mod.rel
LEFT obj.cpl
LEFT obj:obj
LEFT obj:obj|D:dep.de
LEFT obj:obj|D:obj:obj
LEFT obj:obj|D:obj.p
LEFT obj:obj|D:suj:obj
LEFT obj:obj|D:suj:obj|D:suj:obj
LEFT obj:obj|D:suj:suj
LEFT obj:obj|D:suj:suj|D:obj.p|D:p_obj.agt:suj
LEFT obj:obj|D:suj:suj|D:suj:suj
LEFT obj:obj|D:suj:suj|D:suj:suj|D:obj:obj
LEFT obj:obj|D:suj:suj|D:suj:suj|D:suj:suj
LEFT obj:obj|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:obj
LEFT obj.p
LEFT obj.p|D:obj:obj
LEFT obj.p|D:obj.p
LEFT obj.p|D:suj:obj
LEFT obj.p|D:suj:suj
LEFT obj.p|D:suj:suj|D:suj:obj
LEFT obj.p|D:suj:suj|D:suj:suj
LEFT obj.p|D:suj:suj|D:suj:suj|D:suj:suj
LEFT obj:suj
LEFT obj:suj|D:suj:suj
LEFT p_obj
LEFT p_obj.loc
LEFT p_obj.o
LEFT ponct
LEFT suj
RIGHT abbrev
RIGHT aff
RIGHT a_obj
LEFT root
LEFT root|D:suj:suj|D:suj:suj
LEFT S:aff
LEFT S:a_obj:a_obj
LEFT S:a_obj:a_obj|I:a_obj:a_obj
LEFT S:ats:ats
LEFT S:aux.caus
LEFT S:aux.pass
LEFT S:aux.tps
LEFT S:coord|D:coord
LEFT S:de_obj:de_obj
LEFT S:dep
LEFT S:dep.coord
LEFT S:dep|I:arg.comp
LEFT S:dep|I:dep
LEFT S:det
LEFT S:det|D:dep.de
LEFT S:dis:dis
LEFT S:dis:suj
LEFT S:mod
LEFT S:mod:ambiguous|D:det
LEFT S:mod|D:det
LEFT S:mod|D:mod.comp
LEFT S:mod|D:mod.comp|D:mod.super
LEFT S:mod|D:mod.super
LEFT S:mod.loc
LEFT S:obj.cpl|D:arg.comp
LEFT S:obj.cpl|D:arg.comp|D:suj:obj
LEFT S:obj.cpl|D:arg.comp|D:suj:suj
LEFT S:obj.cpl|D:ats:ats
LEFT S:obj.cpl|D:dep.coord
LEFT S:obj.cpl|D:dis:dis
LEFT S:obj.cpl|D:dis:suj
LEFT S:obj.cpl|D:dis:suj|D:suj:obj
LEFT S:obj.cpl|D:dis:suj|D:suj:suj
LEFT S:obj.cpl|D:mod
LEFT S:obj.cpl|D:obj:obj
LEFT S:obj.cpl|D:obj.p
LEFT S:obj:obj
LEFT S:obj.p
LEFT S:obj.p|D:a_obj:a_obj
LEFT S:obj.p|D:a_obj:a_obj|D:a_obj:a_obj
LEFT S:obj.p|D:a_obj:a_obj|D:suj:suj
LEFT S:obj.p|D:de_obj:de_obj
LEFT S:obj.p|D:de_obj:de_obj|D:suj:suj
LEFT S:obj.p|D:de_obj:de_obj|D:suj:suj|D:suj:suj
LEFT S:obj.p|D:dep.coord
LEFT S:obj.p|D:dep.coord|D:suj:suj
LEFT S:obj.p|D:dep.de
LEFT S:obj.p|D:dep.de|D:dep.de
LEFT S:obj.p|D:dep.de|D:mod.loc
LEFT S:obj.p|D:dep.de|D:obj:obj
LEFT S:obj.p|D:dep.de|D:obj.p
LEFT S:obj.p|D:dep.de|D:suj:obj
LEFT S:obj.p|D:dep.de|D:suj:suj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:obj.p
LEFT S:obj.p|D:dep.de|D:suj:suj|D:obj.p|D:dep.de
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:obj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:obj|D:suj:suj|D:suj:suj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:obj:obj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:suj:obj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:suj:suj
LEFT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:suj
LEFT S:obj.p|D:dis:suj
LEFT S:obj.p|D:obj:obj
LEFT S:obj.p|D:obj:suj|D:suj:suj
LEFT S:obj.p|D:p_obj.agt:suj
LEFT S:obj.p|D:p_obj.agt:suj|D:suj:obj
LEFT S:obj.p|D:p_obj.agt:suj|D:suj:suj
LEFT S:obj.p|D:p_obj.dloc
LEFT S:obj.p|D:suj:suj|D:a_obj:a_obj
LEFT S:obj.p|D:suj:suj|D:dep.de
LEFT S:obj.p|I:p_obj.agt:suj
LEFT S:obj:suj|I:suj:suj
LEFT S:p_obj.agt:suj
LEFT S:p_obj.dloc
LEFT S:suj:_
LEFT S:suj:obj
LEFT S:suj:obj|D:arg
LEFT S:suj:obj|S:suj:obj
LEFT S:suj:obj|S:suj:suj
LEFT S:suj:suj
LEFT S:suj:suj|D:arg
LEFT S:suj:suj|D:suj:suj
LEFT S:suj:suj|I:arg
LEFT S:suj:suj|I:suj:suj
LEFT S:suj:suj|S:suj:obj
LEFT S:suj:suj|S:suj:suj
LEFT suj:argc
LEFT suj:obj
LEFT suj:obj|D:arg
LEFT suj:obj|D:suj:obj
LEFT suj:obj|D:suj:suj
LEFT suj:obj|D:suj:suj|D:suj:suj
LEFT suj:obj|D:suj:suj|D:suj:suj|D:suj:suj
LEFT suj:suj
LEFT suj:suj|D:arg
LEFT suj:suj|D:obj:obj|D:suj:suj
LEFT suj:suj|D:suj:argc
LEFT suj:suj|D:suj:obj
LEFT suj:suj|D:suj:suj
LEFT suj:suj|D:suj:suj|D:mod
LEFT suj:suj|D:suj:suj|D:obj.p
LEFT suj:suj|D:suj:suj|D:suj:obj
LEFT suj:suj|D:suj:suj|D:suj:obj|D:suj:suj
LEFT suj:suj|D:suj:suj|D:suj:suj
LEFT suj:suj|D:suj:suj|D:suj:suj|D:obj:obj
LEFT suj:suj|D:suj:suj|D:suj:suj|D:suj:obj
LEFT suj:suj|D:suj:suj|D:suj:suj|D:suj:suj
LEFT suj:suj|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT a_obj:a_obj
RIGHT a_obj:a_obj|D:suj:suj
RIGHT arg
RIGHT ato
RIGHT ats
RIGHT aux_caus
RIGHT aux_pass
RIGHT aux_tps
RIGHT comp
RIGHT ato:ato
RIGHT ats:ato
RIGHT ats:ats
RIGHT ats:ats|D:obj:obj
RIGHT ats:ats|D:suj:obj
RIGHT ats:ats|D:suj:obj|D:suj:suj
RIGHT ats:ats|D:suj:suj
RIGHT ats:ats|D:suj:suj|D:arg
RIGHT ats:ats|D:suj:suj|D:obj:obj
RIGHT ats:ats|D:suj:suj|D:suj:suj
RIGHT ats:ats|D:suj:suj|D:suj:suj|D:obj:obj
RIGHT ats:ats|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT coord
RIGHT de_obj
RIGHT de_obj:de_obj|D:suj:suj
RIGHT dep
RIGHT dep_coord
RIGHT dep.coord
RIGHT dep.coord|D:suj:suj
RIGHT dep|D:dep
RIGHT det
RIGHT missinghead
RIGHT mod
RIGHT mod_rel
RIGHT obj
RIGHT mod.cleft
RIGHT mod.dloc
RIGHT mod|D:mod
RIGHT mod|D:suj:suj
RIGHT mod.loc
RIGHT mod.loc|D:mod.loc
RIGHT mod.rel
RIGHT obj.cpl
RIGHT obj:obj
RIGHT obj:obj|D:dep.de
RIGHT obj:obj|D:obj:obj
RIGHT obj:obj|D:obj.p
RIGHT obj:obj|D:suj:obj
RIGHT obj:obj|D:suj:obj|D:suj:obj
RIGHT obj:obj|D:suj:suj
RIGHT obj:obj|D:suj:suj|D:obj.p|D:p_obj.agt:suj
RIGHT obj:obj|D:suj:suj|D:suj:suj
RIGHT obj:obj|D:suj:suj|D:suj:suj|D:obj:obj
RIGHT obj:obj|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT obj:obj|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:obj
RIGHT obj.p
RIGHT obj.p|D:obj:obj
RIGHT obj.p|D:obj.p
RIGHT obj.p|D:suj:obj
RIGHT obj.p|D:suj:suj
RIGHT obj.p|D:suj:suj|D:suj:obj
RIGHT obj.p|D:suj:suj|D:suj:suj
RIGHT obj.p|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT obj:suj
RIGHT obj:suj|D:suj:suj
RIGHT p_obj
RIGHT p_obj.loc
RIGHT p_obj.o
RIGHT ponct
RIGHT suj
RIGHT root
RIGHT root|D:suj:suj|D:suj:suj
RIGHT S:aff
RIGHT S:a_obj:a_obj
RIGHT S:a_obj:a_obj|I:a_obj:a_obj
RIGHT S:ats:ats
RIGHT S:aux.caus
RIGHT S:aux.pass
RIGHT S:aux.tps
RIGHT S:coord|D:coord
RIGHT S:de_obj:de_obj
RIGHT S:dep
RIGHT S:dep.coord
RIGHT S:dep|I:arg.comp
RIGHT S:dep|I:dep
RIGHT S:det
RIGHT S:det|D:dep.de
RIGHT S:dis:dis
RIGHT S:dis:suj
RIGHT S:mod
RIGHT S:mod:ambiguous|D:det
RIGHT S:mod|D:det
RIGHT S:mod|D:mod.comp
RIGHT S:mod|D:mod.comp|D:mod.super
RIGHT S:mod|D:mod.super
RIGHT S:mod.loc
RIGHT S:obj.cpl|D:arg.comp
RIGHT S:obj.cpl|D:arg.comp|D:suj:obj
RIGHT S:obj.cpl|D:arg.comp|D:suj:suj
RIGHT S:obj.cpl|D:ats:ats
RIGHT S:obj.cpl|D:dep.coord
RIGHT S:obj.cpl|D:dis:dis
RIGHT S:obj.cpl|D:dis:suj
RIGHT S:obj.cpl|D:dis:suj|D:suj:obj
RIGHT S:obj.cpl|D:dis:suj|D:suj:suj
RIGHT S:obj.cpl|D:mod
RIGHT S:obj.cpl|D:obj:obj
RIGHT S:obj.cpl|D:obj.p
RIGHT S:obj:obj
RIGHT S:obj.p
RIGHT S:obj.p|D:a_obj:a_obj
RIGHT S:obj.p|D:a_obj:a_obj|D:a_obj:a_obj
RIGHT S:obj.p|D:a_obj:a_obj|D:suj:suj
RIGHT S:obj.p|D:de_obj:de_obj
RIGHT S:obj.p|D:de_obj:de_obj|D:suj:suj
RIGHT S:obj.p|D:de_obj:de_obj|D:suj:suj|D:suj:suj
RIGHT S:obj.p|D:dep.coord
RIGHT S:obj.p|D:dep.coord|D:suj:suj
RIGHT S:obj.p|D:dep.de
RIGHT S:obj.p|D:dep.de|D:dep.de
RIGHT S:obj.p|D:dep.de|D:mod.loc
RIGHT S:obj.p|D:dep.de|D:obj:obj
RIGHT S:obj.p|D:dep.de|D:obj.p
RIGHT S:obj.p|D:dep.de|D:suj:obj
RIGHT S:obj.p|D:dep.de|D:suj:suj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:obj.p
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:obj.p|D:dep.de
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:obj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:obj|D:suj:suj|D:suj:suj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:obj:obj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:suj:obj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT S:obj.p|D:dep.de|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT S:obj.p|D:dis:suj
RIGHT S:obj.p|D:obj:obj
RIGHT S:obj.p|D:obj:suj|D:suj:suj
RIGHT S:obj.p|D:p_obj.agt:suj
RIGHT S:obj.p|D:p_obj.agt:suj|D:suj:obj
RIGHT S:obj.p|D:p_obj.agt:suj|D:suj:suj
RIGHT S:obj.p|D:p_obj.dloc
RIGHT S:obj.p|D:suj:suj|D:a_obj:a_obj
RIGHT S:obj.p|D:suj:suj|D:dep.de
RIGHT S:obj.p|I:p_obj.agt:suj
RIGHT S:obj:suj|I:suj:suj
RIGHT S:p_obj.agt:suj
RIGHT S:p_obj.dloc
RIGHT S:suj:_
RIGHT S:suj:obj
RIGHT S:suj:obj|D:arg
RIGHT S:suj:obj|S:suj:obj
RIGHT S:suj:obj|S:suj:suj
RIGHT S:suj:suj
RIGHT S:suj:suj|D:arg
RIGHT S:suj:suj|D:suj:suj
RIGHT S:suj:suj|I:arg
RIGHT S:suj:suj|I:suj:suj
RIGHT S:suj:suj|S:suj:obj
RIGHT S:suj:suj|S:suj:suj
RIGHT suj:argc
RIGHT suj:obj
RIGHT suj:obj|D:arg
RIGHT suj:obj|D:suj:obj
RIGHT suj:obj|D:suj:suj
RIGHT suj:obj|D:suj:suj|D:suj:suj
RIGHT suj:obj|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT suj:suj
RIGHT suj:suj|D:arg
RIGHT suj:suj|D:obj:obj|D:suj:suj
RIGHT suj:suj|D:suj:argc
RIGHT suj:suj|D:suj:obj
RIGHT suj:suj|D:suj:suj
RIGHT suj:suj|D:suj:suj|D:mod
RIGHT suj:suj|D:suj:suj|D:obj.p
RIGHT suj:suj|D:suj:suj|D:suj:obj
RIGHT suj:suj|D:suj:suj|D:suj:obj|D:suj:suj
RIGHT suj:suj|D:suj:suj|D:suj:suj
RIGHT suj:suj|D:suj:suj|D:suj:suj|D:obj:obj
RIGHT suj:suj|D:suj:suj|D:suj:suj|D:suj:obj
RIGHT suj:suj|D:suj:suj|D:suj:suj|D:suj:suj
RIGHT suj:suj|D:suj:suj|D:suj:suj|D:suj:suj|D:suj:suj
FQB/tagger/tagger.as
+ 14
− 25
View file @ 17fce072
WRITE b.0 POS adj
WRITE b.0 POS adv
WRITE b.0 POS advneg
WRITE b.0 POS cln
WRITE b.0 POS clo
WRITE b.0 POS clr
WRITE b.0 POS coo
WRITE b.0 POS csu
WRITE b.0 POS det
WRITE b.0 POS etr
WRITE b.0 POS nc
WRITE b.0 POS np
WRITE b.0 POS poncts
WRITE b.0 POS ponctw
WRITE b.0 POS pref
WRITE b.0 POS prep
WRITE b.0 POS pres
WRITE b.0 POS pri
WRITE b.0 POS pro
WRITE b.0 POS prorel
WRITE b.0 POS titre
WRITE b.0 POS v
WRITE b.0 POS vinf
WRITE b.0 POS vppart
WRITE b.0 POS vprespart
WRITE b.0 POS A
WRITE b.0 POS ADV
WRITE b.0 POS C
WRITE b.0 POS CL
WRITE b.0 POS D
WRITE b.0 POS ET
WRITE b.0 POS I
WRITE b.0 POS N
WRITE b.0 POS P
WRITE b.0 POS P+D
WRITE b.0 POS PONCT
WRITE b.0 POS PREF
WRITE b.0 POS PRO
WRITE b.0 POS V
FQB/tagparser/lemmatizer_lookup.cla
+ 1
− 1
View file @ 17fce072
Name : Lemmatizer_Lookup
Type : Information
Oracle : lemma_lookup
Oracle Filename : ../../data/fplm
Oracle Filename : ../../data/maca_trans_lemmatizer_exceptions.fplm
FQB/tagparser/lemmatizer_rules.as
+ 21
− 0
View file @ 17fce072
Default : RULE LEMMA ON FORM @@
RULE LEMMA ON FORM @e@
RULE LEMMA ON FORM @s@
RULE LEMMA ON FORM @x@
RULE LEMMA ON FORM @@r
RULE LEMMA ON FORM @le@
RULE LEMMA ON FORM @ne@
RULE LEMMA ON FORM @es@
RULE LEMMA ON FORM @'@e
RULE LEMMA ON FORM @u@e
RULE LEMMA ON FORM @@re
RULE LEMMA ON FORM @ux@l
RULE LEMMA ON FORM @nt@r
RULE LEMMA ON FORM @t@re
RULE LEMMA ON FORM @se@x
RULE LEMMA ON FORM @u@re
RULE LEMMA ON FORM @a@er
RULE LEMMA ON FORM @u@ir
RULE LEMMA ON FORM @ère@er
RULE LEMMA ON FORM @ées@er
RULE LEMMA ON FORM @é@er
RULE LEMMA ON FORM @ée@er
RULE LEMMA ON FORM @és@er
RULE LEMMA ON FORM @ait@er
RULE LEMMA ON FORM @ant@er
RULE LEMMA ON FORM @ient@enir
FQB/tagparser/morpho.as
+ 105
− 3179
View file @ 17fce072
This diff is collapsed.
data/FQB/FQB.v1.Deep.conll-like.dev
+ 471
− 471
View file @ 17fce072
This diff is collapsed.
data/FQB/FQB.v1.Deep.conll-like.test
+ 662
− 662
View file @ 17fce072
This diff is collapsed.
data/FQB/FQB.v1.Deep.conll-like.train
+ 4713
− 4713
View file @ 17fce072
This diff is collapsed.
data/FQB/removeUselessMorpho.py 0 → 100755
+ 42
− 0
View file @ 17fce072
#! /usr/bin/python3
import sys
import re
def printUsageAndExit() :
print("Usage : "+sys.argv[0]+" input")
exit(1)
def removeUselessTags(filename) :
lines = []
for fetch in open(filename, "r", encoding="UTF-8") :
col = 5
split = fetch.split('\t')
if len(split) > 2 :
line = split[col]
line = re.sub(r'sentid=([^\|]+)', '_', line)
line = re.sub(r'dl=([^\|]+)', '_', line)
line = re.sub(r'fctpath=([^\|]+)', '_', line)
for i in range(4) :
line = re.sub(r'\|\|', '|', line)
line = re.sub(r'^\|', '', line)
line = re.sub(r'^_', '', line)
if len(line) > 0 and (line[-1] == '_' or line[-1] == '|') :
line = line[:-1]
if len(line) == 0 :
line = "_"
split[col] = line
lines.append(split)
f = open(filename, "w", encoding="UTF-8")
for line in lines :
print(*line,file=f,end="",sep="\t")
############################################################################
if len(sys.argv) < 2 :
printUsageAndExit()
for i in range(1,len(sys.argv)) :
removeUselessTags(sys.argv[i])
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment