Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
external:addicter [2011/05/16 06:50] mphi |
external:addicter [2011/05/16 07:23] mphi |
||
---|---|---|---|
Line 5: | Line 5: | ||
This page lies in the external name space and is intended for collaboration with people outside of ÚFAL. | This page lies in the external name space and is intended for collaboration with people outside of ÚFAL. | ||
- | ==== Progress, Results | + | ==== Word Alignment -- Progress and Results |
- | === word alignment | + | === Alternative model comparison |
+ | | | ||
+ | | | ||
+ | ^ meteor | ||
+ | ^ ter* |0.106/ | ||
+ | ^ hmm | ||
+ | ^ lcs | ||
+ | ^ gizadiag* |0.183/ | ||
+ | ^ gizainter |0.170/ | ||
+ | ^ berkeley* |0.200/ | ||
- | !!! alternative model comparison | + | === Explicit wrong lex choice detection === |
+ | * align input+czeng to reference+czeng and input+czeng to hypotheses+czeng | ||
+ | * extract hypothesis-to-reference alignments from there | ||
- | || border=1 | + | | |
- | || | + | | |
- | || | + | ^ czengdiag* |
- | || meteor ||0.092/0.251/**0.135** ||0.047/0.229/''' | + | ^ czenginter |
- | || ter* ||0.106/0.387/''' | + | |
- | || hmm ||0.162/ | + | |
- | || lcs ||0.168/0.462/''' | + | |
- | || gizadiag* ||0.183/ | + | |
- | || gizainter ||0.170/ | + | |
- | || berkeley* ||0.200/ | + | |
- | !!! Explicit wrong lex choice detection | + | === Alignment combinations === |
- | * align input+czeng to reference+czeng and input+czeng to hypotheses+czeng | + | via weighed HMM |
- | * extract hypothesis-to-reference alignments from there | + | |
- | || border=1 | + | |
- | || || Precision/ | + | |
- | || || Lex || Order || Punct || Miss || | + | |
- | || czengdiag* ||0.187/ | + | |
- | || czenginter ||0.197/ | + | |
- | * TODO: also try domain adaptation for word alignment, EMNLP 2011 paper | + | |
- | !!! alignment combinations via weighed HMM | + | | ^ Precision/ |
- | || border=1 | + | | ^ Lex ^ Order ^ Punct ^ Miss ^ |
- | || || Precision/ | + | ^ meteor+hmm |
- | || | + | ^ ter+hmm |
- | || meteor+hmm | + | ^ gizadiag+hmm |
- | || ter+hmm | + | ^ gizainter+hmm |
- | || gizadiag+hmm | + | ^ berkeley+hmm |
- | || gizainter+hmm | + | ^ czengdiag+hmm |
- | || berkeley+hmm | + | ^ czenginter+hmm |
- | || czengdiag+hmm | + | | ||||| |
- | || czenginter+hmm | + | ^ berkeley+czenginter+hmm |0.219/ |
- | || |||||||||| | + | ^ berkeley+czenginter+gizainter+hmm |0.220/ |
- | || berkeley+czenginter+hmm | + | ^ berkeley+czenginter+meteor+hmm |0.220/ |
- | || berkeley+czenginter+gizainter+hmm | + | |
- | || berkeley+czenginter+meteor+hmm | + | ==== TODOs ==== |
+ | * test alignment with synonym detection (cz_wn required) = separating | ||
+ | * order evaluation | ||
+ | * a lot of background research | ||
+ | * currently finds misplaced items, but their shift distances are off | ||
+ | * to fix -- for every misplaced token | ||
+ | * if it (and only it) were to be moved in the original permutation, | ||
+ | * evaluate with nr. of intersections | ||
+ | * try domain adaptation for word alignment, EMNLP 2011 paper | ||
+ | * comb and comment the code | ||
+ | * add help files | ||
+ | * integrate with the rest of Addicter | ||
+ | * approach applicable to learner' | ||
+ | * see Anne Lüdelig, TLT9 | ||
+ | * adapt Addicter to Sara's program | ||
+ | * alternative to reference-based evaluation: " | ||
- | !!! TODO | ||
- | * test alignment with synonym detection (cz_wn required) = separating @@lex@@ and @@disam@@ | ||
- | * order evaluation | ||
- | ** a lot of background research | ||
- | ** currently finds misplaced items, but their shift distances are off | ||
- | *** to fix -- for every misplaced token | ||
- | **** if it (and only it) were to be moved in the original permutation, | ||
- | **** evaluate with nr. of intersections | ||
- | * comb and comment the code | ||
- | * add help files | ||
- | * integrate with the rest of Addicter | ||
- | * learner' | ||
- | ** see Anne Lüdelig, TLT9 | ||
- | * adapt to Sara's program | ||
- | * alternative to reference-based evaluation: " |