Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
external:spr [2011/10/21 14:32] smejkalova |
external:spr [2012/01/19 10:47] smejkalova |
||
---|---|---|---|
Line 5: | Line 5: | ||
===== People and contacts ===== | ===== People and contacts ===== | ||
- | * Silvie Cinková cinkova@ufal.mff.cuni.cz | + | * Silvie Cinková <cinkova (at) ufal.mff.cuni.cz> |
- | * Martin Holub holub@ufal.mff.cuni.cz | + | * Martin Holub <holub (at) ufal.mff.cuni.cz> |
- | * Lenka Smejkalová smejkalova@ufal.mff.cuni.cz | + | * Lenka Smejkalová <smejkalova (at) ufal.mff.cuni.cz> |
- | * Vincent Kríž vincent.kriz@gmail.com | + | * Vincent Kríž <vincent.kriz (at) gmail.com> |
Institute of Formal and Applied Linguistics | Institute of Formal and Applied Linguistics | ||
Line 16: | Line 16: | ||
Malostranské náměstí 25 | Malostranské náměstí 25 | ||
CZ-118 00 Praha | CZ-118 00 Praha | ||
+ | |||
+ | |||
+ | |||
Line 22: | Line 25: | ||
"CPA Verb Validation Sample 30 (En)" is a newly developed lexical resource. It contains descriptions of the following 30 English verbs: | "CPA Verb Validation Sample 30 (En)" is a newly developed lexical resource. It contains descriptions of the following 30 English verbs: | ||
+ | |//access // |//ally// |//arrive// |//breathe// |//claim// | | ||
+ | |//cool// |//cry// |//crush// |//deny// |//enlarge// | | ||
+ | |//enlist// |//forge// |//furnish// |//hail// |//halt// | | ||
+ | |//part// |//plug// |//plough// |//pour// |//say// | | ||
+ | |//smash// |//smell// |//steer// |//submit// |//swell// | | ||
+ | |//tell// | //throw// |//trouble// |//wake// |//yield// | | ||
+ | |||
+ | |||
+ | |||
+ | Here we present a small portion of the data just to illustrate its structure. For each verb we define a set of semantic patterns and provide a sample of manually annotated corpus concordances. Then we do a detailed interannotator disagreement analysis, error detection, and adjudication. | ||
- | |//access // |//ally// |//analyse// |//arrive// |//breathe// | | ||
- | |//claim// |//cool// |//cry// |//crush// |//deny// | | ||
- | |//enlarge// |//enlist// |forge |frighten |furnish | | ||
- | |hail |halt |part |plug |plough | | ||
- | |pour |smash |smell |steer |submit | | ||
- | |swell | throw |trouble |wake |yield | | ||
- | Here we present a small portion of the data just to show its structure. For each verb we define a set of semantic patterns and provide a sample of manually annotated corpus concordances. Then we do a detailed interannotator disagreement analysis, error detection and adjudication. | ||
Line 40: | Line 46: | ||
- | ==== Pattern Definitions Preview ==== | ||
- | Pattern definitions - we have revised the pattern definitions for 30 verbs. Here is the sample of three of them (after revision): | + | |
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | ==== Pattern Definitions Preview ==== | ||
+ | A few examples of revised PDEV entries: | ||
* [[http://ufal.mff.cuni.cz/~smejkalova/pdev/cool_patterns.html|cool]] | * [[http://ufal.mff.cuni.cz/~smejkalova/pdev/cool_patterns.html|cool]] | ||
- | * [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_patterns.html|deny]] - detailed [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_7.png|view]] of pattern number 7 | + | * [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_patterns.html|deny]] |
* [[http://ufal.mff.cuni.cz/~smejkalova/pdev/yield_patterns.html|yield]] | * [[http://ufal.mff.cuni.cz/~smejkalova/pdev/yield_patterns.html|yield]] | ||
+ | |||
+ | An example of a pattern definition form in detail: | ||
+ | * [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_7.png|deny - pattern number 7]] | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
==== Annotated Data Preview ==== | ==== Annotated Data Preview ==== | ||
- | Annotation of 50 concordances per each of these verbs by three annotators. Here is a little sample of three verbs. There has been already finished the manual disagreements analysis and all instances were adjudicated and gold sample was created. Manual disagreements analysis and adjudication: | + | Each of the examples below contains a multiple annotated set of 50 corpus concordances with manual disagreement analysis and final adjudication. The adjudicated data are used as a gold standard sample. |
* cool - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/cool_analysis.pdf|pdf]] | * cool - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/cool_analysis.pdf|pdf]] | ||
* deny - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_analysis.pdf|pdf]] | * deny - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_analysis.pdf|pdf]] | ||
Line 56: | Line 77: | ||
- | ==== Disagreement Analysis Preview ==== | ||
- | Automatic disagreements analysis - confusion matrix for each pair of the annotators in one file | + | |
+ | |||
+ | |||
+ | ==== Disagreement Analysis Preview ==== | ||
+ | Confusion matrices for each pair of annotators and automatic disagreements analysis: | ||
* cool - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/cool_res.txt|txt]] | * cool - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/cool_res.txt|txt]] | ||
* deny - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_res.txt|txt]] | * deny - [[http://ufal.mff.cuni.cz/~smejkalova/pdev/deny_res.txt|txt]] | ||
Line 68: | Line 92: | ||
- | |||
- | TODO: ne odlisna barva pozadi a rozsirit chlivky a kurziva (v tabulce sloves) + vycentrovat na strance | ||
- | TODO: zkontrolovat obsah souboru (specifikace formulare) | ||