Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
draft [2009/08/06 17:33] ptacek |
draft [2009/08/31 14:28] ptacek |
||
---|---|---|---|
Line 11: | Line 11: | ||
Our DAFs covering selected topics contain not only Companion replies mined from the corpora, but also new human-authored assessments, | Our DAFs covering selected topics contain not only Companion replies mined from the corpora, but also new human-authored assessments, | ||
+ | |||
+ | For a sample dialogue, see the Scenario Brief below. | ||
{{user: | {{user: | ||
Line 17: | Line 19: | ||
===== Automatic Speech Recognition (WP 5.1)===== | ===== Automatic Speech Recognition (WP 5.1)===== | ||
features: improved language models, real-time speaker adaptation | features: improved language models, real-time speaker adaptation | ||
- | performance indicator: WER | + | performance indicator: WER |
- | + | ||
Line 26: | Line 26: | ||
===== Speech Reconstruction (WP 5.2) ===== | ===== Speech Reconstruction (WP 5.2) ===== | ||
- | features: omit filler phrases, remove irrelevant speech events, handle false starts, repetitions, | + | features: omit filler phrases, remove irrelevant speech events, handle false starts, repetitions, |
- | performance indicator: BLEU score between actual output and manually reconstructed sentences from corpora (T5.2.1), baseline: Moses with default settings | + | |
Line 38: | Line 37: | ||
===== Morphology Analyzer and POS tagging (WP 5.2) ===== | ===== Morphology Analyzer and POS tagging (WP 5.2) ===== | ||
features: coverage of photo-pal domain, domain adapted tagger | features: coverage of photo-pal domain, domain adapted tagger | ||
- | performance indicator: OOV rate, accuracy | + | performance indicator: OOV rate, accuracy |
Line 53: | Line 52: | ||
===== Semantic Parsing (WP 5.2) ===== | ===== Semantic Parsing (WP 5.2) ===== | ||
features: assignment of semantic roles (69 roles), coordinations, | features: assignment of semantic roles (69 roles), coordinations, | ||
- | performance indicator: accuracy (correctly induced edges, labels) | + | performance indicator: accuracy (correctly induced edges, labels) |
===== Information Extraction (WP 5.2) ===== | ===== Information Extraction (WP 5.2) ===== | ||
Line 85: | Line 85: | ||
manual creation of DAFs covering following topics: Person_retired, | manual creation of DAFs covering following topics: Person_retired, | ||
performance indicator: acceptability - manual evaluation of actions selected by DM | performance indicator: acceptability - manual evaluation of actions selected by DM | ||
+ | |||
Line 92: | Line 93: | ||
===== Natural Language Generation (WP 5.4) ===== | ===== Natural Language Generation (WP 5.4) ===== | ||
- | features: adding of functional words, morphological adjustments, | + | features: adding of functional words, morphological adjustments, |
performance indicator: BLEU score | performance indicator: BLEU score | ||