Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
draft [2009/08/06 17:32] ptacek |
draft [2009/08/31 14:28] ptacek |
||
---|---|---|---|
Line 11: | Line 11: | ||
Our DAFs covering selected topics contain not only Companion replies mined from the corpora, but also new human-authored assessments, | Our DAFs covering selected topics contain not only Companion replies mined from the corpora, but also new human-authored assessments, | ||
+ | |||
+ | For a sample dialogue, see the Scenario Brief below. | ||
{{user: | {{user: | ||
Line 17: | Line 19: | ||
===== Automatic Speech Recognition (WP 5.1)===== | ===== Automatic Speech Recognition (WP 5.1)===== | ||
features: improved language models, real-time speaker adaptation | features: improved language models, real-time speaker adaptation | ||
- | performance indicator: WER | + | performance indicator: WER |
- | + | ||
Line 26: | Line 26: | ||
===== Speech Reconstruction (WP 5.2) ===== | ===== Speech Reconstruction (WP 5.2) ===== | ||
- | features: omit filler phrases, remove irrelevant speech events, handle false starts, repetitions, | + | features: omit filler phrases, remove irrelevant speech events, handle false starts, repetitions, |
- | performance indicator: BLEU score between actual output and manually reconstructed sentences from corpora (T5.2.1), baseline: Moses with default settings | + | |
Line 38: | Line 37: | ||
===== Morphology Analyzer and POS tagging (WP 5.2) ===== | ===== Morphology Analyzer and POS tagging (WP 5.2) ===== | ||
features: coverage of photo-pal domain, domain adapted tagger | features: coverage of photo-pal domain, domain adapted tagger | ||
- | performance indicator: OOV rate, accuracy | + | performance indicator: OOV rate, accuracy |
Line 53: | Line 52: | ||
===== Semantic Parsing (WP 5.2) ===== | ===== Semantic Parsing (WP 5.2) ===== | ||
features: assignment of semantic roles (69 roles), coordinations, | features: assignment of semantic roles (69 roles), coordinations, | ||
- | performance indicator: accuracy (correctly induced edges, labels) | + | performance indicator: accuracy (correctly induced edges, labels) |
===== Information Extraction (WP 5.2) ===== | ===== Information Extraction (WP 5.2) ===== | ||
Line 85: | Line 85: | ||
manual creation of DAFs covering following topics: Person_retired, | manual creation of DAFs covering following topics: Person_retired, | ||
performance indicator: acceptability - manual evaluation of actions selected by DM | performance indicator: acceptability - manual evaluation of actions selected by DM | ||
+ | |||
Line 92: | Line 93: | ||
===== Natural Language Generation (WP 5.4) ===== | ===== Natural Language Generation (WP 5.4) ===== | ||
- | features: adding of functional words, morphological adjustments, | + | features: adding of functional words, morphological adjustments, |
performance indicator: BLEU score | performance indicator: BLEU score | ||
Line 107: | Line 108: | ||
features: new Czech female voice with affective features will be integrated with the TID avatar | features: new Czech female voice with affective features will be integrated with the TID avatar | ||
performance indicator: subjective evaluation of the naturalness and the ability to convey emotions (small-scale, | performance indicator: subjective evaluation of the naturalness and the ability to convey emotions (small-scale, | ||
+ | |||
====== Scenario Brief ====== | ====== Scenario Brief ====== | ||
- | C1 Dobrý den, jak se jmenujete? intro-daf-based | + | C1 Dobrý den, jak se jmenujete? |
H1 Marie. | H1 Marie. | ||
C2 Těší mě. Já jsem Pavla a chtěla bych Vás blíž poznat. Jsem ráda, že mi ukážete Vaše fotografie. | C2 Těší mě. Já jsem Pavla a chtěla bych Vás blíž poznat. Jsem ráda, že mi ukážete Vaše fotografie. | ||
- | C2 Co je tohle? photo_maintenance | + | C2 Co je tohle? |
H2 To je moje rodina, rodiče, sestra, její manžel, moje dvě děti a její dvě děti. | H2 To je moje rodina, rodiče, sestra, její manžel, moje dvě děti a její dvě děti. | ||
H2 Byli u mě na Vánoce na návštěvě. | H2 Byli u mě na Vánoce na návštěvě. | ||
Line 132: | Line 134: | ||
H5 Teď už to ale není ono. | H5 Teď už to ale není ono. | ||
- | C6 Takže teď trávíte Vánoce sama? ask_on_detail-daf-based | + | C6 Takže teď trávíte Vánoce sama? (ask_on_detail-daf-based) |
- | H6 Nejsem úplně sama, chodím každé Vánoce k dceři, ale už to není, jak to bývalo, když byly doma malé děti. | + | H6 Nejsem úplně sama, chodím každé Vánoce k dceři, ale už to není, jak to bývalo, když byly doma malé děti. |
- | C7 Jak děti vyrostou, tak má člověk najednou příliš mnoho času. | + | C7 Jak děti vyrostou, tak má člověk najednou příliš mnoho času. |
C7 Kdo je kdo na té fotce? | C7 Kdo je kdo na té fotce? | ||
H7 U stromečku je můj synovec, ta holčička vedle je moje dcera, chlapeček s hračkou je můj syn, vedle je sestra, její manžel a nad ním je můj otec. | H7 U stromečku je můj synovec, ta holčička vedle je moje dcera, chlapeček s hračkou je můj syn, vedle je sestra, její manžel a nad ním je můj otec. |