Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
draft [2009/07/15 14:51] ptacek |
draft [2009/07/15 15:39] ptacek |
||
---|---|---|---|
Line 11: | Line 11: | ||
photopal domena, nahranej korpus, ze na to sou dafy (reusing SHEFF DM intergrated through Inamode Relayer (TID)) vhodny, moreover reusable for expected pomdp DM from UOX (reuse states, let pomdp' | photopal domena, nahranej korpus, ze na to sou dafy (reusing SHEFF DM intergrated through Inamode Relayer (TID)) vhodny, moreover reusable for expected pomdp DM from UOX (reuse states, let pomdp' | ||
- | typy odpovedi a zpusob jejich implementace, | + | typy odpovedi a zpusob jejich implementace, |
NLP server s tectomt, ASR/TTS/SR client, connected over network | NLP server s tectomt, ASR/TTS/SR client, connected over network | ||
XXX JPta | XXX JPta | ||
Line 26: | Line 26: | ||
features: improved language models, real-time speaker adaptation | features: improved language models, real-time speaker adaptation | ||
performance indicator: WER | performance indicator: WER | ||
+ | |||
+ | |||
+ | |||
===== Speech Reconstruction (WP 5.1 ???) ===== | ===== Speech Reconstruction (WP 5.1 ???) ===== | ||
- | features: omit filler phrases, irrelevant speech events, false starts, repetitions, | + | features: omit filler phrases, |
- | imlementation(zahrnout tuhle info?): moses natrenovany na korpusu | + | performance indicator: BLEU score between actual output and manually reconstructed sentences from corpora |
- | performance indicator: BLEU score (overall scoring of all features) to annotated corpora from T5.2.1., nejaka | + | |
- | XXX Mirek | + | |
+ | |||
+ | |||
===== Morphology Analyzer and POS tagging (WP 5.2) ===== | ===== Morphology Analyzer and POS tagging (WP 5.2) ===== | ||
- | features: XXX Mirek/ | + | features: |
- | performance indicator: accuracy | + | performance indicator: |
===== Syntactic Parsing (WP 5.2) ===== | ===== Syntactic Parsing (WP 5.2) ===== | ||
features: induce dependencies and labels | features: induce dependencies and labels | ||
- | performance indicator: | + | performance indicator: |
v tipu je natrenovat MacDonnalda na dialog datech, ten task je do M42, ted ne. | v tipu je natrenovat MacDonnalda na dialog datech, ten task je do M42, ted ne. | ||
+ | |||
+ | |||
===== Semantic Parsing (WP 5.2) ===== | ===== Semantic Parsing (WP 5.2) ===== | ||
- | features: | + | features: |
- | performance indicator: | + | performance indicator: |
===== Information Extraction (WP 5.2) ===== | ===== Information Extraction (WP 5.2) ===== | ||
Line 54: | Line 63: | ||
covering predicates from before-mentioned set of DAFs. | covering predicates from before-mentioned set of DAFs. | ||
performance indicator: accuracy | performance indicator: accuracy | ||
+ | |||
===== Named Entities Recognition (WP 5.2) ===== | ===== Named Entities Recognition (WP 5.2) ===== | ||
- | features: detect person names, geographical locations | + | features: detect person names, geographical locations, organizations |
performance indicator: f-measure | performance indicator: f-measure | ||
+ | |||
+ | |||
+ | |||
===== Dialog Act Tagging (WP 5.2) ===== | ===== Dialog Act Tagging (WP 5.2) ===== | ||
- | features: tagset | + | features: |
performance indicator: accuracy | performance indicator: accuracy | ||
Line 74: | Line 87: | ||
- | ===== Complete System Evaluation ===== | ||
- | T5.2.7 tohle zminuje, nick webb to pro nas asi neudela | ||
- | performance indicator: number of tokens in user reply utterances, post-session questionare | ||
Line 83: | Line 93: | ||
===== Dialog Manager (WP 5.3) ===== | ===== Dialog Manager (WP 5.3) ===== | ||
features: reply types, using (language independed) predicates (prakticky to znamena, ze pojmenuju testy na prechodech v dafech anglicky) | features: reply types, using (language independed) predicates (prakticky to znamena, ze pojmenuju testy na prechodech v dafech anglicky) | ||
+ | Handmade DAF covering following topics: Person_Retired, | ||
performance indicator: rucni hodnoceni prijatelnosti vybrane akce | performance indicator: rucni hodnoceni prijatelnosti vybrane akce | ||
+ | |||
+ | |||
+ | AZ PO LISTOPADU: | ||
+ | ===== Complete System Evaluation ===== | ||
+ | T5.2.7 tohle zminuje, nick webb to pro nas asi neudela | ||
+ | performance indicator: number of tokens in user reply utterances, post-session questionare | ||
+ | |||
+ | |||
+ | |||
+ | |||
===== Natural Language Generation (WP 5.4) ===== | ===== Natural Language Generation (WP 5.4) ===== | ||
features: variations, underspecified input (dott format), emotional markup (natvrdo v dafech a templatech u hodnoticich vet) | features: variations, underspecified input (dott format), emotional markup (natvrdo v dafech a templatech u hodnoticich vet) | ||
performance indicator: BLEU score | performance indicator: BLEU score |