Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
draft [2009/07/15 15:26] ptacek |
draft [2009/07/15 15:46] ptacek |
||
---|---|---|---|
Line 44: | Line 44: | ||
features: coverage of photo-pal domain, domain adapted tagger (XXX prida nam Jarka OOV slova co najdeme, bude PDTSC rucne oznackovane - do listopadu?) | features: coverage of photo-pal domain, domain adapted tagger (XXX prida nam Jarka OOV slova co najdeme, bude PDTSC rucne oznackovane - do listopadu?) | ||
performance indicator: OOV rate, accuracy | performance indicator: OOV rate, accuracy | ||
+ | |||
Line 50: | Line 51: | ||
performance indicator: accuracy (correctly induced edges, labels) | performance indicator: accuracy (correctly induced edges, labels) | ||
v tipu je natrenovat MacDonnalda na dialog datech, ten task je do M42, ted ne. | v tipu je natrenovat MacDonnalda na dialog datech, ten task je do M42, ted ne. | ||
+ | |||
Line 55: | Line 57: | ||
===== Semantic Parsing (WP 5.2) ===== | ===== Semantic Parsing (WP 5.2) ===== | ||
- | features: | + | features: |
- | performance indicator: accuracy | + | performance indicator: accuracy |
===== Information Extraction (WP 5.2) ===== | ===== Information Extraction (WP 5.2) ===== | ||
Line 62: | Line 64: | ||
covering predicates from before-mentioned set of DAFs. | covering predicates from before-mentioned set of DAFs. | ||
performance indicator: accuracy | performance indicator: accuracy | ||
+ | |||
===== Named Entities Recognition (WP 5.2) ===== | ===== Named Entities Recognition (WP 5.2) ===== | ||
- | features: detect person names, geographical locations | + | features: detect person names, geographical locations, organizations |
performance indicator: f-measure | performance indicator: f-measure | ||
- | ===== Dialog Act Tagging (WP 5.2) ===== | ||
- | features: tagset derived from DAMSL-SWBD, DA is a key feature driving the decision, what to say next. | ||
- | performance indicator: accuracy | ||
- | ===== Sentiment Analysis (WP 5.2) ===== | ||
- | features: za tohle bych vydaval klasifikator, | ||
- | performance indicator: f-measure | ||
- | + | ===== Dialog Act Tagging (WP 5.2) ===== | |
- | + | features: domain tailored tagset (variation of DAMSL-SWBD) | |
- | + | performance indicator: | |
- | + | ||
- | + | ||
- | ===== Complete System Evaluation | + | |
- | T5.2.7 tohle zminuje, nick webb to pro nas asi neudela | + | |
- | performance indicator: | + | |
Line 91: | Line 83: | ||
===== Dialog Manager (WP 5.3) ===== | ===== Dialog Manager (WP 5.3) ===== | ||
features: reply types, using (language independed) predicates (prakticky to znamena, ze pojmenuju testy na prechodech v dafech anglicky) | features: reply types, using (language independed) predicates (prakticky to znamena, ze pojmenuju testy na prechodech v dafech anglicky) | ||
- | Handmade DAF covering following topics: Person_Retired, | + | Manually created DAFs covering following topics: Person_Retired, |
performance indicator: rucni hodnoceni prijatelnosti vybrane akce | performance indicator: rucni hodnoceni prijatelnosti vybrane akce | ||
Line 97: | Line 89: | ||
features: variations, underspecified input (dott format), emotional markup (natvrdo v dafech a templatech u hodnoticich vet) | features: variations, underspecified input (dott format), emotional markup (natvrdo v dafech a templatech u hodnoticich vet) | ||
performance indicator: BLEU score | performance indicator: BLEU score | ||
+ | |||
+ | |||
+ | ====== AZ PO LISTOPADU ====== | ||
+ | |||
+ | ===== Syntactic Parsing (WP 5.2) ===== | ||
+ | features: adapted to domain (McD trained on manual PDTSC trees) | ||
+ | performance indicator: accuracy (correctly induced edges, labels) | ||
+ | |||
+ | |||
+ | ===== Sentiment Analysis (WP 5.2) ===== | ||
+ | features: za tohle bych vydaval klasifikator, | ||
+ | performance indicator: f-measure | ||
+ | |||
+ | ===== Complete System Evaluation ===== | ||
+ | T5.2.7 tohle zminuje, nick webb to pro nas asi neudela | ||
+ | performance indicator: number of tokens in user reply utterances, post-session questionare |