[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
draft [2009/07/15 15:14]
ptacek
draft [2009/07/15 15:39]
ptacek
Line 35: Line 35:
 features: omit filler phrases, remove irrelevant speech events, handle false starts, repetitions, and corrections, polish word ordering features: omit filler phrases, remove irrelevant speech events, handle false starts, repetitions, and corrections, polish word ordering
 performance indicator: BLEU score between actual output and manually reconstructed sentences from corpora (T5.2.1), baseline: Moses with default settings performance indicator: BLEU score between actual output and manually reconstructed sentences from corpora (T5.2.1), baseline: Moses with default settings
 +
  
  
Line 41: Line 42:
  
 ===== Morphology Analyzer and POS tagging (WP 5.2) ===== ===== Morphology Analyzer and POS tagging (WP 5.2) =====
-features: coverage of photo-pal domain, domain adapted tagger PRIDA NAM JARKA SLOVA CO NAJDEME?JEN V PRIPADE RUCNI ANOTACE COMPANIONS-PDTSC DO LISTOPADU+features: coverage of photo-pal domain, domain adapted tagger (XXX prida nam Jarka OOV slova co najdemebude PDTSC rucne oznackovane do listopadu?)
 performance indicator: OOV rate, accuracy performance indicator: OOV rate, accuracy
 +
  
 ===== Syntactic Parsing (WP 5.2) ===== ===== Syntactic Parsing (WP 5.2) =====
 features: induce dependencies and labels features: induce dependencies and labels
-performance indicator: f-measure+performance indicator: accuracy (correctly induced edges, labels)
 v tipu je natrenovat MacDonnalda na dialog datech, ten task je do M42, ted ne. v tipu je natrenovat MacDonnalda na dialog datech, ten task je do M42, ted ne.
 +
 +
  
  
  
 ===== Semantic Parsing (WP 5.2) ===== ===== Semantic Parsing (WP 5.2) =====
-features: meaning representation with semantic roles (69 roles), coordinations, argument structure, partial ellipsis resolution, pronominal anaphora resolution, +features: assignment of semantic roles (69 roles), coordinations, argument structure, partial ellipsis resolution, pronominal anaphora resolution, post parsing detection of ungrammatical edges (caused by long utterances) 
-performance indicator: f-measure+performance indicator: accuracy (correctly induced edges, labels) 
  
 ===== Information Extraction (WP 5.2) ===== ===== Information Extraction (WP 5.2) =====
Line 59: Line 63:
 covering predicates from  before-mentioned set of DAFs. covering predicates from  before-mentioned set of DAFs.
 performance indicator: accuracy performance indicator: accuracy
 +
  
  
 ===== Named Entities Recognition (WP 5.2) ===== ===== Named Entities Recognition (WP 5.2) =====
-features: detect person names, geographical locations (organizations myslim nepotrebne)+features: detect person names, geographical locationsorganizations
 performance indicator: f-measure performance indicator: f-measure
 +
 +
 +
  
 ===== Dialog Act Tagging (WP 5.2) ===== ===== Dialog Act Tagging (WP 5.2) =====
-features: tagset derived from DAMSL-SWBD, DA is a key feature driving the decision, what to say next.+features: domain tailored tagset (variation of DAMSL-SWBD)
 performance indicator: accuracy performance indicator: accuracy
  
Line 79: Line 87:
  
  
-===== Complete System Evaluation ===== 
-T5.2.7 tohle zminuje, nick webb to pro nas asi neudela 
-performance indicator: number of tokens in user reply utterances, post-session questionare 
  
  
Line 90: Line 95:
 Handmade DAF covering following topics: Person_Retired, Person_in_productive_age, Child, Husband, Wife, Wedding, Christmas, Handle_stalled_dialog Handmade DAF covering following topics: Person_Retired, Person_in_productive_age, Child, Husband, Wife, Wedding, Christmas, Handle_stalled_dialog
 performance indicator: rucni hodnoceni prijatelnosti vybrane akce performance indicator: rucni hodnoceni prijatelnosti vybrane akce
 +
 +
 +AZ PO LISTOPADU:
 +===== Complete System Evaluation =====
 +T5.2.7 tohle zminuje, nick webb to pro nas asi neudela
 +performance indicator: number of tokens in user reply utterances, post-session questionare
 +
 +
 +
 +
  
 ===== Natural Language Generation (WP 5.4) ===== ===== Natural Language Generation (WP 5.4) =====
 features: variations, underspecified input (dott format), emotional markup (natvrdo v dafech a templatech u hodnoticich vet) features: variations, underspecified input (dott format), emotional markup (natvrdo v dafech a templatech u hodnoticich vet)
 performance indicator: BLEU score performance indicator: BLEU score

[ Back to the navigation ] [ Back to the content ]