[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
user:zeman:treebanks:grc [2011/12/06 15:00]
zeman Inside, sample and parsing.
user:zeman:treebanks:grc [2011/12/06 16:02]
zeman Conversion run newly, empty sentences discarded, both sentence and token counts differ.
Line 36: Line 36:
 ==== Size ==== ==== Size ====
  
-AGDT contains ​309,092 tokens in 21165 sentences, yielding 14.60 tokens per sentence on average. No official training-test data split is defined. For our HamleDT experiments,​ we took the smallest file called ''​1999.01.0015.xml''​ (5949 tokens / 529 sentences; Aeschylus: //​Suppliants//​) for testing and the rest (303,143 tokens / 20636 sentences) for training.+AGDT contains ​308,882 tokens in 21160 non-empty ​sentences, yielding 14.60 tokens per sentence on average. No official training-test data split is defined. For our HamleDT experiments,​ we took the smallest file called ''​1999.01.0015.xml''​ (5925 tokens / 528 sentences; Aeschylus: //​Suppliants//​) for testing and the rest (302,957 tokens / 20632 sentences) for training.
  
 ==== Inside ==== ==== Inside ====
Line 42: Line 42:
 The native file format of the treebank is based on XML. Greek letters are romanized using [[http://​www.tlg.uci.edu/​encoding/​quickbeta.pdf|Beta Code]], a romanization scheme used widely not only in the Perseus project. It can be mapped 1-1 on the original Greek letters in UTF-8; however, embedded non-Greek words (such as the lemmas “comma” and “other”) cannot be identified automatically (and we do not want to decode them). The native file format of the treebank is based on XML. Greek letters are romanized using [[http://​www.tlg.uci.edu/​encoding/​quickbeta.pdf|Beta Code]], a romanization scheme used widely not only in the Perseus project. It can be mapped 1-1 on the original Greek letters in UTF-8; however, embedded non-Greek words (such as the lemmas “comma” and “other”) cannot be identified automatically (and we do not want to decode them).
  
-Morphological annotation consists of lemma and nine-character positional morphosyntactic ​tags. Disambiguation has been done manually (gold standard).+Morphological annotation consists of lemma and nine-character positional morphosyntactic ​tag. Disambiguation has been done manually (gold standard).
  
 The syntactic annotation style is very similar to that of the Prague Dependency Treebank. The syntactic tags (analytical functions) are almost identical, too. However, in AGDT some combined values are permitted that are not valid in PDT, e.g. ''​ATR_AP_ExD0_APOS''​. The syntactic annotation style is very similar to that of the Prague Dependency Treebank. The syntactic tags (analytical functions) are almost identical, too. However, in AGDT some combined values are permitted that are not valid in PDT, e.g. ''​ATR_AP_ExD0_APOS''​.
Line 111: Line 111:
  </​sentence></​code>​  </​sentence></​code>​
  
-The same sentence converted to the CoNLL format, with Greek letters decoded:+The first sentence ​of the corpus ​converted to the CoNLL format, with Greek letters decoded ​(note that this is not the same sentence as above because the conversion script reorders sentences according to their sentence id):
  
 | 1 | ἄσημα | ἄσημος | a | a | pos=a<​nowiki>​|</​nowiki>​per=-<​nowiki>​|</​nowiki>​num=p<​nowiki>​|</​nowiki>​ten=-<​nowiki>​|</​nowiki>​mod=-<​nowiki>​|</​nowiki>​voi=-<​nowiki>​|</​nowiki>​gen=n<​nowiki>​|</​nowiki>​cas=a<​nowiki>​|</​nowiki>​deg=- | 6 | OBJ | _ | _ | | 1 | ἄσημα | ἄσημος | a | a | pos=a<​nowiki>​|</​nowiki>​per=-<​nowiki>​|</​nowiki>​num=p<​nowiki>​|</​nowiki>​ten=-<​nowiki>​|</​nowiki>​mod=-<​nowiki>​|</​nowiki>​voi=-<​nowiki>​|</​nowiki>​gen=n<​nowiki>​|</​nowiki>​cas=a<​nowiki>​|</​nowiki>​deg=- | 6 | OBJ | _ | _ |

[ Back to the navigation ] [ Back to the content ]