Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
user:zeman:treebanks [2011/11/18 16:48] zeman Danish sample in native format. |
user:zeman:treebanks [2011/11/19 13:04] zeman Greek documentation. |
||
---|---|---|---|
Line 1345: | Line 1345: | ||
| Malt (Nivre et al.) | 84.77 | 89.80 | | | Malt (Nivre et al.) | 84.77 | 89.80 | | ||
| Riedel et al. | 83.63 | 89.66 | | | Riedel et al. | 83.63 | 89.66 | | ||
+ | |||
+ | ===== German (de) ===== | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | ==== Versions ==== | ||
+ | |||
+ | * TIGER Treebank 1 (2003) | ||
+ | * TIGER Treebank 2 (2005) | ||
+ | * TIGER Treebank 2.1 (2007) in [[http:// | ||
+ | * CoNLL 2006 | ||
+ | * CoNLL 2009 | ||
+ | |||
+ | ==== Obtaining and License ==== | ||
+ | |||
+ | The TIGER Treebank is freely downloadable after you accept the [[http:// | ||
+ | |||
+ | Republication of the two CoNLL versions in LDC is planned but it has not happenned yet. | ||
+ | |||
+ | The license in short: | ||
+ | |||
+ | * non-commercial research and evaluation usage by academic or educational institutions | ||
+ | * no redistribution | ||
+ | * acknowledge the use of the corpus in publications | ||
+ | |||
+ | The TIGER Treebank was created by members of three institutes: | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | |||
+ | ==== References ==== | ||
+ | |||
+ | * Website | ||
+ | * http:// | ||
+ | * Data | ||
+ | * //no separate citation// | ||
+ | * Principal publications | ||
+ | * Sabine Brants, Stefanie Dipper, Silvia Hansen, Wolfgang Lezius, George Smith: [[http:// | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | * Berthold Crysmann, Silvia Hansen-Schirra, | ||
+ | * Stefanie Albert, Jan Anderssen, Regine Bader, Stephanie Becker, Tobias Bracht, Sabine Brants, Thorsten Brants, Vera Demberg, Stefanie Dipper, Peter Eisenberg, Silvia Hansen, Hagen Hirschmann, Juliane Janitzek, Carolin Kirstein, Robert Langner, Lukas Michelbacher, | ||
+ | * The header of the XML version of the TIGER Treebank contains lists of various sorts of tags with brief explanation. | ||
+ | |||
+ | ==== Domain ==== | ||
+ | |||
+ | Mostly newswire (Frankfurter Rundschau). | ||
+ | |||
+ | ==== Size ==== | ||
+ | |||
+ | According to their website, the TIGER Treebank version 1 contains approximately 700,000 tokens in 40,000 sentences. Version 2.1 contains approximately 900,000 tokens in 50,000 sentences. | ||
+ | |||
+ | The CoNLL 2006 version contains 705,304 tokens in 39573 sentences, yielding 17.82 tokens per sentence on average (CoNLL 2006 data split: 699,610 tokens / 39216 sentences training, 5694 tokens / 357 sentences test). | ||
+ | |||
+ | The CoNLL 2009 version contains 712,332 tokens in 40020 sentences, yielding 17.80 tokens per sentence on average (CoNLL 2009 data split: 648,677 tokens / 36020 sentences training, 32033 tokens / 2000 sentences development, | ||
+ | |||
+ | ==== Inside ==== | ||
+ | |||
+ | All versions contain // | ||
+ | |||
+ | It is not clear what the // | ||
+ | |||
+ | The original treebank is phrase-based. The dependencies in the CoNLL versions must have thus been drawn using a head-selection procedure. Besides CoNLL data, the TIGER project also provides a subset of the TIGER Treebank in a dependency format. | ||
+ | |||
+ | ==== Sample ==== | ||
+ | |||
+ | The first sentence of TIGER Treebank 2.1 in the TIGER-XML format: | ||
+ | |||
+ | <code xml>< | ||
+ | <graph root=" | ||
+ | < | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | <t id=" | ||
+ | </ | ||
+ | < | ||
+ | <nt id=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | </nt> | ||
+ | <nt id=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | </nt> | ||
+ | <nt id=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | </nt> | ||
+ | <nt id=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | <edge label=" | ||
+ | </nt> | ||
+ | </ | ||
+ | </ | ||
+ | </ | ||
+ | |||
+ | The first sentence of the CoNLL 2006 training data: | ||
+ | |||
+ | | 1 | `` | _ | $( | $( | _ | 4 | PUNC | 4 | PUNC | | ||
+ | | 2 | Ross | _ | NE | NE | _ | 4 | SB | 4 | SB | | ||
+ | | 3 | Perot | _ | NE | NE | _ | 2 | PNC | 2 | PNC | | ||
+ | | 4 | wäre | _ | VAFIN | VAFIN | _ | 0 | ROOT | 0 | ROOT | | ||
+ | | 5 | vielleicht | _ | ADV | ADV | _ | 4 | MO | 4 | MO | | ||
+ | | 6 | ein | _ | ART | ART | _ | 8 | NK | 8 | NK | | ||
+ | | 7 | prächtiger | _ | ADJA | ADJA | _ | 8 | NK | 8 | NK | | ||
+ | | 8 | Diktator | _ | NN | NN | _ | 4 | PD | 4 | PD | | ||
+ | | 9 | < | ||
+ | |||
+ | The first sentence of the CoNLL 2006 test data: | ||
+ | |||
+ | | 1 | Zwei | _ | CARD | CARD | _ | 2 | NK | 2 | NK | | ||
+ | | 2 | Themen | _ | NN | NN | _ | 14 | SB | 14 | SB | | ||
+ | | 3 | , | _ | $, | $, | _ | 2 | PUNC | 2 | PUNC | | ||
+ | | 4 | die | _ | PRELS | PRELS | _ | 8 | OA | 8 | OA | | ||
+ | | 5 | Perot | _ | NE | NE | _ | 8 | SB | 8 | SB | | ||
+ | | 6 | immer | _ | ADV | ADV | _ | 7 | MO | 7 | MO | | ||
+ | | 7 | wieder | _ | ADV | ADV | _ | 8 | MO | 8 | MO | | ||
+ | | 8 | anspricht | _ | VVFIN | VVFIN | _ | 2 | RC | 2 | RC | | ||
+ | | 9 | , | _ | $, | $, | _ | 2 | PUNC | 2 | PUNC | | ||
+ | | 10 | Rezession | _ | NN | NN | _ | 2 | APP | 2 | APP | | ||
+ | | 11 | und | _ | KON | KON | _ | 10 | CD | 10 | CD | | ||
+ | | 12 | Bürokratie | _ | NN | NN | _ | 10 | CJ | 10 | CJ | | ||
+ | | 13 | , | _ | $, | $, | _ | 14 | PUNC | 14 | PUNC | | ||
+ | | 14 | machen | _ | VVFIN | VVFIN | _ | 0 | ROOT | 0 | ROOT | | ||
+ | | 15 | ihnen | _ | PPER | PPER | _ | 18 | DA | 18 | DA | | ||
+ | | 16 | besonders | _ | ADV | ADV | _ | 18 | MO | 18 | MO | | ||
+ | | 17 | zu | _ | PTKZU | PTKZU | _ | 18 | PM | 18 | PM | | ||
+ | | 18 | schaffen | _ | VVINF | VVINF | _ | 14 | OC | 14 | OC | | ||
+ | | 19 | . | _ | $. | $. | _ | 14 | PUNC | 14 | PUNC | | ||
+ | |||
+ | The first sentence of the CoNLL 2009 training data: | ||
+ | |||
+ | | 1 | `` | _ | `` | $( | $( | _ | _ | 4 | 4 | PUNC | PUNC | _ | _ | | ||
+ | | 2 | Ross | Ross | Roß | NE | NN | Nom< | ||
+ | | 3 | Perot | Perot | Perot | NE | NE | Nom< | ||
+ | | 4 | wäre | sein | sein | VAFIN | VAFIN | 3< | ||
+ | | 5 | vielleicht | vielleicht | vielleicht | ADV | ADV | _ | _ | 4 | 4 | MO | MO | _ | _ | | ||
+ | | 6 | ein | ein | ein | ART | ART | Nom< | ||
+ | | 7 | prächtiger | prächtig | prächtig | ADJA | ADJA | Pos< | ||
+ | | 8 | Diktator | Diktator | Diktator | NN | NN | Nom< | ||
+ | | 9 | < | ||
+ | |||
+ | The first sentence of the CoNLL 2009 development data: | ||
+ | |||
+ | | 1 | Maschinenbau | Maschinenbau | Maschinenbau | NN | NN | Nom< | ||
+ | | 2 | / | _ | / | $( | $( | _ | _ | 0 | 1 | PUNC | PUNC | _ | _ | | ||
+ | | 3 | ( | _ | ( | $( | $( | _ | _ | 0 | 4 | PUNC | PUNC | _ | _ | | ||
+ | | 4 | Zusammenfassung | Zusammenfassung | Zusammenfassung | NN | NN | Nom< | ||
+ | | 5 | ) | _ | ) | $( | $( | _ | _ | 0 | 1 | PUNC | PUNC | _ | _ | | ||
+ | |||
+ | The first sentence of the CoNLL 2009 test data: | ||
+ | |||
+ | | 1 | Gegen | gegen | gegen | APPR | APPR | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 2 | eine | ein | ein | ART | ART | Acc< | ||
+ | | 3 | Erweiterung | Erweiterung | Erweiterung | NN | NN | Acc< | ||
+ | | 4 | ihrer | ihr | ihr | PPOSAT | PPOSAT | Gen< | ||
+ | | 5 | Organisation | Organisation | Organisation | NN | NN | Gen< | ||
+ | | 6 | zu | zu | zu | APPR | APPR | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 7 | einem | ein | ein | ART | ART | Dat< | ||
+ | | 8 | sicherheitspolitischen | sicherheitspolitisch | sicherheitspolitisch | ADJA | ADJA | Pos< | ||
+ | | 9 | Forum | Forum | Forum | NN | NN | Dat< | ||
+ | | 10 | sprachen | sprechen | sprechen | VVFIN | VVFIN | 3< | ||
+ | | 11 | sich | sich | er< | ||
+ | | 12 | die | der | d | ART | ART | Nom< | ||
+ | | 13 | meisten | meister | meist | PIAT | PIAT | Nom< | ||
+ | | 14 | Staaten | Staat | Staat | NN | NN | Nom< | ||
+ | | 15 | beim | bei | beim | APPRART | APPRART | Dat< | ||
+ | | 16 | Gipfeltreffen | Gipfeltreffen | Gipfeltreffen | NN | NN | Dat< | ||
+ | | 17 | für | für | für | APPR | APPR | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 18 | Asiatisch-Pazifische | asiatisch-pazifisch | Asiatisch-Pazifische | ADJA | NN | Pos< | ||
+ | | 19 | Wirtschaftskooperation | Wirtschaftskooperation | Wirtschaftskooperation | NN | NN | Acc< | ||
+ | | 20 | ( | _ | ( | $( | $( | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 21 | Apec | Apec | _ | NE | NE | Nom< | ||
+ | | 22 | ) | _ | ) | $( | $( | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 23 | in | in | in | APPR | APPR | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 24 | Osaka | Osaka | Osaka | NE | NE | Dat< | ||
+ | | 25 | aus | aus | aus | PTKVZ | PTKVZ | _ | _ | _ | _ | _ | _ | _ | | ||
+ | | 26 | . | _ | . | $. | $. | _ | _ | _ | _ | _ | _ | _ | | ||
+ | |||
+ | ==== Parsing ==== | ||
+ | |||
+ | TIGER is a mildly nonprojective treebank. 15875 of the 680,710 tokens in the CoNLL 2009 training+development datasets are attached nonprojectively (2.33%). | ||
+ | |||
+ | The results of the CoNLL 2006 shared task are [[http:// | ||
+ | |||
+ | ^ Parser (Authors) ^ LAS ^ UAS ^ | ||
+ | | MST (McDonald et al.) | 87.34 | 90.38 | | ||
+ | | Riedel et al. | 86.24 | 89.76 | | ||
+ | | Basis (O' | ||
+ | | Malt (Nivre et al.) | 85.82 | 88.76 | | ||
+ | |||
+ | The results of the CoNLL 2009 shared task are [[http:// | ||
+ | |||
+ | ^ Parser (Authors) ^ LAS ^ | ||
+ | | Bohnet | 87.48 | | ||
+ | | Merlo | 87.29 | | ||
+ | | Chen | 86.24 | | ||
+ | | Che | 86.19 | | ||
+ | |||
+ | ===== Greek (el) ===== | ||
+ | |||
+ | Greek Dependency Treebank (GDT) | ||
+ | |||
+ | ==== Versions ==== | ||
+ | |||
+ | * CoNLL 2007 | ||
+ | |||
+ | ==== Obtaining and License ==== | ||
+ | |||
+ | There does not seem to be any regular distribution channel for the Greek Dependency Treebank. The CoNLL 2007 version had a restricted license for the duration of the shared task only. Republication of the CoNLL version in LDC is planned but it has not happenned yet. In the meantime, one can ask Prokopis Prokopidis (prokopis (at) ilsp (dot) gr) about availability of the corpus. | ||
+ | |||
+ | GDT was created by members of the [[http:// | ||
+ | |||
+ | ==== References ==== | ||
+ | |||
+ | * Website | ||
+ | * //no website dedicated to the treebank// | ||
+ | * Data | ||
+ | * //no separate citation// | ||
+ | * Principal publications | ||
+ | * Prokopis Prokopidis, Elina Desipri, Maria Koutsombogera, | ||
+ | * Documentation | ||
+ | * Description of tags and feature values is provided in the '' | ||
+ | |||
+ | ==== Domain ==== | ||
+ | |||
+ | Mixed (“GDT consists of randomly selected textual fragments and texts in three domains: politics (current affairs, manual transcripts and minutes of European parliamentary sessions), health, and travel.”) | ||
+ | |||
+ | ==== Size ==== | ||
+ | |||
+ | The CoNLL 2007 version contains 70223 tokens in 2902 sentences, yielding 24.20 tokens per sentence on average (CoNLL 2007 data split: 65419 tokens / 2705 sentences training, 4804 tokens / 197 sentences test). | ||
+ | |||
+ | ==== Inside ==== | ||
+ | |||
+ | The original morphosyntactic tags have been converted to fit into the three columns (CPOS, POS and FEAT) of the CoNLL format. There //should// be a 1-1 mapping between the [[http:// | ||
+ | |||
+ | The morphological analysis does not include lemmas. The morphosyntactic tags have been assigned (probably) manually. | ||
+ | |||
+ | The guidelines for syntactic annotation are documented in the other [[http:// | ||
+ | |||
+ | ==== Sample ==== | ||
+ | |||
+ | The first three sentences of the CoNLL 2006 training data: | ||
+ | |||
+ | | 1 | Глава | _ | N | Nc | _ | 0 | ROOT | 0 | ROOT | | ||
+ | | 2 | трета | _ | M | Mo | gen=f< | ||
+ | | |||||||||| | ||
+ | | 1 | НАРОДНО | _ | A | An | gen=n< | ||
+ | | 2 | СЪБРАНИЕ | _ | N | Nc | gen=n< | ||
+ | | |||||||||| | ||
+ | | 1 | Народното | _ | A | An | gen=n< | ||
+ | | 2 | събрание | _ | N | Nc | gen=n< | ||
+ | | 3 | осъществява | _ | V | Vpi | trans=t< | ||
+ | | 4 | законодателната | _ | A | Af | gen=f< | ||
+ | | 5 | власт | _ | N | Nc | _ | 3 | obj | 3 | obj | | ||
+ | | 6 | и | _ | C | Cp | _ | 3 | conj | 3 | conj | | ||
+ | | 7 | упражнява | _ | V | Vpi | trans=t< | ||
+ | | 8 | парламентарен | _ | A | Am | gen=m< | ||
+ | | 9 | контрол | _ | N | Nc | gen=m< | ||
+ | | 10 | . | _ | Punct | Punct | _ | 3 | punct | 3 | punct | | ||
+ | |||
+ | The first three sentences of the CoNLL 2006 test data: | ||
+ | |||
+ | | 1 | Единственото | _ | A | An | gen=n< | ||
+ | | 2 | решение | _ | N | Nc | gen=n< | ||
+ | | |||||||||| | ||
+ | | 1 | Ерик | _ | N | Np | gen=m< | ||
+ | | 2 | Франк | _ | N | Np | gen=m< | ||
+ | | 3 | Ръсел | _ | H | Hm | gen=m< | ||
+ | | |||||||||| | ||
+ | | 1 | Пълен | _ | A | Am | gen=m< | ||
+ | | 2 | мрак | _ | N | Nc | gen=m< | ||
+ | | 3 | и | _ | C | Cp | _ | 2 | conj | 2 | conj | | ||
+ | | 4 | пълна | _ | A | Af | gen=f< | ||
+ | | 5 | самота | _ | N | Nc | _ | 2 | conjarg | 2 | conjarg | | ||
+ | | 6 | . | _ | Punct | Punct | _ | 2 | punct | 2 | punct | | ||
+ | |||
+ | ==== Parsing ==== | ||
+ | |||
+ | Nonprojectivities in BTB are rare. Only 747 of the 196,151 tokens in the CoNLL 2006 version are attached nonprojectively (0.38%). | ||
+ | |||
+ | The results of the CoNLL 2006 shared task are [[http:// | ||
+ | |||
+ | ^ Parser (Authors) ^ LAS ^ UAS ^ | ||
+ | | MST (McDonald et al.) | 87.57 | 92.04 | | ||
+ | | Malt (Nivre et al.) | 87.41 | 91.72 | | ||
+ | | Nara (Yuchang Cheng) | 86.34 | 91.30 | | ||