Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
user:zeman:treebanks:hi [2011/12/06 22:23] zeman Size. |
user:zeman:treebanks:hi [2012/10/02 16:13] zeman HTB 0.5 for the 2012 shared task. |
||
---|---|---|---|
Line 9: | Line 9: | ||
* CoNLL format | * CoNLL format | ||
* ICON 2010 | * ICON 2010 | ||
+ | * Shakti Standard Format (SSF; native) | ||
+ | * CoNLL format | ||
+ | * HPST 2012 (MTPIL workshop COLING 2012; this version is also called HTB (Hindi Treebank) 0.5) | ||
* Shakti Standard Format (SSF; native) | * Shakti Standard Format (SSF; native) | ||
* CoNLL format | * CoNLL format | ||
- | There has been no official release of the treebank yet. There have been two as-is sample releases for the purposes of the NLP tools contests in parsing Indian languages, attached to the [[http:// | + | There has been no official release of the treebank yet. There have been three as-is sample releases for the purposes of the NLP tools contests in parsing Indian languages, attached to the [[http:// |
==== Obtaining and License ==== | ==== Obtaining and License ==== | ||
- | There is no standard distribution channel for the treebank after the ICON 2010 evaluation period. Inquire at the LTRC (ltrc (at) iiit (dot) ac (dot) in) about the possibility of getting the data. The ICON 2010 license in short: | + | There is no standard distribution channel for the treebank after the shared task evaluation period. Inquire at the LTRC (ltrc (at) iiit (dot) ac (dot) in) about the possibility of getting the data. The ICON 2010 and HPST 2012 license in short: |
* non-commercial research usage | * non-commercial research usage | ||
Line 39: | Line 42: | ||
==== Domain ==== | ==== Domain ==== | ||
- | Unknown. | + | News domain corpus from ISI Kolkata. |
==== Size ==== | ==== Size ==== | ||
Line 46: | Line 49: | ||
^ Part ^ Sentences ^ Chunks ^ Ratio ^ | ^ Part ^ Sentences ^ Chunks ^ Ratio ^ | ||
- | | Training | 1501 | 13779 | 9.18 | | + | | Training | 1501 | 13779 | 9.18 | |
- | | Development | 150 | 1250 | 8.33 | | + | | Development | 150 | |
- | | Test | 150 | 1156 | 7.71 | | + | | Test | |
- | | TOTAL | 1801 | 16185 | 8.99 | | + | | TOTAL | |
The ICON 2010 version came with a data split into three parts: training, development and test. The intra-chunk dependencies have been added: | The ICON 2010 version came with a data split into three parts: training, development and test. The intra-chunk dependencies have been added: | ||
^ Part ^ Sentences ^ Chunks ^ Ratio ^ Words ^ Ratio ^ | ^ Part ^ Sentences ^ Chunks ^ Ratio ^ Words ^ Ratio ^ | ||
- | | Training | 2972 | | | 64452 | 21.69 | | + | | Training | 2972 | | | 64452 | 21.69 | |
- | | Development | 543 | | | 12616 | 23.23 | | + | | Development | 543 | | | 12616 | 23.23 | |
- | | Test | 321 | | | 6588 | 20.52 | | + | | Test | |
- | | TOTAL | 3836 | | | 83656 | 21.81 | | + | | TOTAL | |
I have counted the sentences and tokens (words) on the '' | I have counted the sentences and tokens (words) on the '' | ||
- | ==== Inside ==== | + | The HTB 0.5 (2012) version came with a data split into three parts: training, development and test. The intra-chunk dependencies have been added: |
- | | + | ^ Part ^ Sentences ^ Chunks ^ Ratio ^ Words ^ Ratio ^ |
+ | | Training | | ||
+ | | Development | 1233 | | | 26416 | 21.42 | | ||
+ | | Test | | | | | | | ||
+ | | TOTAL | | | | | | | ||
- | -- | + | ==== Inside ==== |
- | + | ||
- | The text uses the [[http:// | + | |
- | The CoNLL format contains only the chunk heads. The native SSF format shows the other words in the chunk, too, but it does not capture intra-chunk dependency relations. This is an example of a multi-word chunk: | + | HTB 0.5 is distributed in Devanagari UTF-8 and in the WX encoding (see below), both in SSF and CoNLL formats, each with gold-standard and automatic morphology. |
- | < | + | //The rest of this section applies to the ICON datasets. It may or may not still be valid for HTB 0.5.// |
- | 3.1 | + | |
- | 3.2 | + | |
- | 3.3 | + | |
- | ))</code> | + | |
- | In the CoNLL format, the CPOS column contains | + | The text uses the [[http:// |
Occasionally there are '' | Occasionally there are '' | ||
Line 83: | Line 84: | ||
The [[http:// | The [[http:// | ||
- | According to [[http:// | + | According to [[http:// |
- | Note: There have been cycles in the Hindi part of HyDT but no such problem occurs in the Bengali part. | + | Note: There have been cycles in the Hindi part of HyDT. |
==== Sample ==== | ==== Sample ==== | ||
Line 601: | Line 602: | ||
==== Parsing ==== | ==== Parsing ==== | ||
- | Nonprojectivities in HyDT-Bangla | + | Nonprojectivities in HyDT-Hindi are not frequent. Only 862 of the 77068 chunks in the training+development ICON 2010 version are attached nonprojectively (1.12%). |
- | The results of the ICON 2009 NLP tools contest have been published in [[http:// | + | The results of the ICON 2009 NLP tools contest have been published in [[http:// |
^ Parser (Authors) ^ LAS ^ UAS ^ | ^ Parser (Authors) ^ LAS ^ UAS ^ | ||
- | | Kolkata (De et al.)* | 84.29 | 90.32 | | + | | Hyderabad (Ambati et al.) | 79.33 | 90.22 | |
- | | Hyderabad (Ambati et al.) | 78.25 | 90.22 | | + | | Malt (Nivre) | 78.20 | 89.36 | |
- | | Malt (Nivre) | 76.07 | 88.97 | | + | | Malt+MST (Zeman) | 73.88 | 88.49 | |
- | | Malt+MST (Zeman) | 71.49 | 86.89 | | + | | Mannem | 76.90 | 88.06 | |
- | | Mannem | 70.34 | 83.56 | | + | |
- | The results of the ICON 2010 NLP tools contest have been published in [[http:// | + | The results of the ICON 2010 NLP tools contest have been published in [[http:// |
^ Parser (Authors) ^ LAS ^ UAS ^ | ^ Parser (Authors) ^ LAS ^ UAS ^ | ||
- | | Attardi et al. | 70.66 | 87.41 | | + | | Attardi et al. | 87.49 | 94.78 | |
- | | Kosaraju et al. | 70.55 | 86.16 | | + | | Kosaraju et al. | 88.63 | 94.54 | |
- | | Kolachina et al. | 70.14 | 87.10 | | + | | Kolachina et al. | 86.22 | 93.25 | |