Differences
This shows you the differences between two versions of the page.
Next revision | Previous revision Next revision Both sides next revision | ||
user:zeman:treebanks:te [2012/03/22 11:14] zeman vytvořeno |
user:zeman:treebanks:te [2012/03/22 17:06] zeman Inside. |
||
---|---|---|---|
Line 46: | Line 46: | ||
^ Part ^ Sentences ^ Chunks ^ Ratio ^ | ^ Part ^ Sentences ^ Chunks ^ Ratio ^ | ||
- | | Training | 980 | 6449 | 6.58 | | + | | Training |
- | | Development | 150 | 811 | 5.41 | | + | | Development | |
- | | Test | 150 | 961 | 6.41 | | + | | Test | |
- | | TOTAL | 1280 | 8221 | 6.42 | | + | | TOTAL |
- | The ICON 2010 version came with a data split into three parts: training, development | + | As for ICON 2010, the data description in [[http:// |
- | ^ Part ^ Sentences ^ Chunks ^ Ratio ^ Words ^ Ratio ^ | + | ^ Part ^ Sentences ^ Chunks ^ Ratio ^ PSentences |
- | | Training | 979 | 6440 | 6.58 | 10305 | 10.52 | | + | | Training |
- | | Development | 150 | 812 | 5.41 | 1196 | 7.97 | | + | | Development | |
- | | Test | 150 | 961 | 6.41 | 1350 | 9.00 | | + | | Test | |
- | | TOTAL | 1279 | 8213 | 6.42 | 12851 | 10.04 | | + | | TOTAL |
- | + | ||
- | I have counted the sentences and chunks. The number of words comes from (Husain et al., 2010). Note that the paper gives the number of training sentences as 980 (instead of 979), which is a mistake. The last training sentence has the id 980 but there is no sentence with id 418. | + | |
- | + | ||
- | Apparently the training-development-test data split was more or less identical in both years, except for the minor discrepancies (number of training sentences and development chunks). | + | |
==== Inside ==== | ==== Inside ==== | ||
- | The text uses the [[http:// | + | The text uses the [[http:// |
The CoNLL format contains only the chunk heads. The native SSF format shows the other words in the chunk, too, but it does not capture intra-chunk dependency relations. This is an example of a multi-word chunk: | The CoNLL format contains only the chunk heads. The native SSF format shows the other words in the chunk, too, but it does not capture intra-chunk dependency relations. This is an example of a multi-word chunk: | ||
- | < | + | < |
- | 3.1 ekatA QC <fs af='eka, | + | 3.1 932 QC <fs af='932, |
- | 3.2 ledisa | + | 3.2 maMxi |
- | 3.3 rumAla | + | 3.3 AdavAlYle |
))</ | ))</ | ||
Line 83: | Line 79: | ||
According to [[http:// | According to [[http:// | ||
- | Note: There have been cycles in the Hindi part of HyDT but no such problem occurs in the Bengali | + | Note: There have been cycles in the Hindi part of HyDT but no such problem occurs in the Telugu |
==== Sample ==== | ==== Sample ==== |