Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
pub-company:icon2009 [2009/10/20 23:21] stranak |
pub-company:icon2009 [2009/10/21 17:22] stranak |
||
---|---|---|---|
Line 34: | Line 34: | ||
==== Out of Vocabulary ==== | ==== Out of Vocabulary ==== | ||
No data have been lemmatised, so all the numbers mean forms. | No data have been lemmatised, so all the numbers mean forms. | ||
+ | ^ | ||
^ data ^ tokens | ^ data ^ tokens | ||
| **Tides-train-en** | | **Tides-train-en** | ||
Line 39: | Line 40: | ||
| **Tides+DP11-train-en** | 1402536 | 52947 | | | **Tides+DP11-train-en** | 1402536 | 52947 | | ||
| **Tides+DP11-train-hi** | 1434543 | 57131 | | | **Tides+DP11-train-hi** | 1434543 | 57131 | | ||
- | | **Tides-dev-en** | + | | **Tides-dev-en** |
- | | **Tides-dev-hi** | + | | **Tides-dev-hi** |
- | | **Tides-test-en** | + | | **Tides-test-en** |
- | | **Tides-test-hi** | + | | **Tides-test-hi** |
- | ^ | + | ^ |
- | | | **tokens seen in train**|| **types seen in train** | + | | |
- | | | // | + | | |
- | | **Tides-test-en** | | + | | | abs | OOV | abs | OOV | abs | OOV | abs | OOV | |
- | | **Tides-test-hi** | | + | | **Tides-test-en** | |
- | | **Tides-dev-en** | + | | **Tides-test-hi** | |
- | | **Tides-dev-hi** | + | | **Tides-dev-en** |
+ | | **Tides-dev-hi** | ||