[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

• ÚFAL Wiki Home
• ÚFAL Home
• Sitemap
• RSS
• ÚFAL calendar
• Recent changes
• Login
• Hledat:

[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

View differences: Side by SideInline Go

Link to this comparison view

Both sides previous revision Previous revision 2010/03/25 10:01 stranak 2010/03/25 09:53 stranak dalsi OOV2010/03/24 18:11 stranak 2010/03/24 17:57 stranak 2010/03/24 17:56 stranak 2010/03/24 17:54 stranak pridany udaje o OOV pro Tides+dictfilt (Shabdanjali)2009/10/23 14:18 stranak 2009/10/23 14:17 stranak 2009/10/23 14:05 stranak 2009/10/23 14:05 stranak 2009/10/22 22:14 zeman After cleaning.2009/10/22 22:05 zeman Numbers of bytes to make the identification of the version of data more precise.2009/10/22 16:55 stranak 2009/10/22 16:54 stranak 2009/10/22 16:53 stranak 2009/10/22 15:58 stranak 2009/10/22 15:57 stranak 2009/10/22 15:36 stranak 2009/10/22 15:32 stranak 2009/10/22 14:22 zeman Tides statistics.2009/10/21 17:22 stranak 2009/10/21 14:35 stranak 2009/10/20 23:25 stranak 2009/10/20 23:24 stranak 2009/10/20 23:21 stranak 2009/10/20 23:08 stranak 2009/10/20 17:16 stranak 2009/10/16 10:09 zeman vytvořeno Go Next revision		Previous revision 2010/03/25 10:01 stranak 2010/03/25 09:53 stranak dalsi OOV2010/03/24 18:11 stranak 2010/03/24 17:57 stranak 2010/03/24 17:56 stranak 2010/03/24 17:54 stranak pridany udaje o OOV pro Tides+dictfilt (Shabdanjali)2009/10/23 14:18 stranak 2009/10/23 14:17 stranak 2009/10/23 14:05 stranak 2009/10/23 14:05 stranak 2009/10/22 22:14 zeman After cleaning.2009/10/22 22:05 zeman Numbers of bytes to make the identification of the version of data more precise.2009/10/22 16:55 stranak 2009/10/22 16:54 stranak 2009/10/22 16:53 stranak 2009/10/22 15:58 stranak 2009/10/22 15:57 stranak 2009/10/22 15:36 stranak 2009/10/22 15:32 stranak 2009/10/22 14:22 zeman Tides statistics.2009/10/21 17:22 stranak 2009/10/21 14:35 stranak 2009/10/20 23:25 stranak 2009/10/20 23:24 stranak 2009/10/20 23:21 stranak 2009/10/20 23:08 stranak 2009/10/20 17:16 stranak 2009/10/16 10:09 zeman vytvořeno Go Next revision Both sides next revision
pub-company:icon2009 [2009/10/20 17:16] stranak		pub-company:icon2009 [2009/10/21 14:35] stranak
Line 33:		Line 33:
	==== Out of Vocabulary ====		==== Out of Vocabulary ====
-	| data           | tokens  | types | tokens in train | types in train |	+	No data have been lemmatised, so  all the numbers mean forms.
-	| Tides-train-en | 1226144 | 48048 | ||	+	^           Vocabulary Size               ^^^
-	| Tides-train-hi | 1312435 | 53451 | ||	+	^ data                ^ tokens  ^ types ^
-	| Tides+DP11-train-en | 1402536 | 52947 | ||	+	| **Tides-train-en**      | 1226144 | 48048 |
-	| Tides+DP11-train-hi | 1434543 | 57131 | ||	+	| **Tides-train-hi**      | 1312435 | 53451 |
		+	| **Tides+DP11-train-en** | 1402536 | 52947 |
		+	| **Tides+DP11-train-hi** | 1434543 | 57131 |
		+	| **Tides-dev-en**        |   22485 |  5596 |
		+	| **Tides-dev-hi**        |   24363 |  5642 |
		+	| **Tides-test-en**       |   27169 |  5939 |
		+	| **Tides-test-hi**       |   28574 |  5872 |
		+
		+
		+	^         Coverage               ^^^^^
		+	|                   | **tokens seen in train**  ||||  **types seen in train**  ||||
		+	|                   |  //Tides//  ||  //Tides+DP//  ||  //Tides//  || //Tides+DP// ||
		+	|                   | abs |  OOV  | abs |    OOV   | abs |  OOV  | abs |    OOV   |
		+	| **Tides-test-en** |             |                |             |                |
		+	| **Tides-test-hi** |             |                |             |                |
		+	| **Tides-dev-en**  |             |                |             |                |
		+	| **Tides-dev-hi**  |             |                |             |                |

---

[ Back to the navigation ] [ Back to the content ]