Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
ufal:tasks [2012/01/18 15:34] ufal |
ufal:tasks [2012/01/19 12:01] ufal |
||
---|---|---|---|
Line 5: | Line 5: | ||
=== Europarl tokenizer === | === Europarl tokenizer === | ||
- | * **info:** A sample rule-based tokenizer, can use a list of prefixes which are usually followed by a dot but don't break a sentence. Distributed as a part of the Europarl tools. | + | * **description:** A sample rule-based tokenizer, can use a list of prefixes which are usually followed by a dot but don't break a sentence. Distributed as a part of the Europarl tools. |
* **version: | * **version: | ||
* **author:** Philipp Koehn and Josh Schroeder | * **author:** Philipp Koehn and Josh Schroeder | ||
* **licence: | * **licence: | ||
* **url:** http:// | * **url:** http:// | ||
- | * **languages: | + | * **languages: |
* **efficiency**: | * **efficiency**: | ||
+ | * **reference**: | ||
* **contact: | * **contact: | ||