===== Dutch (nl) =====

[[http://odur.let.rug.nl/~vannoord/trees/|The Alpino Treebank]]

==== Versions ====

  * The Alpino Treebank 1.0 (2002) in an XML-based format
  * CoNLL 2006
  * [[http://odur.let.rug.nl/~vannoord/Lassy/|Lassy]] (2007 and later) builds upon Alpino, is much larger but not under the same license

==== Obtaining and License ====

Alpino is available under the [[http://www.gnu.org/licenses/gpl-2.0.html|GNU General Public License]]. Download the original distribution (DTAG + TIGER-XML formats) from http://odur.let.rug.nl/~vannoord/ftp/AlpinoCDROM/. Download the CoNLL 2006 conversion from http://ilk.uvt.nl/conll/free_data.html. The license in short:

  * any usage, commercial or not
  * modification and redistribution under same license permitted
  * citation in publications not required (but it is common decency)

Alpino was created by members of the [[http://www.rug.nl/let/onderwijs/afdelingen/informatiekunde/index|Alfa-informatica]], Faculty of Arts (Faculteit der Letteren), University of Groningen (Rijksuniversiteit Groningen), Oude Kijk in 't Jatstraat 26, NL-9712 EK Groningen, The Netherlands.

==== References ====

  * Website
    * http://odur.let.rug.nl/~vannoord/trees/ (Alpino)
    * http://odur.let.rug.nl/~vannoord/Lassy/ (Lassy)
    * http://ilk.uvt.nl/conll/free_data.html (CoNLL 2006)
  * Data
    * //no separate citation//
  * Principal publications
    * Robert Malouf, Gertjan van Noord: [[http://www-tsujii.is.s.u-tokyo.ac.jp/bsa/papers/malouf.pdf|Wide Coverage Parsing with Stochastic Attribute Value Grammars]]. In: Proceedings of Beyond Shallow Analyses – Formalisms and Statistical Modeling for Deep Analyses Workshop, IJCNLP, Sanya, Hainan, China, 2004.
    * Leonoor van der Beek, Gosse Bouma, Jan Daciuk, Tanja Gaustad, Robert Malouf, Gertjan van Noord, Robbert Prins, Begoña Villada: [[http://odur.let.rug.nl/~vannoord/trees/Papers/report_ch5.pdf|Algorithms for Linguistic Processing NWO PIONIER Progress Report]]. Groningen, Netherlands, 2002.
  * Documentation
    * The files {{:user:zeman:treebanks:nl-tagset.txt|doc/tagset.txt}}, ''doc/syn_prot.pdf'' and ''doc/diffs.pdf'' in the CoNLL 2006 distribution.

==== Domain ====

Newspaper. The Alpino Treebank consists of “the full cdbl (newspaper) part of the Eindhoven corpus.”

==== Size ====

The CoNLL 2006 version contains 200,654 tokens in 13735 sentences, yielding 14.61 tokens per sentence on average (CoNLL 2006 data split: 195,069 tokens / 13349 sentences training, 5585 tokens / 386 sentences test).

==== Inside ====

In the CoNLL version, the original POS tags from the Alpino Treebank were replaced by POS tags from the Memory-based part-of-speech tagger using the WOTAN tagset, which is described in the file ''tagset.txt''. The morphological annotation includes lemmas. The syntactic annotation is mostly identical to that of the Corpus Gesproken Nederlands (CGN, Spoken Dutch Corpus) as described in the file ''syn_prot.pdf'' (Dutch only). An attempt to describe a number of differences between the CGN and Alpino annotation practice is given in the file ''diff.pdf'' (which is heavily out of date, but the number of differences has been reduced). Conversion issues: head selection, multi-word units, discourse units.

Multi-word expressions have been concatenated into one token, using underscore as the joining character (e.g. "Economische_en_Monetaire_Unie"). They have special part-of-speech tags ''MWU'', their subparts of speech and features may describe the individual parts of the unit. E.g. "aan_het" has CPOS ''MWU'', (sub)POS ''Prep_Art'' and features ''voor_bep|onzijd|neut''.

==== Sample ====

The first two sentences of the CoNLL 2006 training data:

| 1 | Cathy | Cathy | N | N | <nowiki>eigen|ev|neut</nowiki> | 2 | su | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 2 | zag | zie | V | V | <nowiki>trans|ovt|1of2of3|ev</nowiki> | 0 | ROOT | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 3 | hen | hen | Pron | Pron | <nowiki>per|3|mv|datofacc</nowiki> | 2 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 4 | wild | wild | Adj | Adj | <nowiki>attr|stell|onverv</nowiki> | 5 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 5 | zwaaien | zwaai | N | N | <nowiki>soort|mv|neut</nowiki> | 2 | vc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 6 | <nowiki>.</nowiki> | <nowiki>.</nowiki> | Punc | Punc | punt | 5 | punct | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| ||||||||||
| 1 | Ze | ze | Pron | Pron | <nowiki>per|3|evofmv|nom</nowiki> | 2 | su | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 2 | had | heb | V | V | <nowiki>trans|ovt|1of2of3|ev</nowiki> | 0 | ROOT | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 3 | met | met | Prep | Prep | voor | 8 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 4 | haar | haar | Pron | Pron | <nowiki>bez|3|ev|neut|attr</nowiki> | 5 | det | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 5 | moeder | moeder | N | N | <nowiki>soort|ev|neut</nowiki> | 3 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 6 | kunnen | kan | V | V | <nowiki>hulp|ott|1of2of3|mv</nowiki> | 2 | vc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 7 | gaan | ga | V | V | <nowiki>hulp|inf</nowiki> | 6 | vc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 8 | winkelen | winkel | V | V | <nowiki>intrans|inf</nowiki> | 11 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 9 | <nowiki>,</nowiki> | <nowiki>,</nowiki> | Punc | Punc | komma | 8 | punct | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 10 | zwemmen | zwem | V | V | <nowiki>intrans|inf</nowiki> | 11 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 11 | of | of | Conj | Conj | neven | 7 | vc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 12 | terrassen | terras | N | N | <nowiki>soort|mv|neut</nowiki> | 11 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 13 | <nowiki>.</nowiki> | <nowiki>.</nowiki> | Punc | Punc | punt | 12 | punct | <nowiki>_</nowiki> | <nowiki>_</nowiki> |

The first two sentences of the CoNLL 2006 test data:

| 1 | BASISTAKENPAKKET | <nowiki>basis_taken_pakket</nowiki> | Prep | Prep | voor | 0 | ROOT | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 2 | JEUGDGEZONDHEIDSZORG | <nowiki>jeugd_gezondheid_zorg</nowiki> | N | N | <nowiki>eigen|ev|neut</nowiki> | 0 | ROOT | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 3 | <nowiki>0-19</nowiki> | <nowiki>0-19</nowiki> | Num | Num | <nowiki>hoofd|bep|attr|onverv</nowiki> | 4 | det | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 4 | JAAR | JAAR | N | N | <nowiki>eigen|ev|neut</nowiki> | 0 | ROOT | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| ||||||||||
| 1 | Daarvoor | daarvoor | Adv | Adv | <nowiki>pron|aanw</nowiki> | 3 | pc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 2 | is | ben | V | V | <nowiki>hulpofkopp|ott|3|ev</nowiki> | 0 | ROOT | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 3 | gekozen | kies | V | V | <nowiki>trans|verldw|onverv</nowiki> | 2 | vc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 4 | omdat | omdat | Conj | Conj | <nowiki>onder|metfin</nowiki> | 3 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 5 | gemeenten | gemeente | N | N | <nowiki>soort|mv|neut</nowiki> | 11 | su | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 6 | bij | bij | Prep | Prep | voor | 12 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 7 | uitstek | uitstek | N | N | <nowiki>soort|ev|neut</nowiki> | 6 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 8 | het | het | Art | Art | <nowiki>bep|onzijd|neut</nowiki> | 10 | det | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 9 | lokale | lokaal | Adj | Adj | <nowiki>attr|stell|vervneut</nowiki> | 10 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 10 | gezondheidsbeleid | <nowiki>gezondheid_beleid</nowiki> | N | N | <nowiki>soort|ev|neut</nowiki> | 12 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 11 | kunnen | kan | V | V | <nowiki>hulp|inf</nowiki> | 4 | body | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 12 | toespitsen | <nowiki>spits_toe</nowiki> | V | V | <nowiki>refl|inf</nowiki> | 11 | vc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 13 | op | op | Prep | Prep | voor | 12 | pc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 14 | de | de | Art | Art | <nowiki>bep|zijdofmv|neut</nowiki> | 16 | det | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 15 | specifieke | specifiek | Adj | Adj | <nowiki>attr|stell|vervneut</nowiki> | 16 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 16 | gezondheidssituatie | <nowiki>gezondheid_situatie</nowiki> | N | N | <nowiki>soort|ev|neut</nowiki> | 17 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 17 | en | en | Conj | Conj | neven | 13 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 18 | zorgbehoeften | <nowiki>zorg_behoefte</nowiki> | N | N | <nowiki>soort|mv|neut</nowiki> | 17 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 19 | van | van | Prep | Prep | voor | 16 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 20 | kinderen | kind | N | N | <nowiki>soort|mv|neut</nowiki> | 21 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 21 | en | en | Conj | Conj | neven | 19 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 22 | jongeren | jongere | Adj | Adj | <nowiki>zelfst|vergr|vervneut</nowiki> | 21 | cnj | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 23 | in | in | Prep | Prep | voor | 20 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 24 | de | de | Art | Art | <nowiki>bep|zijdofmv|neut</nowiki> | 26 | det | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 25 | eigen | eigen | Pron | Pron | <nowiki>aanw|neut|attr|weigen</nowiki> | 26 | mod | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 26 | gemeente | gemeente | N | N | <nowiki>soort|ev|neut</nowiki> | 23 | obj1 | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
| 27 | <nowiki>.</nowiki> | <nowiki>.</nowiki> | Punc | Punc | punt | 26 | punct | <nowiki>_</nowiki> | <nowiki>_</nowiki> |

==== Parsing ====

Nonprojectivities in Alpino are quite frequent. 10858 of the 200,654 tokens in the CoNLL 2006 version are attached nonprojectively (5.41%).

The results of the CoNLL 2006 shared task are [[http://ilk.uvt.nl/conll/results.html|available online]]. They have been published in [[http://aclweb.org/anthology-new/W/W06/W06-2920.pdf|(Buchholz and Marsi, 2006)]]. The evaluation procedure was non-standard because it excluded punctuation tokens. These are the best results for Dutch:

^ Parser (Authors) ^ LAS ^ UAS ^
| MST (McDonald et al.) | 79.19 | 83.57 |
| Riedel et al. | 78.59 | 82.91 |
| Basis (John O'Neil) | 77.51 | 81.73 |
| Malt (Nivre et al.) | 78.59 | 81.35 |