Institute of Formal and Applied Linguistics Wiki

Prague Dependency Treebank (PDT)

• PDT 0.5 (1998)
• PDT 1.0 (2001)
• PDT 2.0 (2006)
• PDT 2.5 (2011)
• PDT 3.0 (2013)
• CoNLL 2006
• CoNLL 2007
• CoNLL 2009

The CoNLL 2006 version is based on PDT 1.0. The CoNLL 2007 and 2009 versions are based on PDT 2.0.

The original PDT 1.0 and 2.0 is distributed by the LDC under the catalogue numbers LDC2001T10 and LDC2006T01. It is free for LDC members 2001 and 2006, price for non-members is unknown (contact LDC). The license in short:

• non-commercial research usage
• no redistribution
• include in publications: “The Prague Dependency Treebank, version 2.0 has been developed by the Institute of Formal and Applied Linguistics, http://ufal.mff.cuni.cz/.”

The CoNLL 2006, 2007 and 2009 versions are obtainable upon request under similar license terms. Their publication in the LDC together with the other CoNLL treebanks is being prepared.

The PDT 2.5 version is available for download from the LINDAT CLARIN repository under the Creative Commons 3.0-BY-NC-SA license, i.e.:

• non-commercial usage
• redistribution possible under the same license
• cite in publications

PDT was created by members of the Institute of Formal and Applied Linguistics (Ústav formální a aplikované lingvistiky, ÚFAL), Faculty of Mathematics and Physics (Matematicko-fyzikální fakulta), Charles University in Prague (Univerzita Karlova v Praze), Malostranské náměstí 25, Praha, CZ-11800, Czechia. The CoNLL 2006 conversion of the treebank was prepared by Yuval Krymolowski; the CoNLL 2007 and 2009 conversions were prepared by ÚFAL (Zdeněk Žabokrtský and Jan Štěpánek).

• Website
  • http://ufal.mff.cuni.cz/pdt3.0/
  • http://ufal.mff.cuni.cz/pdt2.5/
  • http://ufal.mff.cuni.cz/pdt2.0/
  • http://ufal.mff.cuni.cz/pdt/
• Data
  • Jan Hajič, Eva Hajičová, Petr Pajas, Jarmila Panevová, Petr Sgall: Prague Dependency Treebank 1.0 (LDC2001T10). Linguistic Data Consortium, Philadelphia, USA, 2001. ISBN 1-58563-212-0.
  • Jan Hajič, Eva Hajičová, Jarmila Panevová, Petr Sgall, Petr Pajas, Jan Štěpánek, Jiří Havelka, Marie Mikulová: Prague Dependency Treebank 2.0 (LDC2006T01). Linguistic Data Consortium, Philadelphia, USA, 2006. ISBN 1-58563-370-4.
  • Eduard Bejček, Jan Hajič, Jarmila Panevová, Jiří Mírovský, Johanka Spoustová, Jan Štěpánek, Pavel Straňák, Pavel Šidák, Pavlína Vimmrová, Eva Šťastná, Magda Ševčíková, Lenka Smejkalová, Petr Homola, Jan Popelka, Markéta Lopatková, Lucie Hrabalová, Natalia Klyueva, Zdeněk Žabokrtský: Prague Dependency Treebank 2.5. Univerzita Karlova v Praze, Praha, Czechia, 2011-12-06, http://hdl.handle.net/11858/00-097C-0000-0006-DB11-8
• Principal publications
  • Jan Hajič, Alena Böhmová, Eva Hajičová, Barbora Hladká: The Prague Dependency Treebank: A Three-Level Annotation Scenario. In: Anne Abeillé (ed.): Treebanks: Building and Using Parsed Corpora, pages 103-127, Kluwer, Amsterdam, The Netherlands, 2000.
  • Eduard Bejček, Jarmila Panevová, Jan Popelka, Pavel Straňák, Magda Ševčíková, Jan Štěpánek, Zdeněk Žabokrtský: Prague Dependency Treebank 2.5 – a Revisited Version of PDT 2.0. In: Proceedings of the 24th International Conference on Computational Linguistics (Coling 2012), pages 231-246, Mumbai, India, 2012.
• Documentation
  • Jiří Hana, Daniel Zeman: Manual for Morphological Annotation, Revision for the Prague Dependency Treebank 2.0, ÚFAL Technical Report No. 2005-27, Praha, Czechia, 2005.
  • Jan Hajič, Jarmila Panevová, Eva Buráňová, Zdeňka Urešová, Alla Bémová: Annotations at Analytical Level, Instructions for annotators, ÚFAL MFF UK, Praha, Czechia, 1999.
  • Wiki: Chyby v PDT 3.0

Newswire text (Lidové noviny, Mladá fronta Dnes), business weekly (Českomoravský Profit) and a scientific magazine (Vesmír).

All distributions of PDT are officially split to training, development (d-test) and test (e-test) data sets. PDT 2.0 contains data that are annotated only morphologically (M-layer), those that are annotated both morphologically and analytically (surface syntax; M+A layers), and the smallest subset is also annotated tectogrammatically (M+A+T layers). The statistics in this section cover the M+A subset, which is relevant for surface dependency parsing.

Size of CoNLL 2007 data was limited because some teams of CoNLL 2006 complained that they did not have enough time and resources to train the larger models. For CoNLL 2009, only that part of PDT was selected that contained also tectogrammatical annotation, because the 2009 task included semantic learning.

Parts of the following table have been taken from (Zeman 2004, page 21). Only non-empty sentences counted (e.g. PDT 1.0 had 81614 sentence tags but only 73088 non-empty ones).

PDT 3.0 also distinguishes d-test and e-test but I currently have counts from train and d-test summed up. To be updated…

PDT 1.0 is distributed in the CSTS format. PDT 2.0 uses the PML format. CoNLL 2006 and 2007 uses the CoNLL-X format; CoNLL 2009 format is slightly different (number and meaning of columns). Unlike the other formats, the CSTS format used the ISO-8859-2 character encoding.

The CSTS format (PDT 0.5 and 1.0) contains morphological annotation (lemmas and tags) both manual and by two taggers. The CoNLL 2009 version contains manual and one automatic disambiguation. The official distribution of PDT 2.0 and the CoNLL 2006 and 2007 versions contain only manual morphology.

The original PDT uses 15-character positional morphological tags. The CoNLL versions convert the tags to the two/three CoNLL columns, CPOS, POS and FEAT. In addition, the CoNLL versions contain the Sem feature, which is derived from the tags attached to lemma in PDT (see Hana and Zeman, 2005).

See above for documentation of the morphological tags. All CoNLL distributions contain a README file with a brief description of the parts of speech and features. Use DZ Interset to inspect the PDT and the CoNLL tagsets.

The guidelines for syntactic annotation are documented in the PDT annotation manual.

The first sentence of the PDT 1.0 training data:

<csts lang=cs>
<h>
<source>Českomoravský profit</source>
<markup>
<mauth>js
<mdate>1996-2000
<mdesc>Manual analytical annotation
</markup>
<markup>
<mauth>kk,lk
<mdate>1996-2000
<mdesc>Manual morphological annotation
</markup>
</h>
<doc file="s/inf/j/1994/cmpr9406" id="001">
<a>
<mod>s
<txtype>inf
<genre>mix
<med>j
<temp>1994
<authname>y
<opus>cmpr9406
<id>001
</a>
<c>
<p n=1>
<s id="cmpr9406:001-p1s1">
<p n=2>
<s id="cmpr9406:001-p2s1">
<f cap>Třikrát<l>třikrát`3<t>Cv-------------<MDl src="a">třikrát`3<MDt src="a">Cv-------------<MDl src="b">třikrát`3<MDt src="b">Cv-------------<A>Adv<r>1<g>2
<f>rychlejší<l>rychlý<t>AAFS1----2A----<MDl src="a">rychlý<MDt src="a">AANS1----2A----<MDl src="b">rychlý<MDt src="b">AAFS1----2A----<A>ExD<r>2<g>0
<f>než<l>než-2<t>J,-------------<MDl src="a">než-2<MDt src="a">J,-------------<MDl src="b">než-2<MDt src="b">J,-------------<A>AuxC<r>3<g>2
<f>slovo<l>slovo<t>NNNS1-----A----<MDl src="a">slovo<MDt src="a">NNNS4-----A----<MDl src="b">slovo<MDt src="b">NNNS1-----A----<A>ExD<r>4<g>3

The first two sentences of the PDT 1.0 d-test data:

<csts lang=cs>
<h>
<source>Lidové noviny</source>
<markup>
<mauth>zu
<mdate>1996-2000
<mdesc>Manual analytical annotation
</markup>
</h>
<doc file="s/pub/nws/1994/ln94206" id="1">
<a>
<mod>s
<txtype>pub
<genre>mix
<med>nws
<temp>1994
<authname>y
<opus>ln94206
<id>1
</a>
<c>
<p n=1>
<s id="ln94206:1-p1s1">
<i>ti
<f cap>Lidé<MDl src="a">člověk<MDt src="a">NNMP1-----A---1<MDl src="b">člověk<MDt src="b">NNMP1-----A---1<A>ExD<r>1<g>0
<p n=2>
<s id="ln94206:1-p2s1">
<f upper.abbr>ING<MDl src="a">Ing-1_:B_^(inženýr)<MDt src="a">NNMXX-----A---8<MDl src="b">Ing-1_:B_^(inženýr)<MDt src="b">NNMXX-----A---8<A>Atr<r>1<g>4
<D>
<d>.<MDl src="a">.<MDt src="a">Z:-------------<MDl src="b">.<MDt src="b">Z:-------------<A>AuxG<r>2<g>1
<f upper>PETR<MDl src="a">Petr_;Y<MDt src="a">NNMS1-----A----<MDl src="b">Petr_;Y<MDt src="b">NNMS1-----A----<A>Atr<r>3<g>4
<f upper>KARAS<MDl src="a">karas<MDt src="a">NNMS1-----A----<MDl src="b">karas<MDt src="b">NNMS1-----A----<A>Sb_Ap<r>4<g>11
<D>
<d>,<MDl src="a">,<MDt src="a">Z:-------------<MDl src="b">,<MDt src="b">Z:-------------<A>AuxX<r>5<g>6
<f mixed>CSc<MDl src="a">CSc-1_:B_^(kandidát_věd)<MDt src="a">NNMXX-----A---8<MDl src="b">CSc-1_:B_^(kandidát_věd)<MDt src="b">NNMXX-----A---8<A>Atr<r>6<g>4
<D>
<d>.<MDl src="a">.<MDt src="a">Z:-------------<MDl src="b">.<MDt src="b">Z:-------------<A>AuxG<r>7<g>6
<d>(<MDl src="a">(<MDt src="a">Z:-------------<MDl src="b">(<MDt src="b">Z:-------------<A>ExD<r>8<g>4
<D>
<f num>53<MDl src="a">53<MDt src="a">C=-------------<MDl src="b">53<MDt src="b">C=-------------<A>ExD_Pa<r>9<g>4
<D>
<d>)<MDl src="a">)<MDt src="a">Z:-------------<MDl src="b">)<MDt src="b">Z:-------------<A>ExD<r>10<g>4
<D>
<d>,<MDl src="a">,<MDt src="a">Z:-------------<MDl src="b">,<MDt src="b">Z:-------------<A>Apos<r>11<g>20
<f>generální<MDl src="a">generální<MDt src="a">AAMS1----1A----<MDl src="b">generální<MDt src="b">AAMS1----1A----<A>Atr<r>12<g>13
<f>ředitel<MDl src="a">ředitel<MDt src="a">NNMS1-----A----<MDl src="b">ředitel<MDt src="b">NNMS1-----A----<A>Sb_Co<r>13<g>15
<f upper>ČEZ<MDl src="a">ČEZ-1_:B_;K_^(České_energetické_závody)<MDt src="a">NNIPX-----A---8<MDl src="b">ČEZ-1_:B_;K_^(České_energetické_závody)<MDt src="b">NNIPX-----A---8<A>Atr<r>14<g>13
<f>a<MDl src="a">a-1<MDt src="a">J^-------------<MDl src="b">a-1<MDt src="b">J^-------------<A>Coord_Ap<r>15<g>11
<f>předseda<MDl src="a">předseda<MDt src="a">NNMS1-----A----<MDl src="b">předseda<MDt src="b">NNMS1-----A----<A>Sb_Co<r>16<g>15
<f>jeho<MDl src="a">jeho_^(přivlast.)<MDt src="a">PSXXXZS3-------<MDl src="b">jeho_^(přivlast.)<MDt src="b">PSXXXZS3-------<A>Atr<r>17<g>18
<f>představenstva<MDl src="a">představenstvo<MDt src="a">NNNS2-----A----<MDl src="b">představenstvo<MDt src="b">NNNS2-----A----<A>Atr<r>18<g>16
<D>
<d>,<MDl src="a">,<MDt src="a">Z:-------------<MDl src="b">,<MDt src="b">Z:-------------<A>AuxX<r>19<g>11
<f>je<MDl src="a">být<MDt src="a">VB-S---3P-AA---<MDl src="b">být<MDt src="b">VB-S---3P-AA---<A>Pred<r>20<g>0
<f>absolventem<MDl src="a">absolvent<MDt src="a">NNMS7-----A----<MDl src="b">absolvent<MDt src="b">NNMS7-----A----<A>Pnom<r>21<g>20
<f>elektrotechnické<MDl src="a">elektrotechnický<MDt src="a">AAFS2----1A----<MDl src="b">elektrotechnický<MDt src="b">AAFS2----1A----<A>Atr<r>22<g>23
<f>fakulty<MDl src="a">fakulta<MDt src="a">NNFS2-----A----<MDl src="b">fakulta<MDt src="b">NNFS2-----A----<A>Atr_Co<r>23<g>25
<f upper>ČVUT<MDl src="a">ČVUT-1_:B_;K_^(České_vysoké_učení_technické)<MDt src="a">NNNXX-----A---8<MDl src="b">ČVUT-1_:B_;K_^(České_vysoké_učení_technické)<MDt src="b">NNNXX-----A---8<A>Atr<r>24<g>23
<f>a<MDl src="a">a-1<MDt src="a">J^-------------<MDl src="b">a-1<MDt src="b">J^-------------<A>Coord<r>25<g>21
<f>postgraduálního<MDl src="a">postgraduální<MDt src="a">AANS2----1A----<MDl src="b">postgraduální<MDt src="b">AANS2----1A----<A>Atr<r>26<g>27
<f>studia<MDl src="a">studium<MDt src="a">NNNS2-----A----<MDl src="b">studium<MDt src="b">NNNS2-----A----<A>Atr_Co<r>27<g>25
<f>v<MDl src="a">v-1<MDt src="a">RR--6----------<MDl src="b">v-1<MDt src="b">RR--6----------<A>AuxP<r>28<g>29
<f>oboru<MDl src="a">obor_^(lidské_činnosti)<MDt src="a">NNIS6-----A----<MDl src="b">obor_^(lidské_činnosti)<MDt src="b">NNIS6-----A----<A>AuxP<r>29<g>27
<f>metod<MDl src="a">metoda<MDt src="a">NNFP2-----A----<MDl src="b">metoda<MDt src="b">NNFP2-----A----<A>Atr<r>30<g>29
<f>operační<MDl src="a">operační<MDt src="a">AAFS2----1A----<MDl src="b">operační<MDt src="b">AAFS2----1A----<A>Atr<r>31<g>32
<f>analýzy<MDl src="a">analýza<MDt src="a">NNFS2-----A----<MDl src="b">analýza<MDt src="b">NNFS2-----A----<A>Atr<r>32<g>30
<D>
<d>.<MDl src="a">.<MDt src="a">Z:-------------<MDl src="b">.<MDt src="b">Z:-------------<A>AuxK<r>33<g>0

The first sentence of the PDT 1.0 e-test data:

<csts lang=cs>
<h>
<source>Lidové noviny</source>
<markup>
<mauth>zu
<mdate>1996-2000
<mdesc>Manual analytical annotation
</markup>
</h>
<doc file="s/pub/nws/1994/ln94209" id="1">
<a>
<mod>s
<txtype>pub
<genre>mix
<med>nws
<temp>1994
<authname>y
<opus>ln94209
<id>1
</a>
<c>
<p n=1>
<s id="ln94209:1-p1s1">
<f cap>Přádelny<MDl src="a">přádelna<MDt src="a">NNFP1-----A----<MDl src="b">přádelna<MDt src="b">NNFP1-----A----<A>Sb<r>1<g>2
<f>mají<MDl src="a">mít<MDt src="a">VB-P---3P-AA---<MDl src="b">mít<MDt src="b">VB-P---3P-AA---<A>Pred<r>2<g>0
<f>dvojnásob<MDl src="a">dvojnásob<MDt src="a">Db-------------<MDl src="b">dvojnásob<MDt src="b">Db-------------<A>Obj<r>3<g>2
<f>vad<MDl src="a">vada<MDt src="a">NNFP2-----A----<MDl src="b">vada<MDt src="b">NNFP2-----A----<A>Atr<r>4<g>3

Morphological annotation of the first amw training file of the PDT 2.0:

<mdata xmlns="http://ufal.mff.cuni.cz/pdt/pml/">
 <head>
  <schema href="mdata_schema.xml" />
  <references>
   <reffile id="w" name="wdata" href="cmpr9406_001.w.gz" />
  </references>
 </head>
 <meta>
  <lang>cs</lang>
  <annotation_info id="manual">
   <desc>Manual annotation</desc>
  </annotation_info>
 </meta>
 <s id="m-cmpr9406-001-p2s1">
  <m id="m-cmpr9406-001-p2s1w1">
   <src.rf>manual</src.rf>
   <w.rf>w#w-cmpr9406-001-p2s1w1</w.rf>
   <form>Třikrát</form>
   <lemma>třikrát`3</lemma>
   <tag>Cv-------------</tag>
  </m>
  <m id="m-cmpr9406-001-p2s1w2">
   <src.rf>manual</src.rf>
   <w.rf>w#w-cmpr9406-001-p2s1w2</w.rf>
   <form>rychlejší</form>
   <lemma>rychlý</lemma>
   <tag>AAFS1----2A----</tag>
  </m>
  <m id="m-cmpr9406-001-p2s1w3">
   <src.rf>manual</src.rf>
   <w.rf>w#w-cmpr9406-001-p2s1w3</w.rf>
   <form>než</form>
   <lemma>než-2</lemma>
   <tag>J,-------------</tag>
  </m>
  <m id="m-cmpr9406-001-p2s1w4">
   <src.rf>manual</src.rf>
   <w.rf>w#w-cmpr9406-001-p2s1w4</w.rf>
   <form>slovo</form>
   <lemma>slovo</lemma>
   <tag>NNNS1-----A----</tag>
  </m>
 </s>

Analytical (surface-syntactic) annotation of the first amw training file of the PDT 2.0:

<adata xmlns="http://ufal.mff.cuni.cz/pdt/pml/">
 <head>
  <schema href="adata_schema.xml" />
  <references>
   <reffile id="m" name="mdata" href="cmpr9406_001.m.gz" />
   <reffile id="w" name="wdata" href="cmpr9406_001.w.gz" />
  </references>
 </head>
 <meta>
  <annotation_info>
   <desc>Manual annotation</desc>
  </annotation_info>
 </meta>
 <trees>
  <LM id="a-cmpr9406-001-p2s1">
   <s.rf>m#m-cmpr9406-001-p2s1</s.rf>
   <ord>0</ord>
   <children>
    <LM id="a-cmpr9406-001-p2s1w2">
     <m.rf>m#m-cmpr9406-001-p2s1w2</m.rf>
     <afun>ExD</afun>
     <ord>2</ord>
     <children>
      <LM id="a-cmpr9406-001-p2s1w1">
       <m.rf>m#m-cmpr9406-001-p2s1w1</m.rf>
       <afun>Adv</afun>
       <ord>1</ord>
      </LM>
      <LM id="a-cmpr9406-001-p2s1w3">
       <m.rf>m#m-cmpr9406-001-p2s1w3</m.rf>
       <afun>AuxC</afun>
       <ord>3</ord>
       <children>
        <LM id="a-cmpr9406-001-p2s1w4">
         <m.rf>m#m-cmpr9406-001-p2s1w4</m.rf>
         <afun>ExD</afun>
         <ord>4</ord>
        </LM>
       </children>
      </LM>
     </children>
    </LM>
   </children>
  </LM>

The first two sentences of the CoNLL 2006 and 2007 training data:

The first sentence of the CoNLL 2006 test data:

The first sentence of the CoNLL 2007 test data:

The first sentence of the CoNLL 2009 training data:

The first sentence of the CoNLL 2009 development data:

The first sentence of the CoNLL 2009 test data:

PDT is a mildly nonprojective treebank. 8351 of the 437,020 tokens in the CoNLL 2007 version are attached nonprojectively (1.91%).

There is an online summary of known results in Czech parsing.

The results of the CoNLL 2006 shared task are available online. They have been published in (Buchholz and Marsi, 2006). The evaluation procedure was non-standard because it excluded punctuation tokens. These are the best results for Czech:

The results of the CoNLL 2007 shared task are available online. They have been published in (Nivre et al., 2007). The evaluation procedure was changed to include punctuation tokens. These are the best results for Czech:

The two Malt parser results of 2007 (single malt and blended) are described in (Hall et al., 2007) and the details about the parser configuration are described here.

The results of the CoNLL 2009 shared task are available online. They have been published in (Hajič et al., 2009). Unlabeled attachment score was not published. These are the best results for Czech: