[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
user:zeman:treebanks:ta [2012/03/22 10:49]
zeman Sample.
user:zeman:treebanks:ta [2012/03/22 11:01] (current)
zeman Nonprojectivity and parsing.
Line 94: Line 94:
 ==== Parsing ==== ==== Parsing ====
  
-Nonprojectivities in PADT are rare. Only 431 of the 116,793 tokens in the CoNLL 2007 version are attached nonprojectively (0.37%).+Nonprojectivities in PADT are very rare. Only 15 of the 9581 tokens are attached nonprojectively (0.16%).
  
-The results of the CoNLL 2006 shared task are [[http://ilk.uvt.nl/conll/results.html|available online]]. They have been published in [[http://aclweb.org/anthology-new/W/W06/W06-2920.pdf|(Buchholz and Marsi2006)]]. The evaluation procedure was non-standard because it excluded punctuation tokens. These are the best results for Arabic:+Initial parsing results were published by [[http://ufal.mff.cuni.cz/~ramasamy/papers/2011-pres-CICLing.pdf|(Ramasamy and Žabokrtský2011)]]. They use smaller data and different training-test data split than defined here (2008 tokens training, 953 tokens test).
  
 ^ Parser (Authors) ^ LAS ^ UAS ^ ^ Parser (Authors) ^ LAS ^ UAS ^
-| MST (McDonald et al.) | 66.91 | 79.34 | +| Malt (Nivre et al.) | 65.69 | 75.03 
-| Basis (O'Neil) | 66.71 | 78.54 | +MST (McDonald et al.) | 65.69 | 74.92 |
-| Malt (Nivre et al.) | 66.71 | 77.52 | +
-| Edinburgh (Riedel et al.) | 66.65 | 78.62 | +
- +
-The results of the CoNLL 2007 shared task are [[http://nextens.uvt.nl/depparse-wiki/AllScores|available online]]. They have been published in [[http://aclweb.org/anthology-new/D/D07/D07-1096.pdf|(Nivre et al., 2007)]]. The evaluation procedure was changed to include punctuation tokens. These are the best results for Arabic: +
- +
-^ Parser (Authors) ^ LAS ^ UAS ^ +
-| Malt (Nilsson et al.) | 76.52 | 85.81 | +
-| Nakagawa | 75.08 | 86.09 +
-Malt (Hall et al.) | 74.75 | 84.21 | +
-| Sagae | 74.71 | 84.04 | +
-| Chen | 74.65 | 83.49 | +
-| Titov et al. | 74.12 83.18 | +
- +
-The two Malt parser results of 2007 (single malt and blended) are described in [[http://aclweb.org/anthology-new/D/D07/D07-1097.pdf|(Hall et al., 2007)]] and the details about the parser configuration are described [[http://w3.msi.vxu.se/users/jha/conll07/|here]].+
  

[ Back to the navigation ] [ Back to the content ]