|
Next revision
|
Previous revision
|
user:zeman:treebanks:ar [2011/11/20 21:20]
zeman vytvořeno |
user:zeman:treebanks:ar [2013/07/16 14:54] (current)
zeman Preliminary results of parsing PADT 2.0. |
| * CoNLL 2006 | * CoNLL 2006 |
| * CoNLL 2007 | * CoNLL 2007 |
| | * PADT 2.0 (not released) |
| |
| The CoNLL 2007 version reportedly improves over CoNLL 2006 in quality of morphological annotation. Both CoNLL versions miss important parts of the original PADT annotation (see below). | The CoNLL 2007 version reportedly improves over CoNLL 2006 and over the LDC PADT 1.0 in quality of morphological annotation. On the other hand, both CoNLL versions miss important parts of the original PADT annotation (see below). PADT 2.0 was never officially released. Preparations began but Otakar Smrž, the key person, left Charles University inbetween. |
| |
| ==== Obtaining and License ==== | ==== Obtaining and License ==== |
| |
| The CoNLL 2006 and 2007 versions are obtainable upon request under similar license terms. Their publication in the LDC together with the other CoNLL treebanks is being prepared. | The CoNLL 2006 and 2007 versions are obtainable upon request under similar license terms. Their publication in the LDC together with the other CoNLL treebanks is being prepared. |
| | |
| | There are plans that ÚFAL will distribute PADT via its data repository free of charge to those who declare that they have the LDC license for the underlying texts. The Prague annotation will be newly licensed under Creative Commons. Internally, we have the most up-to-date version in the SVN repository, see https://svn.ms.mff.cuni.cz/trac/padt. I am checking out a working copy to /net/projects/padt. |
| |
| PADT was created by members of the [[http://ufal.mff.cuni.cz/|Institute of Formal and Applied Linguistics]] (Ústav formální a aplikované lingvistiky, ÚFAL), Faculty of Mathematics and Physics (Matematicko-fyzikální fakulta), Charles University in Prague (Univerzita Karlova v Praze), Malostranské náměstí 25, Praha, CZ-11800, Czechia. The CoNLL conversion of the treebank was prepared by Otakar Smrž, one of the key authors of the original PADT. | PADT was created by members of the [[http://ufal.mff.cuni.cz/|Institute of Formal and Applied Linguistics]] (Ústav formální a aplikované lingvistiky, ÚFAL), Faculty of Mathematics and Physics (Matematicko-fyzikální fakulta), Charles University in Prague (Univerzita Karlova v Praze), Malostranské náměstí 25, Praha, CZ-11800, Czechia. The CoNLL conversion of the treebank was prepared by Otakar Smrž, one of the key authors of the original PADT. |
| * Principal publications | * Principal publications |
| * Jan Hajič, Otakar Smrž, Petr Zemánek, Jan Šnaidauf, Emanuel Beška: [[http://ufal.mff.cuni.cz/padt/PADT_1.0/docs/papers/2004-nemlar-padt.pdf|Prague Arabic Dependency Treebank: Development in Data and Tools]]. In: //Proceedings of the NEMLAR International Conference on Arabic Language Resources and Tools//, pages 110-117, Cairo, Egypt, 2004. | * Jan Hajič, Otakar Smrž, Petr Zemánek, Jan Šnaidauf, Emanuel Beška: [[http://ufal.mff.cuni.cz/padt/PADT_1.0/docs/papers/2004-nemlar-padt.pdf|Prague Arabic Dependency Treebank: Development in Data and Tools]]. In: //Proceedings of the NEMLAR International Conference on Arabic Language Resources and Tools//, pages 110-117, Cairo, Egypt, 2004. |
| | * Documentation |
| | * [[:padt:start|PADT at ÚFAL wiki]] (or [[padt|here]]?) |
| |
| ==== Domain ==== | ==== Domain ==== |
| |
| The original PADT 1.0 is distributed in the [[:format-fs|FS format]]. The CoNLL versions are distributed in the [[:format-conll|CoNLL-X format]]. The original PADT contains more information than the CoNLL version. There is morphological annotation (tags and lemmas) both manual and by a tagger (while only manual is in CoNLL data), glosses etc. However, the most important piece of information that got lost during the conversion to CoNLL is the FS attribute called ''parallel''. It distinguishes conjuncts from shared modifiers of coordination and thus the syntactic structure is incomplete without it. | The original PADT 1.0 is distributed in the [[:format-fs|FS format]]. The CoNLL versions are distributed in the [[:format-conll|CoNLL-X format]]. The original PADT contains more information than the CoNLL version. There is morphological annotation (tags and lemmas) both manual and by a tagger (while only manual is in CoNLL data), glosses etc. However, the most important piece of information that got lost during the conversion to CoNLL is the FS attribute called ''parallel''. It distinguishes conjuncts from shared modifiers of coordination and thus the syntactic structure is incomplete without it. |
| | |
| | The unreleased PADT 2.0 has been converted to the [[:format-pml|PML format]]. |
| |
| Word forms and lemmas are vocalized, i.e. they contain diacritics for short vowels as well as consonant gemination and a few other things. The CoNLL 2006 version includes [[http://www.qamus.org/transliteration.htm|Buckwalter transliteration]] of the Arabic script (in the same column as Arabic, attached to the Arabic form/lemma with an underscore character). | Word forms and lemmas are vocalized, i.e. they contain diacritics for short vowels as well as consonant gemination and a few other things. The CoNLL 2006 version includes [[http://www.qamus.org/transliteration.htm|Buckwalter transliteration]] of the Arabic script (in the same column as Arabic, attached to the Arabic form/lemma with an underscore character). |
| |
| The two Malt parser results of 2007 (single malt and blended) are described in [[http://aclweb.org/anthology-new/D/D07/D07-1097.pdf|(Hall et al., 2007)]] and the details about the parser configuration are described [[http://w3.msi.vxu.se/users/jha/conll07/|here]]. | The two Malt parser results of 2007 (single malt and blended) are described in [[http://aclweb.org/anthology-new/D/D07/D07-1097.pdf|(Hall et al., 2007)]] and the details about the parser configuration are described [[http://w3.msi.vxu.se/users/jha/conll07/|here]]. |
| | |
| | We obtained the following results during our HamleDT experiments on extended PADT 2.0 data using Malt Parser 1.7 and the stacklazy algorithm: |
| | |
| | ^ Parser (Authors) ^ UAS ^ |
| | | Malt (Nivre et al.) | 79.61 | |
| |
