[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » user » zeman » treebanks

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
user:zeman:treebanks [2011/11/02 09:53]
zeman PSČ. 		user:zeman:treebanks [2014/07/17 17:43] (current)
zeman Croatian.
Line 1: Line 1:
 ====== Treebanks for Various Languages ====== ====== Treebanks for Various Languages ======
  
-===== Arabic (ar) =====+http://ufal.mff.cuni.cz/hamledt/ nebo [[hamledt|HamleDT ve Wiki]]
  
-Prague Arabic Dependency Treebank (PADT)+  * [[user:zeman:treebanks:grc|Ancient Greek (grc)]] 
 +  * [[user:zeman:treebanks:ar|Arabic (ar)]] 
 +  * [[user:zeman:treebanks:eu|Basque (eu)]] 
 +  * [[user:zeman:treebanks:bn|Bengali (bn)]] 
 +  * [[user:zeman:treebanks:bg|Bulgarian (bg)]] 
 +  * [[user:zeman:treebanks:ca|Catalan (ca)]] 
 +  * [[user:zeman:treebanks:hr|Croatian (hr)]] 
 +  * [[user:zeman:treebanks:cs|Czech (cs)]] 
 +  * [[user:zeman:treebanks:da|Danish (da)]] 
 +  * [[user:zeman:treebanks:nl|Dutch (nl)]] 
 +  * [[user:zeman:treebanks:en|English (en)]] 
 +  * [[user:zeman:treebanks:et|Estonian (et)]] 
 +  * [[user:zeman:treebanks:fi|Finnish (fi)]] 
 +  * [[user:zeman:treebanks:de|German (de)]] 
 +  * [[user:zeman:treebanks:el|Greek (el)]] 
 +  * [[user:zeman:treebanks:hi|Hindi (hi)]] 
 +  * [[user:zeman:treebanks:hu|Hungarian (hu)]] 
 +  * [[user:zeman:treebanks:it|Italian (it)]] 
 +  * [[user:zeman:treebanks:ja|Japanese (ja)]] 
 +  * [[user:zeman:treebanks:la|Latin (la)]] 
 +  * [[user:zeman:treebanks:fa|Persian (fa)]] 
 +  * [[user:zeman:treebanks:pt|Portuguese (pt)]] 
 +  * [[user:zeman:treebanks:ro|Romanian (ro)]] 
 +  * [[user:zeman:treebanks:ru|Russian (ru)]] 
 +  * [[user:zeman:treebanks:sk|Slovak (sk)]] 
 +  * [[user:zeman:treebanks:sl|Slovene (sl)]] 
 +  * [[user:zeman:treebanks:es|Spanish (es)]] 
 +  * [[user:zeman:treebanks:sv|Swedish (sv)]] 
 +  * [[user:zeman:treebanks:ta|Tamil (ta)]] 
 +  * [[user:zeman:treebanks:te|Telugu (te)]] 
 +  * [[user:zeman:treebanks:tr|Turkish (tr)]]
  
-==== Versions ====+===== To Process =====
  
-  * Original PADT 1.0 as distributed by the LDC +Ahoj, 
-  * CoNLL 2006 +stáhl jsem nový španělský závislostní korpus IULA (větší než AnCora) 
-  * CoNLL 2007+/net/projects/tectomt_shared/data/resources/treebanks/es
  
-The CoNLL 2007 version reportedly improves over CoNLL 2006 in quality of morphological annotation.+License:  CC BY 3.0 (Unported) 
 +Web:      http://www.iula.upf.edu/recurs01_tbk_uk.htm 
 +Doc:      http://www.iula.upf.edu/recurs01_conll_uk.htm 
 +Download: http://repositori.upf.edu/handle/10230/20048 
 +Parsing:  http://www.taln.upf.edu/system/files/biblio_files/ijcnlp_final_padro_et_al_2013.pdf 
 +          state-of-the-art LAS score is 94.7 using Mate-C 
 +sentences  42,000 
 +tokens    590,000
  
-==== Obtaining and License ====+The sentences have been choosed from the IULA LSP corpus, automatically annotated with POS information and manually annotated with syntactical information using the DELPH-IN environment. The resulting syntactic analysis is automatically converted to dependencies and delivered using the CONLL format.
  
-The original PADT 1.0 is distributed by the LDC under the catalogue number [[http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2004T23|LDC2004T23]]. It is free for LDC members 2004, price for non-members is unknown (contact LDC). The [[http://ufal.mff.cuni.cz/corp-lic/padt10-ord.html|license]] in short: +Martin
- +
-  * non-commercial research usage +
-  * no redistribution +
-  * cite [[http://ufal.mff.cuni.cz/padt/PADT_1.0/#refs|one publication]] in publications; also include: "The PADT 1.0 has been developed by the Institute of Formal and Applied Linguistics and the Center for Computational Linguistics (see http://ufal.mff.cuni.cz/)." +
- +
-The CoNLL 2006 and 2007 versions are obtainable upon request under similar license terms. Their publication in the LDC together with the other CoNLL treebanks is being prepared. +
- +
-PADT was created by members of the [[http://ufal.mff.cuni.cz/|Institute of Formal and Applied Linguistics]] (Ústav formální a aplikované lingvistiky, ÚFAL), Faculty of Mathematics and Physics (Matematicko-fyzikální fakulta), Charles University in Prague (Univerzita Karlova v Praze), Malostranské náměstí 25, Praha, CZ-11800, Czechia. +
- +
-==== Domain ==== +
- +
-Newswire text from press agencies (Agence France Presse, Ummah, Al Hayat, An Nahar, Xinhua 2001-2003). +
- +
-==== Size ==== +
- +
-According to their website, the original PADT 1.0 contains 113,500 tokens annotated analytically. The CoNLL 2006 version contains 59752 tokens in 1606 sentences, yielding 37.21 tokens per sentence on average (CoNLL 2006 data split: 54379 tokens / 1460 sentences training, 5373 tokens / 146 sentences test). The CoNLL 2007 version contains 116,793 tokens in 3043 sentences, yielding 38.38 tokens per sentence on average (CoNLL 2007 data split: 111,669 tokens / 2912 sentences training, 5124 tokens / 131 sentences test). +
- +
-==== References ==== +
- +
-  * Website +
-    * http://ufal.mff.cuni.cz/padt/ +
-  * Data +
-    * Jan Hajič, Otakar Smrž, Petr Zemánek, Petr Pajas, Jan Šnaidauf, Emanuel Beška, Jakub Kráčmar, Kamila Hassanová: //Prague Arabic Dependency Treebank 1.0// (LDC2004T23). Linguistic Data Consortium, Philadelphia, USA, 2004. ISBN 1-58563-319-4. +
-  * Principal publications +
-    * Jan Hajič, Otakar Smrž, Petr Zemánek, Jan Šnaidauf, Emanuel Beška: [[http://ufal.mff.cuni.cz/padt/PADT_1.0/docs/papers/2004-nemlar-padt.pdf|Prague Arabic Dependency Treebank: Development in Data and Tools]]. In: //Proceedings of the NEMLAR International Conference on Arabic Language Resources and Tools//, pages 110-117, Cairo, Egypt, 2004. +
- +
-==== TO DO ==== +
- +
-  * Documentation of m-tags, s-tags etc., tokenization issues, vocalization, Buckwalter transliteration, link to Elixir +
-  * Sample sentence, statistics of nonprojectivity etc. +
-  * Known published parsing accuracies, especially CoNLL 2006 and 2007 +
-  * Missing is_member attribute in CoNLL versions+

[ Back to the navigation ] [ Back to the content ]