Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
user:zeman:treebanks [2011/11/07 12:07] zeman Link to Bengali syntactic tags. |
user:zeman:treebanks [2014/05/26 17:01] zeman |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== | + | ====== |
- | ===== Arabic (ar) ===== | + | 22.4.2014: DZ: Prošel jsem všech 30 jazyků a dal jsem jejich pražskou normalizaci alespoň částečně do pořádku. Částečně znamená, že jsem vynuloval testy na AfunNotNR, FinalPunctuation a vše kolem nekonzistentních koordinací. Samozřejmě by to chtělo dál pracovat na Auxech, interpunkci a zbytečných neprojektivitách, |
- | [[http:// | + | **Verze 2.0 by měla být hotová a zakonzervovaná nejpozději v pátek 23.5.2014!** V pondělí 26. začíná LREC na Islandu, kde bude Ruda tuto verzi prezentovat. |
- | ==== Versions ==== | + | * < |
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * Vygenerovat HamleDT 2.0 free do ''/ | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * Asi už zrušit webový přístup k této složce. Kvůli verzi 1.0 to šlo, ale teď by měli všichni chodit přes Lindat. | ||
+ | * < | ||
+ | * Aktualizovat [[http:// | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * < | ||
+ | * Ve spolupráci s Honzou Ptáčkem vyrobit i grafickou upoutávku na titulní stranu | ||
+ | * Inzerovat HamleDT 2.0 v corpora@uib.no! // | ||
+ | * < | ||
+ | * Inzerovat na facebookové stránce ÚFALu | ||
+ | * Přidat odkazy na HamleDT na všechna relevantní místa (zejména ke všem jazykům) do ACL Wiki | ||
- | * Original PADT 1.0 as distributed by the LDC | + | Odloženo na dobu po vydání HamleDTa 2.0: |
- | * CoNLL 2006 | + | |
- | * CoNLL 2007 | + | |
- | The CoNLL 2007 version reportedly improves over CoNLL 2006 in quality of morphological annotation. Both CoNLL versions miss important parts of the original PADT annotation | + | * Po LRECu 2014 doplnit referenci na nový článek a na webu z něj udělat ten hlavní "how to cite". |
+ | * K odkazům na články dodat také odkazy na PDF a BibTeX. | ||
+ | * Hodila by se i podrobnější dokumentace obsahu treebanků a harmonizačního procesu. Pokud to nestihneme, tak alespoň tabulka afunů s vysvětlivky (v podstatě už ji máme v islandském článku) | ||
+ | * Dan musí dodělat v Bibliu značkování publikací, aby bylo možné na stránky HamleDTa vygenerovat seznam všech publikací, které se HamleDTa týkají | ||
+ | * Vymyslet lepší hierarchii složek na disku? | ||
+ | * Rozšířit systém testů, aby pokrýval i stanfordskou mutaci HamleDTa. | ||
+ | * Zlepšit podporu práci s CoNLL patchi. Dodat skript, který to slepí s původními daty a případně nějak pomůže u treebanků, u kterých není jasné, jak se jmenují a jak jsou uspořádané soubory, ve kterých uživatel dostal originální verzi. | ||
+ | * Dotáhnout parsing HamleDTa 2.0 a popsat jeho výsledky na webu. | ||
+ | * Vymyslet způsob, jak by se obsah webu zrcadlil v SVN, kde máme treexový kód pro HamleDTa | ||
+ | * Do jazyků s cizími písmy doplnit transliteraci. | ||
+ | * Pro některou z příštích verzí zvažujeme přidat automatický a zarovnaný překlad od Googlu, tak bychom transliteraci mohli odložit na stejný okamžik. | ||
+ | * Přidat HamleDT do (aktualizovat v) PML-TQ. Dořešit přístup pro nepřihlášené vs. přihlášené uživatele. Odkázat na to ze stránek HamleDTa. | ||
+ | * Zavést verzování dat, dotáhnout pravidelné automatické regresní testování (cron-diff, Dan má zatím první nástřel) | ||
+ | * Zařídit posílání e-mailů a automatické mazání výstupů, ve kterých nebyl zjištěn žádný rozdíl. Jinak se rychle zaplní disk, každou noc tam přibude několik gigabajtů. | ||
+ | * Vytvořit webovou službu (např. scénář v rámci Treex:: | ||
+ | * Nahradit arabská data novými (Zdeněk je slíbil do začátku května) | ||
+ | * Aktualizace 19. května: Zdeněk to nestihne. Znamená to, že v 99 % vět je alespoň jeden uzel, který nemá vyplněné lemma nebo značku nebo obojí. Nemám spočítané přímo procento všech uzlů, ale bude taky velmi vysoké. Rozhodně to není tak, že by v každé větě byl jen jeden uzel vadný. | ||
+ | * Bohužel teď nemáme moc možností, co s tím. Stará data z CoNLL 2007 byla mizerná, protože tam chyběly hodnoty is_member. K nim se vracet nechci. S novými daty nedokážu ve zbývajícím čase nic pořádného udělat, to bude urgentní TODO po vydání HamleDTa 2.0. Vynechat arabštinu taky nechci, je to jeden z těch volných jazyků a v článku jsme ho slíbili. Takže to prostě vydáme v tom stavu, ve kterém to je, nedá se nic dělat. | ||
+ | * Konečné rozhodnutí pro HamleDT 2.0: vrátil jsem se k PADT r349, z ní jsem do HamleDTa zařadil jen ty věty, ve kterých všechny uzly měly vyplněný afun. Pro další verze HamleDTa musíme nejdříve dotáhnout do přijatelného stavu samotné PADT. | ||
- | ==== Obtaining and License | + | ====== |
- | + | ||
- | The original PADT 1.0 is distributed by the LDC under the catalogue number [[http:// | + | |
- | + | ||
- | * non-commercial research usage | + | |
- | * no redistribution | + | |
- | * cite [[http:// | + | |
- | + | ||
- | The CoNLL 2006 and 2007 versions are obtainable upon request under similar license terms. Their publication in the LDC together with the other CoNLL treebanks is being prepared. | + | |
- | + | ||
- | PADT was created by members of the [[http:// | + | |
- | + | ||
- | ==== Domain ==== | + | |
- | + | ||
- | Newswire text from press agencies (Agence France Presse, Ummah, Al Hayat, An Nahar, Xinhua 2001-2003). | + | |
- | + | ||
- | ==== Size ==== | + | |
- | + | ||
- | According to their website, the original PADT 1.0 contains 113,500 tokens annotated analytically. The CoNLL 2006 version contains 59752 tokens in 1606 sentences, yielding 37.21 tokens per sentence on average (CoNLL 2006 data split: 54379 tokens / 1460 sentences training, 5373 tokens / 146 sentences test). The CoNLL 2007 version contains 116,793 tokens in 3043 sentences, yielding 38.38 tokens per sentence on average (CoNLL 2007 data split: 111,669 tokens / 2912 sentences training, 5124 tokens / 131 sentences test). | + | |
- | + | ||
- | As noted in (Nivre et al., 2007), “the parsing units in this treebank are in many cases larger than conventional sentences, which partly explains the high average number of tokens per sentence.” | + | |
- | + | ||
- | ==== References ==== | + | |
- | + | ||
- | * Website | + | |
- | * http:// | + | |
- | * Data | + | |
- | * Jan Hajič, Otakar Smrž, Petr Zemánek, Petr Pajas, Jan Šnaidauf, Emanuel Beška, Jakub Kráčmar, Kamila Hassanová: //Prague Arabic Dependency Treebank 1.0// (LDC2004T23). Linguistic Data Consortium, Philadelphia, | + | |
- | * Principal publications | + | |
- | * Jan Hajič, Otakar Smrž, Petr Zemánek, Jan Šnaidauf, Emanuel Beška: [[http:// | + | |
- | + | ||
- | ==== Inside ==== | + | |
- | + | ||
- | The original PADT 1.0 is distributed in the [[: | + | |
- | + | ||
- | Word forms and lemmas are vocalized, i.e. they contain diacritics for short vowels as well as consonant gemination and a few other things. The CoNLL 2006 version includes [[http:// | + | |
- | + | ||
- | Note that tokenization of Arabic typically includes splitting original words (inserting spaces between letters), not just separating punctuation from words. Example: وبالفالوجة = wabiālfālūjah = wa/CONJ + bi/PREP + AlfAlwjp/ | + | |
- | + | ||
- | The original PADT 1.0 uses 10-character positional morphological tags whose documentation is hard to find. The CoNLL 2006 version converts the tags to the three CoNLL columns, CPOS, POS and FEAT, most of the information being encoded as pipe-separated attribute-value assignments in FEAT. There //should// be a 1-1 mapping between the PADT positional tags and the CoNLL 2006 annotation. The CoNLL 2007 version uses a tag conversion different from CoNLL 2006. Both CoNLL distributions contain a README file with a brief description of the parts of speech and features. Use [[http:// | + | |
- | + | ||
- | The guidelines for syntactic annotation are documented in the [[http:// | + | |
- | + | ||
- | ==== Sample ==== | + | |
- | + | ||
- | The first two sentences of the CoNLL 2006 training data: | + | |
- | + | ||
- | | 1 | غِيابُ_giyAbu | غِياب_giyAb | N | N | case=1< | + | |
- | | 2 | فُؤاد_fu& | + | |
- | | 3 | كَنْعان_kanoEAn | كَنْعان_kanoEAn | Z | Z | _ | 1 | Atr | _ | _ | | + | |
- | | |||||||||| | + | |
- | | 1 | فُؤاد_fu& | + | |
- | | 2 | كَنْعان_kanoEAn | كَنْعان_kanoEAn | Z | Z | _ | 9 | Sb | _ | _ | | + | |
- | | 3 | ،_, | ،_, | G | G | _ | 2 | AuxG | _ | _ | | + | |
- | | 4 | رائِد_rA}id | رائِد_rA}id | N | N | _ | 2 | Atr | _ | _ | | + | |
- | | 5 | القِصَّة_AlqiS~ap | قِصَّة_qiS~ap | N | N | gen=F< | + | |
- | | 6 | القَصِيرَةِ_AlqaSiyrapi | قَصِير_qaSiyr | A | A | gen=F< | + | |
- | | 7 | فِي_fiy | فِي_fiy | P | P | _ | 4 | AuxP | _ | _ | | + | |
- | | 8 | لُبْنانِ_lubonAni | لُبْنان_lubonAn | Z | Z | case=2< | + | |
- | | 9 | رَحَلَ_raHala | رَحَل-َ_raHal-a | V | VP | pers=3< | + | |
- | | 10 | مَساءَ_masA' | + | |
- | | 11 | أَمْسِ_> | + | |
- | | 12 | عَن_Ean | عَن_Ean | P | P | _ | 9 | AuxP | _ | _ | | + | |
- | | 13 | 81_81 | 81_81 | Q | Q | _ | 12 | Adv | _ | _ | | + | |
- | | 14 | عاماً_EAmAF | عام_EAm | N | N | gen=M< | + | |
- | | 15 | ._. | ._. | G | G | _ | 0 | AuxK | _ | _ | | + | |
- | + | ||
- | The first sentence of the CoNLL 2006 test data: | + | |
- | + | ||
- | | 1 | اِتِّفاقٌ_Ait~ifAqN | اِتِّفاق_Ait~ifAq | N | N | case=1< | + | |
- | | 2 | بَيْنَ_bayona | بَيْنَ_bayona | P | P | _ | 1 | AuxP | _ | _ | | + | |
- | | 3 | لُبْنانِ_lubonAni | لُبْنان_lubonAn | Z | Z | case=2< | + | |
- | | 4 | وَ_wa | وَ_wa | C | C | _ | 2 | Coord | _ | _ | | + | |
- | | 5 | سُورِيَّةٍ_suwriy~apK | سُورِيا_suwriyA | Z | Z | gen=F< | + | |
- | | 6 | عَلَى_EalaY | عَلَى_EalaY | P | P | _ | 1 | AuxP | _ | _ | | + | |
- | | 7 | رَفْعِ_rafoEi | رَفْع_rafoE | N | N | case=2< | + | |
- | | 8 | مُسْتَوَى_musotawaY | مُسْتَوَى_musotawaY | N | N | _ | 7 | Atr | _ | _ | | + | |
- | | 9 | التَبادُلِ_AltabAduli | تَبادُل_tabAdul | N | N | case=2< | + | |
- | | 10 | التِجارِيِّ_AltijAriy~i | تِجارِيّ_tijAriy~ | A | A | case=2< | + | |
- | | 11 | إِلَى_< | + | |
- | | 12 | 500_500 | 500_500 | Q | Q | _ | 11 | Atr | _ | _ | | + | |
- | | 13 | مِلْيُونِ_miloyuwni | مِلْيُون_miloyuwn | N | N | case=2< | + | |
- | | 14 | دُولارٍ_duwlArK | دُولار_duwlAr | N | N | case=2< | + | |
- | + | ||
- | The first sentence of the CoNLL 2007 training data: | + | |
- | + | ||
- | | 1 | تَعْدادُ | تَعْداد_1 | N | N- | Case=1< | + | |
- | | 2 | سُكّانِ | ساكِن_1 | N | N- | Case=2< | + | |
- | | 3 | 22 | [DEFAULT] | Q | Q- | _ | 2 | Atr | _ | _ | | + | |
- | | 4 | دَوْلَةً | دَوْلَة_1 | N | N- | Gender=F< | + | |
- | | 5 | عَرَبِيَّةً | عَرَبِيّ_1 | A | A- | Gender=F< | + | |
- | | 6 | سَ | سَ_FUT | F | F- | _ | 7 | AuxM | _ | _ | | + | |
- | | 7 | يَرْتَفِعُ | اِرْتَفَع_1 | V | VI | Mood=I< | + | |
- | | 8 | إِلَى | إِلَى_1 | P | P- | _ | 7 | AuxP | _ | _ | | + | |
- | | 9 | 654 | [DEFAULT] | Q | Q- | _ | 8 | Adv | _ | _ | | + | |
- | | 10 | مِلْيُونَ | مِلْيُون_1 | N | N- | Case=4< | + | |
- | | 11 | نَسَمَةٍ | نَسَمَة_1 | N | N- | Gender=F< | + | |
- | | 12 | فِي | فِي_1 | P | P- | _ | 7 | AuxP | _ | _ | | + | |
- | | 13 | مُنْتَصَفِ | مُنْتَصَف_1 | N | N- | Case=2< | + | |
- | | 14 | القَرْنِ | قَرْن_1 | N | N- | Case=2< | + | |
- | + | ||
- | The first sentence of the CoNLL 2007 test data: | + | |
- | + | ||
- | | 1 | مُقاوَمَةُ | مُقاوَمَة_1 | N | N- | Gender=F< | + | |
- | | 2 | زَواجِ | زَواج_1 | N | N- | Case=2< | + | |
- | | 3 | الطُلّابِ | طالِب_1 | N | N- | Case=2< | + | |
- | | 4 | العُرْفِيِّ | عُرْفِيّ_1 | A | A- | Case=2< | + | |
- | + | ||
- | ==== Parsing ==== | + | |
- | + | ||
- | Nonprojectivities in PADT are rare. Only 431 of the 116,793 tokens in the CoNLL 2007 version are attached nonprojectively (0.37%). | + | |
- | + | ||
- | The results of the CoNLL 2006 shared task are [[http:// | + | |
- | + | ||
- | ^ Parser (Authors) ^ LAS ^ UAS ^ | + | |
- | | MST (McDonald et al.) | 66.91 | 79.34 | | + | |
- | | Basis (O' | + | |
- | | Malt (Nivre et al.) | 66.71 | 77.52 | | + | |
- | | Edinburgh (Riedel et al.) | 66.65 | 78.62 | | + | |
- | + | ||
- | The results of the CoNLL 2007 shared task are [[http:// | + | |
- | + | ||
- | ^ Parser (Authors) ^ LAS ^ UAS ^ | + | |
- | | Malt (Nilsson et al.) | 76.52 | 85.81 | | + | |
- | | Nakagawa | 75.08 | 86.09 | | + | |
- | | Malt (Hall et al.) | 74.75 | 84.21 | | + | |
- | | Sagae | 74.71 | 84.04 | | + | |
- | | Chen | 74.65 | 83.49 | | + | |
- | | Titov et al. | 74.12 | 83.18 | | + | |
- | + | ||
- | The two Malt parser results of 2007 (single malt and blended) are described in [[http:// | + | |
- | + | ||
- | ===== Bulgarian (bg) ===== | + | |
- | + | ||
- | [[http:// | + | |
- | + | ||
- | ==== Versions ==== | + | |
- | + | ||
- | * Original BTB in native format | + | |
- | * CoNLL 2006 (BulTreeBank-DP) | + | |
- | + | ||
- | The original BTB is based on HPSG (head-driven phrase-structure grammar). The CoNLL version contains only the dependency information encoded in HPSG BulTreeBank. | + | |
- | + | ||
- | ==== Obtaining and License ==== | + | |
- | + | ||
- | Only the CoNLL version seems to be distributed but you may ask the creators about the HPSG version. For the dependency version, print the [[http:// | + | |
- | + | ||
- | * research usage | + | |
- | * no redistribution | + | |
- | * cite [[http:// | + | |
- | + | ||
- | BTB was created by members of the [[http:// | + | |
- | + | ||
- | ==== Domain ==== | + | |
- | + | ||
- | Unknown (“A set of Bulgarian sentences marked-up with detailed syntactic information. These sentences are mainly extracted from authentic Bulgarian texts. They are chosen with regards two criteria. First, they cover the variety of syntactic structures of Bulgarian. Second, they show the statistical distribution of these phenomena in real texts.”) At least part of it is probably news (Novinar, Sega, Standart). | + | |
- | + | ||
- | ==== Size ==== | + | |
- | + | ||
- | The CoNLL 2006 version contains 196,151 tokens in 13221 sentences, yielding 14.84 tokens per sentence on average (CoNLL 2006 data split: 190,217 tokens / 12823 sentences training, 5934 tokens / 398 sentences test). | + | |
- | + | ||
- | ==== References ==== | + | |
- | + | ||
- | * Website | + | |
- | * http:// | + | |
- | * Data | + | |
- | * //no separate citation// | + | |
- | * Principal publications | + | |
- | * Kiril Simov, Petya Osenova, Alexander Simov, Milen Kouylekov: //Design and Implementation of the Bulgarian HPSG-based Treebank.// In: Erhard Hinrichs, Kiril Simov (eds.): Journal of Research on Language and Computation, | + | |
- | * Documentation | + | |
- | * Kiril Simov, Petya Osenova, Milena Slavcheva: [[http:// | + | |
- | * Petya Osenova, Kiril Simov: [[http:// | + | |
- | * http:// | + | |
- | + | ||
- | ==== Inside ==== | + | |
- | + | ||
- | The original morphosyntactic tags have been converted to fit into the three columns (CPOS, POS and FEAT) columns of the CoNLL format. There //should// be a 1-1 mapping between the [[http:// | + | |
- | + | ||
- | The morphological analysis does not include lemmas. The morphosyntactic tags have been assigned (probably) manually. | + | |
- | + | ||
- | The guidelines for syntactic annotation are documented in the other [[http:// | + | |
- | + | ||
- | ==== Sample ==== | + | |
- | + | ||
- | The first three sentences of the CoNLL 2006 training data: | + | |
- | + | ||
- | | 1 | Глава | _ | N | Nc | _ | 0 | ROOT | 0 | ROOT | | + | |
- | | 2 | трета | _ | M | Mo | gen=f< | + | |
- | | |||||||||| | + | |
- | | 1 | НАРОДНО | _ | A | An | gen=n< | + | |
- | | 2 | СЪБРАНИЕ | _ | N | Nc | gen=n< | + | |
- | | |||||||||| | + | |
- | | 1 | Народното | _ | A | An | gen=n< | + | |
- | | 2 | събрание | _ | N | Nc | gen=n< | + | |
- | | 3 | осъществява | _ | V | Vpi | trans=t< | + | |
- | | 4 | законодателната | _ | A | Af | gen=f< | + | |
- | | 5 | власт | _ | N | Nc | _ | 3 | obj | 3 | obj | | + | |
- | | 6 | и | _ | C | Cp | _ | 3 | conj | 3 | conj | | + | |
- | | 7 | упражнява | _ | V | Vpi | trans=t< | + | |
- | | 8 | парламентарен | _ | A | Am | gen=m< | + | |
- | | 9 | контрол | _ | N | Nc | gen=m< | + | |
- | | 10 | . | _ | Punct | Punct | _ | 3 | punct | 3 | punct | | + | |
- | + | ||
- | The first three sentences of the CoNLL 2006 test data: | + | |
- | + | ||
- | | 1 | Единственото | _ | A | An | gen=n< | + | |
- | | 2 | решение | _ | N | Nc | gen=n< | + | |
- | | |||||||||| | + | |
- | | 1 | Ерик | _ | N | Np | gen=m< | + | |
- | | 2 | Франк | _ | N | Np | gen=m< | + | |
- | | 3 | Ръсел | _ | H | Hm | gen=m< | + | |
- | | |||||||||| | + | |
- | | 1 | Пълен | _ | A | Am | gen=m< | + | |
- | | 2 | мрак | _ | N | Nc | gen=m< | + | |
- | | 3 | и | _ | C | Cp | _ | 2 | conj | 2 | conj | | + | |
- | | 4 | пълна | _ | A | Af | gen=f< | + | |
- | | 5 | самота | _ | N | Nc | _ | 2 | conjarg | 2 | conjarg | | + | |
- | | 6 | . | _ | Punct | Punct | _ | 2 | punct | 2 | punct | | + | |
- | + | ||
- | ==== Parsing ==== | + | |
- | + | ||
- | Nonprojectivities in BTB are rare. Only 747 of the 196,151 tokens in the CoNLL 2006 version are attached nonprojectively (0.38%). | + | |
- | + | ||
- | The results of the CoNLL 2006 shared task are [[http:// | + | |
- | + | ||
- | ^ Parser (Authors) ^ LAS ^ UAS ^ | + | |
- | | MST (McDonald et al.) | 87.57 | 92.04 | | + | |
- | | Malt (Nivre et al.) | 87.41 | 91.72 | | + | |
- | | Nara (Yuchang Cheng) | 86.34 | 91.30 | | + | |
- | + | ||
- | ===== Bengali (bn) ===== | + | |
- | + | ||
- | Hyderabad Dependency Treebank (HyDT-Bangla) | + | |
- | + | ||
- | ==== Versions ==== | + | |
- | + | ||
- | * ICON 2009 | + | |
- | * Shakti Standard Format (SSF; native) | + | |
- | * CoNLL format | + | |
- | * ICON 2010 | + | |
- | * Shakti Standard Format (SSF; native) | + | |
- | * CoNLL format | + | |
- | + | ||
- | There has been no official release of the treebank yet. There have been two as-is sample releases for the purposes of the NLP tools contests in parsing Indian languages, attached to the [[http:// | + | |
- | + | ||
- | ==== Obtaining and License ==== | + | |
- | + | ||
- | There is no standard distribution channel for the treebank after the ICON 2010 evaluation period. Inquire at the LTRC (ltrc (at) iiit (dot) ac (dot) in) about the possibility of getting the data. The ICON 2010 license in short: | + | |
- | + | ||
- | * non-commercial research usage | + | |
- | * no redistribution | + | |
- | + | ||
- | HyDT-Bangla is being created by members of the [[http:// | + | |
- | + | ||
- | ==== Domain ==== | + | |
- | + | ||
- | Unknown. | + | |
- | + | ||
- | ==== Size ==== | + | |
- | + | ||
- | HyDT-Bangla shows dependencies between chunks, not words. The node/tree ratio is thus much lower than in other treebanks. The ICON 2010 / CoNLL version contains 7252 chunk nodes (not tokens – see below) in 1129 trees, yielding 6.42 chunks per sentence on average (ICON 2010 data split: 6440 chunks / 979 sentences training, 812 chunks / 150 sentences test). | + | |
- | + | ||
- | According to the data description file supplied with the data, there are 980 (training only?) sentences with 10305 words, which yields 10.52 words per sentence on average. | + | |
- | + | ||
- | ==== References ==== | + | |
- | + | ||
- | * Website | + | |
- | * //no website dedicated to the treebank// | + | |
- | * [[http:// | + | |
- | * [[http:// | + | |
- | * Data | + | |
- | * //no separate citation// | + | |
- | * Principal publications | + | |
- | * Samar Husain: [[http:// | + | |
- | * Samar Husain, Prashanth Mannem, Bharat Ambati, Phani Gadde: //The ICON-2010 tools contest on Indian language dependency parsing.// In: [[http:// | + | |
- | * Documentation | + | |
- | * http:// | + | |
- | + | ||
- | ==== Inside ==== | + | |
- | + | ||
- | The text uses the [[http:// | + | |
- | + | ||
- | The CoNLL format contains only the chunk heads. The native SSF format shows the other words in the chunk, too, but it does not capture intra-chunk dependency relations. This is an example of a multi-word chunk: | + | |
- | + | ||
- | < | + | |
- | 3.1 | + | |
- | 3.2 | + | |
- | 3.3 | + | |
- | ))</ | + | |
- | + | ||
- | In the CoNLL format, the CPOS column contains the chunk label (e.g. '' | + | |
- | Occasionally there are '' | + | http://ufal.mff.cuni.cz/ |
- | The [[http:// | + | * [[user:zeman: |
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
+ | * [[user: | ||
- | Morphological annotation is manual or automatic? | + | ===== To Process ===== |
- | ==== Sample ==== | + | Ahoj, |
+ | stáhl jsem nový španělský závislostní korpus IULA (větší než AnCora) | ||
+ | / | ||
- | The first three sentences | + | License: |
+ | Web: http:// | ||
+ | Doc: http:// | ||
+ | Download: http:// | ||
+ | Parsing: | ||
+ | state-of-the-art LAS score is 94.7 using Mate-C | ||
+ | sentences | ||
+ | tokens | ||
- | | 1 | mAXabIlawA | mAXabIlawA | NP | NNP | lex-mAXabIlawA< | + | The sentences have been choosed from the IULA LSP corpus, automatically annotated with POS information and manually annotated with syntactical information using the DELPH-IN environment. The resulting syntactic analysis is automatically converted to dependencies and delivered using the CONLL format. |
- | | 2 | waKana | waKana | NP | PRP | lex-waKana< | + | |
- | | 3 | hAwera | hAwa | NP | NN | lex-hAwa< | + | |
- | | 4 | GadZi | GadZi | NP | NN | lex-GadZi< | + | |
- | | 5 | Kule | Kul | VGNF | VM | lex-Kul< | + | |
- | | 6 | tebile | tebila | NP | NN | lex-tebila< | + | |
- | | 7 | rAKaCila | rAK | VGF | VM | lex-rAK< | + | |
- | | |||||||||| | + | |
- | | 1 | sexike | sexika | NP | NN | lex-sexika< | + | |
- | | 2 | muKa | muKa | NP | NN | lex-muKa< | + | |
- | | 3 | PiriyZe | PiriyZe | VGNF | VM | lex-PiriyZe< | + | |
- | | 4 | balala | bal | VGF | VM | lex-bal< | + | |
- | | 5 | kAra | ke | NP | WQ | lex-ke< | + | |
- | | 6 | bAdZiwe | bAdZi | NP | NN | lex-bAdZi< | + | |
- | | 7 | kArA | ke | NP | WQ | lex-ke< | + | |
- | | 8 | ela | As | NP | WQ | lex-As< | + | |
- | | |||||||||| | + | |
- | | 1 | lokatA | loka | NP | NN | lex-loka< | + | |
- | | 2 | boXahayZa | boXahayZa | RBP | RB | lex-boXahayZa< | + | |
- | | 3 | mAJe | mAJe | NP | XC | lex-mAJe< | + | |
- | | 4 | BAdZA | BAdZA | NP | NN | lex-BAdZA< | + | |
- | | 5 | xeyZa | xe | VGF | VM | lex-xe< | + | |
+ | Martin |