[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
user:zeman:treebanks:ru [2012/01/13 17:49]
zeman References.
user:zeman:treebanks:ru [2012/01/13 21:49] (current)
zeman Data split.
Line 32: Line 32:
     * David Mareček, Natalia Kljueva: [[http://aclweb.org/anthology/W/W09/W09-4005.pdf|Converting Russian Treebank SynTagRus into Praguian PDT Style]]. In: Multilingual Resources, Technologies and Evaluation for Central and Eastern European Languages, pp. 26-31, Bulgaria, 2009.     * David Mareček, Natalia Kljueva: [[http://aclweb.org/anthology/W/W09/W09-4005.pdf|Converting Russian Treebank SynTagRus into Praguian PDT Style]]. In: Multilingual Resources, Technologies and Evaluation for Central and Eastern European Languages, pp. 26-31, Bulgaria, 2009.
   * Documentation   * Documentation
-    * Description of tags and feature values is hard to find; see also the [[#Inside|Inside section below]].+    * Daniel Zeman: {{:user:zeman:treebanks:russian_dependency_treebank.pdf|Russian Dependency Treebank}} //(written based on a Russian document pamjatka_korpus.doc)//, College Park, Maryland, USA, 2006
  
 ==== Domain ==== ==== Domain ====
  
-Newswire + unknown (“25000 word forms from EPEC (Aduriz et al., 2003) and 25000 word forms coming from newspapers that can be considered equivalent to the other corpora in the project [3LBi.eCatalan and Spanish]”; “EPECa corpus of written Basque tagged at morphological and syntactic levels for the automatic processing”).+Uppsala University Corpus of contemporary Russian prose (balanced fiction-journalistic, + small percentage of scientific and popular science). In addition, several hundred short texts published in 2001-2002 on various Internet news portals” (yandex.rurbc.rupolit.ru, lenta.rustrana.ru, news.ru etc.)
  
 ==== Size ==== ==== Size ====
  
-The CoNLL 2007 dataset was officially split into training and test partThe data split of BDT-II was provided by Koldo Gojenola and should correspond to data split used in parsing experiments published by the IXA Group. +There are 497,465 tokens in 34895 sentences, yielding 14.26 tokens per sentence on average. The original data was not split to training and test. In our HamleDT experiments, we take one file (''Выживший_камикадзе.tgt'', 402 sentences, 3458 tokens) as the test datawhile the rest serves for training.
- +
-^ Version ^ Train Sentences ^ Train Tokens ^ D-test Sentences ^ D-test Tokens ^ E-test Sentences ^ E-test Tokens ^ Total Sentences ^ Total Tokens ^ Sentence Length ^ +
-| CoNLL 2007 |  3190 |  50526 |  334 |  5390 |              |   3524 |    55916 |  15.87 | +
-| BDT-II |  9094 |  124,684 |  1010 |  12625 |  1122 |  14295 |  11226 |  151,604 |  13.50 |+
  
 ==== Inside ==== ==== Inside ====
  
-Both versions (CoNLL 2007 and BDT-IIare in the CoNLL 2006/2007 format.+The native file format of Syntagrus is the XML-based ''.tgt'' format. It uses the Windows-1251 encoding, which can be converted to UTF-8. Converting the file names is more of a challenge, depending on the file system (one typically gets a zipped archive containing files whose names use the Cyrillic alphabet, and the file system may store the names in a codepage different from Windows-1251).
  
-Part of speech tag description (obtained per e-mail from Koldo Gojenola, thanks!):+Morphological annotation has probably been done manually and it contains lemmas (uppercased). See references for a description of morphological tags (features) and syntactic tags (dependency relation labels). Note that the tags use the Cyrillic alphabet.
  
-  * IZE = noun +The syntactic trees do not contain punctuationPunctuation tokens have not been removed but they do not have independent nodes in the trees.
-    * ARR = common +
-    * IZB = proper name +
-    * LIB = place name +
-    * ZKI = number +
-  * ADJ = adjective +
-    * ARR = common +
-    * GAL = question +
-  * ADI = verb +
-    * SIN = simple +
-    * ADK = composed +
-    * ADP = periphrastic +
-    * FAK = factitive +
-  * ADB = adverb +
-    * ARR = common +
-    * GAL = question +
-  * DET = determiner +
-    * ERKARR = demonstrative common +
-    * ERKIND = demonstrative emphatic +
-    * NOLARR = indefinite common +
-    * NOLGAL = indefinite question +
-    * ZNB = number +
-    * DZH = definite +
-    * BAN = distributive +
-    * ORD = ordinal +
-    * DZG = indefinite +
-    * ORO = general +
-  * IOR = pronoun +
-    * PERARR = personal common +
-    * PERIND = personal emphatic +
-    * IZGMGB = indefinite +
-    * IZGGAL = question +
-    * BIH = ??? +
-    * ELK = ??? +
-  * LOT = link +
-    * LOK = connector +
-    * JNT = conjunction +
-  * PRT = particle +
-  * ITJ = interjection +
-  * BST = other +
-  * ADL = auxiliary verb +
-  * ADT = synthetic verb +
-  * SIG = acronym +
-  * SNB = symbol +
-  * LAB = abbreviation +
- +
-Main features: +
- +
-  * KAS = caseVarious descriptions of Basque grammar list different numbers of cases and it is not easy to match all of the BDT case tags with them. Some but not all of them are described in the Annex 3 of the technical report mentioned above. The following list gives all case tags occurring in BDT with their frequencies in brackets. +
-    * KAS:ABL (984) = ablativo = ablative +
-    * KAS:ABS (22805) = absolutivo = absolutive +
-    * KAS:ABU (32) = adlativo terminal ("-raino") = "until, as far as" = terminative +
-    * KAS:ABZ (27) = adlativo direccional ("-rantz") = "towards" ~ lative? +
-    * KAS:ALA (1093) = adlativo = allative +
-    * KAS:BNK (13) =? special case of the locative genitive ("-ko", "-eko"+
-    * KAS:DAT (1451) = dativo = dative +
-    * KAS:DES (181) = destinativo = benefactive ("-entzat"+
-    * KAS:DESK (223) =? descriptive locative genitive ("-ko", "-eko"), also frequently used for counted noun after numeral +
-    * KAS:EM (705) = multiword token with postposition (e.g. "_gabe", "_arabera", "_batera", "_bezala"...) +
-    * KAS:ERG (6059) = ergativo = ergative +
-    * KAS:GEL (6259) = genitivo locativo = locative genitive +
-    * KAS:GEN (4307) = genitivo de posesión = possessive genitive +
-    * KAS:INE (7690) = inesivo = inessive +
-    * KAS:INS (1370) = instrumental +
-    * KAS:MOT (165) = motivativo = causative +
-    * KAS:PAR (930) = partitivo = partitive +
-    * KAS:PRO (89) = prolativo = essive +
-    * KAS:SOZ (928) = asociativo = comitative +
-  * ASP = aspect +
-  * ERL = relation (relative sentence, completive sentence, indirect question...) +
- +
-List of all 286 features found in the corpus with frequencies: +
-  * ADM:ADIZE 3612 +
-  * ADM:ADOIN 2919 +
-  * ADM:PART 14711 +
-  * ASP:BURU 7491 +
-  * ASP:EZBU 2421 +
-  * ASP:GERO 2166 +
-  * ASP:PNT 6631 +
-  * BIZ:+ 2303 +
-  * BIZ:- 22116 +
-  * ENT:??? 35 +
-  * ENT:Erakundea 3499 +
-  * ENT:Pertsona 4401 +
-  * ENT:Tokia 3949 +
-  * ERL:AURK 1264 +
-  * ERL:BALD 332 +
-  * ERL:DENB 390 +
-  * ERL:EMEN 5969 +
-  * ERL:ERLT 1531 +
-  * ERL:ESPL 129 +
-  * ERL:HAUT 408 +
-  * ERL:HELB 925 +
-  * ERL:KAUS 864 +
-  * ERL:KONPL 2614 +
-  * ERL:KONT 215 +
-  * ERL:MOD 1152 +
-  * ERL:MOD/DENB 244 +
-  * ERL:MOS 146 +
-  * ERL:ONDO 160 +
-  * ERL:ZHG 232 +
-  * HIT:NO 50 +
-  * HIT:TO 38 +
-  * IZAUR:+ 1499 +
-  * IZAUR:- 5930 +
-  * KAS:ABL 984 +
-  * KAS:ABS 22807 +
-  * KAS:ABU 32 +
-  * KAS:ABZ 27 +
-  * KAS:ALA 1094 +
-  * KAS:BNK 13 +
-  * KAS:DAT 1451 +
-  * KAS:DES 181 +
-  * KAS:DESK 223 +
-  * KAS:EM 707 +
-  * KAS:ERG 6059 +
-  * KAS:GEL 6266 +
-  * KAS:GEN 4307 +
-  * KAS:INE 7693 +
-  * KAS:INS 1370 +
-  * KAS:MOT 165 +
-  * KAS:PAR 930 +
-  * KAS:PRO 89 +
-  * KAS:SOZ 928 +
-  * KLM:AM 80 +
-  * KLM:HAS 2 +
-  * MAI:GEHI 38 +
-  * MAI:IND 36 +
-  * MAI:KONP 244 +
-  * MAI:SUP 406 +
-  * MDN:A1 11766 +
-  * MDN:A3 107 +
-  * MDN:A4 1 +
-  * MDN:A5 282 +
-  * MDN:B1 6666 +
-  * MDN:B2 185 +
-  * MDN:B3 11 +
-  * MDN:B4 59 +
-  * MDN:B5A 1 +
-  * MDN:B5B 27 +
-  * MDN:B6 1 +
-  * MDN:B7 79 +
-  * MDN:B8 38 +
-  * MDN:C 52 +
-  * MOD:EGI 2244 +
-  * MOD:ZIU 126 +
-  * MTKAT:LAB 16 +
-  * MTKAT:SIG 696 +
-  * MTKAT:SNB 22 +
-  * MUG:M 42116 +
-  * MUG:MG 8449 +
-  * MW:B 3615 +
-  * NEUR:- 193 +
-  * NMG:MG 1055 +
-  * NMG:P 2690 +
-  * NMG:S 2156 +
-  * NOR:GU 223 +
-  * NOR:HAIEK 4248 +
-  * NOR:HI 20 +
-  * NOR:HURA 14342 +
-  * NOR:NI 337 +
-  * NOR:ZU 93 +
-  * NOR:ZUEK 12 +
-  * NORI:GURI 124 +
-  * NORI:HAIEI 306 +
-  * NORI:HARI 1085 +
-  * NORI:HIRI-NO 2 +
-  * NORI:HIRI-TO 5 +
-  * NORI:NIRI 152 +
-  * NORI:ZUEI 12 +
-  * NORI:ZURI 39 +
-  * NORK:GUK 721 +
-  * NORK:HAIEK-K 2618 +
-  * NORK:HARK 5981 +
-  * NORK:HIK 6 +
-  * NORK:HIK-NO 10 +
-  * NORK:HIK-TO 8 +
-  * NORK:NIK 662 +
-  * NORK:ZUEK-K 46 +
-  * NORK:ZUK 208 +
-  * NUM:P 9347 +
-  * NUM:PH 172 +
-  * NUM:S 32570 +
-  * PER:GU 242 +
-  * PER:HAIEK 93 +
-  * PER:HI 14 +
-  * PER:HURA 1 +
-  * PER:NI 290 +
-  * PER:ZU 60 +
-  * PER:ZUEK 29 +
-  * PLU:+ 149 +
-  * PLU:- 10257 +
-  * POS:+ 2353 +
-  * POS:POSAldeko 2 +
-  * POS:POSAurkako 1 +
-  * POS:POSGabeko 1 +
-  * POS:POSInguruko 1 +
-  * POS:POSKontrako 2 +
-  * POS:POSaintzinean 1 +
-  * POS:POSaitzina 2 +
-  * POS:POSaitzinean 5 +
-  * POS:POSaitzineko 2 +
-  * POS:POSaitzinetik 3 +
-  * POS:POSalboan 2 +
-  * POS:POSaldamenetik 1 +
-  * POS:POSalde 38 +
-  * POS:POSaldean 11 +
-  * POS:POSaldeaz 1 +
-  * POS:POSaldeko 37 +
-  * POS:POSaldera 20 +
-  * POS:POSalderat 1 +
-  * POS:POSaldetik 25 +
-  * POS:POSantzean 1 +
-  * POS:POSantzeko 9 +
-  * POS:POSantzekoa 2 +
-  * POS:POSantzera 3 +
-  * POS:POSarabera 135 +
-  * POS:POSaraberako 1 +
-  * POS:POSarte 82 +
-  * POS:POSartean 158 +
-  * POS:POSarteetik 1 +
-  * POS:POSarteko 108 +
-  * POS:POSartekoak 1 +
-  * POS:POSat 6 +
-  * POS:POSatzean 15 +
-  * POS:POSatzeko 6 +
-  * POS:POSatzera 1 +
-  * POS:POSatzetik 12 +
-  * POS:POSaurka 103 +
-  * POS:POSaurkaa 1 +
-  * POS:POSaurkako 48 +
-  * POS:POSaurrean 74 +
-  * POS:POSaurreko 10 +
-  * POS:POSaurrera 36 +
-  * POS:POSaurrerako 2 +
-  * POS:POSaurretik 26 +
-  * POS:POSazpian 9 +
-  * POS:POSazpitik 6 +
-  * POS:POSbaitan 12 +
-  * POS:POSbarik 2 +
-  * POS:POSbarna 1 +
-  * POS:POSbarnean 11 +
-  * POS:POSbarneko 2 +
-  * POS:POSbarnera 1 +
-  * POS:POSbarrena 4 +
-  * POS:POSbarrenean 1 +
-  * POS:POSbarru 7 +
-  * POS:POSbarruan 37 +
-  * POS:POSbarruetatik 1 +
-  * POS:POSbarruko 3 +
-  * POS:POSbarrura 1 +
-  * POS:POSbarrutik 2 +
-  * POS:POSbatera 42 +
-  * POS:POSbatera— 1 +
-  * POS:POSbegira 31 +
-  * POS:POSbehera 11 +
-  * POS:POSbestaldean 1 +
-  * POS:POSbezala 75 +
-  * POS:POSbezalako 15 +
-  * POS:POSbezalakoa 1 +
-  * POS:POSbezalakoen 1 +
-  * POS:POSbidez 45 +
-  * POS:POSbila 20 +
-  * POS:POSbitarte 2 +
-  * POS:POSbitartean 18 +
-  * POS:POSbitarteko 5 +
-  * POS:POSbitarterako 1 +
-  * POS:POSbitartez 13 +
-  * POS:POSburuan 7 +
-  * POS:POSburuz 47 +
-  * POS:POSburuzko 36 +
-  * POS:POSeran 1 +
-  * POS:POSerdian 11 +
-  * POS:POSerdiko 1 +
-  * POS:POSerdira 3 +
-  * POS:POSerditan 1 +
-  * POS:POSeske 2 +
-  * POS:POSesker 30 +
-  * POS:POSesku 12 +
-  * POS:POSeskuetan 5 +
-  * POS:POSeskuko 1 +
-  * POS:POSeskutik 6 +
-  * POS:POSezean 4 +
-  * POS:POSgabe 74 +
-  * POS:POSgabeko 17 +
-  * POS:POSgain 36 +
-  * POS:POSgaindi 1 +
-  * POS:POSgaindiko 1 +
-  * POS:POSgainean 33 +
-  * POS:POSgaineko 12 +
-  * POS:POSgainera 9 +
-  * POS:POSgainerat 1 +
-  * POS:POSgainetik 16 +
-  * POS:POSgero 1 +
-  * POS:POSgeroztik 18 +
-  * POS:POSgertu 4 +
-  * POS:POSgibeleko 1 +
-  * POS:POSgibeletik 2 +
-  * POS:POSgisa 34 +
-  * POS:POSgisako 1 +
-  * POS:POSgisan 2 +
-  * POS:POSgisara 1 +
-  * POS:POSgoiko 1 +
-  * POS:POSgoitik 1 +
-  * POS:POSgora 30 +
-  * POS:POSgorago 1 +
-  * POS:POSgorako 7 +
-  * POS:POSgorakoen 1 +
-  * POS:POShurbil 8 +
-  * POS:POShurrean 1 +
-  * POS:POSinguru 16 +
-  * POS:POSingurua 1 +
-  * POS:POSinguruan 77 +
-  * POS:POSinguruetako 1 +
-  * POS:POSinguruetan 2 +
-  * POS:POSinguruetara 1 +
-  * POS:POSinguruko 27 +
-  * POS:POSingurura 5 +
-  * POS:POSingururako 1 +
-  * POS:POSirian 1 +
-  * POS:POSkanpo 28 +
-  * POS:POSkanpoko 12 +
-  * POS:POSkanpora 4 +
-  * POS:POSkontra 72 +
-  * POS:POSkontrako 38 +
-  * POS:POSlanda 7 +
-  * POS:POSlandara 2 +
-  * POS:POSlegez 1 +
-  * POS:POSlekuan 4 +
-  * POS:POSlepora 1 +
-  * POS:POSmendean 1 +
-  * POS:POSmenpe 8 +
-  * POS:POSmenpera 1 +
-  * POS:POSmoduan 1 +
-  * POS:POSmodura 1 +
-  * POS:POSondoan 19 +
-  * POS:POSondoko 1 +
-  * POS:POSondora 1 +
-  * POS:POSondoren 32 +
-  * POS:POSondorengo 2 +
-  * POS:POSondotik 14 +
-  * POS:POSordez 9 +
-  * POS:POSostean 17 +
-  * POS:POSosteko 1 +
-  * POS:POSpare 1 +
-  * POS:POSparean 5 +
-  * POS:POSpareko 2 +
-  * POS:POSpartean 3 +
-  * POS:POSpartez 1 +
-  * POS:POSpean 1 +
-  * POS:POStruke 9 +
-  * POS:POSurrun 3 +
-  * POS:POSurruti 3 +
-  * POS:POSzai 2 +
-  * POS:POSzain 12 +
-  * POS:POSzehar 42 +
-  * ZENB:- 192 +
-  * _ 36940 +
- +
-The syntactic guidelines (structure and labels) are described in Spanish in this [[http://ixa.si.ehu.es/Ixa/Argitalpenak/Barne_txostenak/1068549887/publikoak/guia.pdf|technical report]]. See Appendix 3 for some lists of tags. +
- +
-Multi-word expressions have been collapsed into one token, using underscore as the joining character (e.g. Espainia_Poliziak, iduri_zait).+
  
 ==== Sample ==== ==== Sample ====
  
-The first sentence of the CoNLL 2007 training data:+The first sentence of our test file in the native TGT format:
  
-| 1 | espainiako_poliziak | Espainia_Poliziak | IZE | IZE_LIB | PLU-<nowiki>|</nowiki>ENTI_LOC | 4 | ncsubj | _ | _ | +<code xml><?xml version="1.0" encoding="windows-1251"?
-| 2 | hiru | hiru | DET | DET_DZH | NMGP | 3 | detmod | _ | _ | +<text><inf
-| 3 | gazte | gazte | IZE | IZE_ARR | ABS<nowiki>|</nowiki>MG | 4 | ncobj | _ | _ | +<author>ЛТЕЛЕНЬ</author
-| 4 | atxilotu | atxilotu | ADI | ADI_SIN | PART<nowiki>|</nowiki>BURU | 8 | lot | _ | _ | +<title>Интервью "МН" ЕГайдара</title
-| 5 | ditu | *edun | ADL | ADL | A1<nowiki>|</nowiki>NR_HAIEK<nowiki>|</nowiki>NK_HARK | 4 | auxmod | _ | _ | +<source/> 
-| 6 | atarrabian | Atarrabia | IZE | IZE_LIB | PLU-<nowiki>|</nowiki>INE<nowiki>|</nowiki>NUMS<nowiki>|</nowiki>MUGM<nowiki>|</nowiki>ENTI_LOC | 4 | ncmod | _ | _ | +<annot>ЛИ</annot
-| 7 | | , | PUNC | PUNC_KOMA | _ | 6 | PUNC | _ | _ | +<editor>ИБ</editor
-| 8 | eta | eta | LOT | LOT_JNT | - | 0 | ROOT | _ | _ | +<date>10.12.03</date
-| 9 | madrilera | Madril | IZE | IZE_LIB | PLU-<nowiki>|</nowiki>ALA<nowiki>|</nowiki>NUMS<nowiki>|</nowiki>MUGM<nowiki>|</nowiki>ENTI_LOC | 10 | ncmod | _ | _ | +<comment/> 
-| 10 | eraman | eraman | ADI | ADI_SIN | PART<nowiki>|</nowiki>BURU | 8 | lot | _ | _ | +</inf
-| 11 | ditu | *edun | ADL | ADL | A1<nowiki>|</nowiki>NR_HAIEK<nowiki>|</nowiki>NK_HARK | 10 | auxmod | _ | _ | +<body
-| 12 | | . | PUNC | PUNC_PUNC | _ | 11 | PUNC | _ | _ | +<S ID="1"
- +<W DOM="3" EXTRAFEAT="CAP" FEAT="S ЕД МУЖ ИМ ОД" ID="1" LEMMA="ЕГОР" LINK="предик">Егор</W>  
-The first sentence of the CoNLL 2007 test data: +<W DOM="1" EXTRAFEAT="CAP" FEAT="ЕД МУЖ ИМ ОД" ID="2" LEMMA="ГАЙДАР" LINK="аппоз">Гайдар</W>  
- +<W DOM="_root" EXTRAFEAT="ЛИЧ" FEAT="V НЕСОВ ИЗЪЯВ ПРОШ ЕД МУЖ" ID="3" LEMMA="ВОЗГЛАВЛЯТЬ">возглавлял</W>  
-| 1 | epaileek | epaile | IZE | IZE_ARR | BIZ+<nowiki>|</nowiki>ERG<nowiki>|</nowiki>NUMP<nowiki>|</nowiki>MUGM | +<W DOM="6" FEAT="A ЕД СРЕД ВИН" ID="4" LEMMA="ПЕРВЫЙ" LINK="опред">первое</W>  
-| 2 | diote | esan | ADT | ADT | PNT<nowiki>|</nowiki>A1<nowiki>|</nowiki>NR_HURA<nowiki>|</nowiki>NK_HAIEK-K | +<W DOM="6" FEAT="A ЕД СРЕД ВИН" ID="5" LEMMA="РОССИЙСКИЙ" LINK="опред">российское</W>  
-| 3 | eaeko | EAE | IZE | IZE_LIB | SIG<nowiki>|</nowiki>GEL<nowiki>|</nowiki>NUMS<nowiki>|</nowiki>MUGM<nowiki>|</nowiki>ENTI_LOC | +<W DOM="3" FEAT="ЕД СРЕД ВИН НЕОД" ID="6" LEMMA="ПРАВИТЕЛЬСТВО" LINK="1-компл">правительство</W> 
-| 4 | parlamentarioek | parlamentario | ADJ | ADJ_ARR | IZAUR-<nowiki>|</nowiki>ERG<nowiki>|</nowiki>NUMP<nowiki>|</nowiki>MUGM | +<W DOM="8" FEAT="ЕД СРЕД ВИН" ID="7" LEMMA="КОТОРЫЙ" LINK="1-компл">которое</W>  
-| 5 | eaetik_kanpo | EAE | SIG | SIG- | DEK<nowiki>|</nowiki>NUMS<nowiki>|</nowiki>MUGM<nowiki>|</nowiki>DEK<nowiki>|</nowiki>ABL_kanpo_ABS<nowiki>|</nowiki>ENTI_LOC<nowiki>|</nowiki>POS | +<W DOM="6" EXTRAFEAT="ЛИЧ" FEAT="V НЕСОВ ИЗЪЯВ ПРОШ МН" ID="8" LEMMA="НАЗЫВАТЬ" LINK="релят">называли</W>  
-| 6 | eginiko | egin | ADI | ADI_SIN | PART<nowiki>|</nowiki>GEL | +<W DOM="8" FEAT="ЕД СРЕД ТВОР НЕОД" ID="9" LEMMA="ПРАВИТЕЛЬСТВО" LINK="2-компл">правительством</W>  
-| 7 | delituak | delitu | IZE | IZE_ARR | BIZ-<nowiki>|</nowiki>ABS<nowiki>|</nowiki>NUMP<nowiki>|</nowiki>MUGM | +<W DOM="9" FEAT="ЕД МУЖ РОД ОД" ID="10" LEMMA="КАМИКАДЗЕ" LINK="квазиагент">камикадзе</W> 
-| 8 | ikertzea | ikertu | ADI | ADI_SIN | ADIZE<nowiki>|</nowiki>KONPL<nowiki>|</nowiki>ABS | +</S></code>
-| 9 | eta | eta | LOT | LOT_JNT | - | +
-10 | epaitzea | epaitu | ADI | ADI_SIN | ADIZE<nowiki>|</nowiki>KONPL<nowiki>|</nowiki>ABS | +
-| 11 | auzitegi_gorenari | auzitegi_gora | ADJ | ADJ_IZO | DEK<nowiki>|</nowiki>GEN<nowiki>|</nowiki>NUMP<nowiki>|</nowiki>MUGM<nowiki>|</nowiki>DEK<nowiki>|</nowiki>DAT<nowiki>|</nowiki>NUMS<nowiki>|</nowiki>MUGM<nowiki>|</nowiki>ENTI_LOC | +
-12 | dagokiola | egon | ADT | ADT | PNT<nowiki>|</nowiki>KONPL<nowiki>|</nowiki>A1<nowiki>|</nowiki>NR_HURA<nowiki>|</nowiki>NI_HARI | +
-| 13 | , | , | PUNC | PUNC_KOMA | _ | +
-| 14 | baina | baina | LOT | LOT_JNT | AURK | +
-| 15 | atzerrian | atzerri | IZE | IZE_ARR | INE<nowiki>|</nowiki>NUMS<nowiki>|</nowiki>MUGM | +
-| 16 | izaniko | izan | ADI | ADI_SIN | PART<nowiki>|</nowiki>GEL | +
-| 17 | kontaktu | kontaktu | IZE | IZE_ARR | _ | +
-| 18 | horiek | horiek | DET | DET_ERKARR | ABS<nowiki>|</nowiki>NUMP<nowiki>|</nowiki>MUGM | +
-| 19 | ezin_direla | ezin_izan | ADI | ADI_ADK | PNT<nowiki>|</nowiki>KONPL<nowiki>|</nowiki>A1<nowiki>|</nowiki>NR_HAIEK<nowiki>|</nowiki>MWCorrect | +
-| 20 | delitutzat | delitu | IZE | IZE_ARR | BIZ-<nowiki>|</nowiki>PRO<nowiki>|</nowiki>MG | +
-| 21 | hartu | hartu | ADI | ADI_SIN | PART | +
-| 22 | . | . | PUNC | PUNC_PUNC | _ | +
- +
-The first sentence of the BDT-II training data: +
- +
-| Estatu_Batuetako_DEAko | Estatu_Batuak_DEA | IZE | LIB | PLU:+<nowiki>|</nowiki>IZAUR:-<nowiki>|</nowiki>KAS:GEL<nowiki>|</nowiki>NUM:P<nowiki>|</nowiki>MUG:M<nowiki>|</nowiki>MW:B<nowiki>|</nowiki>ENT:Erakundea | 2 | ncmod | _ | _ | +
-| 2 | buru | buru | IZE | ARR | _ | 4 | ncsubj | _ | _ | +
-| 3 | ohiak | ohi | ADJ | ARR | IZAUR:-<nowiki>|</nowiki>KAS:ERG<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 2 | ncmod | _ | _ | +
-| 4 | aztertuko | aztertu | ADI | SIN | ADM:PART<nowiki>|</nowiki>ASP:GERO | 0 | ROOT | _ | _ | +
-| 5 | du | *edun | ADL | ADL | MDN:A1<nowiki>|</nowiki>NOR:HURA<nowiki>|</nowiki>NORK:HARK | | auxmod | _ | _ | +
-| 6 | RUCen | RUC | IZE | IZB | MTKAT:SIG<nowiki>|</nowiki>KAS:GEN<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M<nowiki>|</nowiki>ENT:Erakundea | 7 | ncmod | _ | _ | +
-| 7 | erreforma | erreforma | IZE | ARR | KAS:ABS<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 4 | ncobj | _ | _ | +
-| 8 | . | . | PUNT_MARKA | PUNT_PUNT | _ | 7 | PUNC | _ | _ | +
- +
-The first sentence of the BDT-II development data: +
- +
-| 1 | Irakaskuntzan | irakaskuntza | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:INE<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 2 | ncmod | _ | _ | +
-| 2 | jardun | jardun | ADI | SIN | ADM:PART<nowiki>|</nowiki>ASP:BURU | 0 | ROOT | _ | _ | +
-| zuen | *edun | ADL | ADL | MDN:B1<nowiki>|</nowiki>NOR:HURA<nowiki>|</nowiki>NORK:HARK | 2 | auxmod | _ | _ | +
-| 4 | Miel | Miel | IZE | IZB | PLU:-<nowiki>|</nowiki>ENT:Pertsona | 5 | entios | _ | _ | +
-| 5 | Anjel_Elustondok | Anjel_Elustondo | IZE | IZB | PLU:-<nowiki>|</nowiki>KAS:ERG<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M<nowiki>|</nowiki>ENT:Pertsona | 2 | ncsubj | _ | _ | +
-| 1980 | 1980 | IZE | ZKI | _ | 7 | ncmod | _ | _ | +
-| 7 | urtetik | urte | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:ABL<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 2 | ncmod | _ | _ | +
-| 8 | 1992ra | 1992 | IZE | ZKI | KAS:ALA<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 2 | ncmod | _ | _ | +
-| 9 | , | , | PUNT_MARKA | PUNT_KOMA | _ | | PUNC | _ | _ | +
-| 10 | hauetatik | hauek | DET | ERKARR | KAS:ABL<nowiki>|</nowiki>NUM:P<nowiki>|</nowiki>MUG:M | 16 | ncmod | _ | _ | +
-| 11 | hamar | hamar | DET | DZH | NMG:P | 12 | detmod | _ | _ | +
-| 12 | urtez | urte | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:INS<nowiki>|</nowiki>MUG:MG | 16 | lot | _ | _ | +
-| 13 | Azpeitiko | Azpeitia | IZE | LIB | PLU:-<nowiki>|</nowiki>KAS:GEL<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M<nowiki>|</nowiki>ENT:Tokia | 14 | ncmod | _ | _ | +
-| 14 | ikastolan | ikastola | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:INE<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 16 | ncmod | _ | _ | +
-| 15 | irakasle | irakasle | IZE | ARR | KAS:ABS<nowiki>|</nowiki>MUG:MG | 16 | ncpred | _ | _ | +
-| 16 | eta | eta | LOT | JNT | ERL:EMEN | | aponcmod | _ | _ | +
-| 17 | beste | beste | DET | DZG | _ | 18 | detmod | _ | _ | +
-| 18 | biak | bi | IZE | ZKI | KAS:ABS<nowiki>|</nowiki>NUM:P<nowiki>|</nowiki>MUG:M | 16 | lot | _ | _ | +
-| 19 | , | , | PUNT_MARKA | PUNT_KOMA | _ | 18 | PUNC | _ | _ | +
-| 20 | Arabako | Araba | IZE | LIB | PLU:-<nowiki>|</nowiki>KAS:GEL<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M<nowiki>|</nowiki>ENT:Tokia | 21 | ncmod | _ | _ | +
-| 21 | ikastolen | ikastola | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:GEN<nowiki>|</nowiki>NUM:P<nowiki>|</nowiki>MUG:M | 22 | ncmod | _ | _ | +
-| 22 | elkartean | elkarte | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:INE<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 16 | ncmod | _ | _ | +
-| 23 | . | . | PUNT_MARKA | PUNT_PUNT | _ | 22 | PUNC | _ | _ | +
- +
-The first sentence of the BDT-II test data: +
- +
-| 1 | Hegoaldean | hegoalde | IZE | ARR | KAS:INE<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | | ncmod | _ | _ | +
-| 2 | iduri_zait | iduri_izan | ADI | ADK | ASP:PNT<nowiki>|</nowiki>MDN:A1<nowiki>|</nowiki>NOR:HURA<nowiki>|</nowiki>NORI:NIRI<nowiki>|</nowiki>MW:B | 0 | ROOT | _ | _ | +
-| 3 | euskararen | euskara | IZE | ARR | BIZ:-<nowiki>|</nowiki>KAS:GEN<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 4 | ncmod | _ | _ | +
-| 4 | mundu | mundu | IZE | ARR | BIZ:- | 7 | ncsubj | _ | _ | +
-| 5 | hau | hau | DET | ERKARR | KAS:ABS<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 4 | detmod | _ | _ | +
-| 6 | adi-adi | adi-adi | ADB | ARR | _ | 7 | ncmod | _ | _ | +
-| 7 | dagola | egon | ADT | ADT | ASP:PNT<nowiki>|</nowiki>ERL:KONPL<nowiki>|</nowiki>MDN:A3<nowiki>|</nowiki>NOR:HURA | 2 | ccomp_obj | _ | _ | +
-| 8 | , | , | PUNT_MARKA | PUNT_KOMA | _ | 7 | PUNC | _ | _ | +
-| Euskaltzaindiak | Euskaltzaindia | IZE | LIB | PLU:-<nowiki>|</nowiki>KAS:ERG<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M<nowiki>|</nowiki>ENT:Tokia | 11 | ncsubj | _ | _ | +
-10 | zer | zer | DET | NOLGAL | NMG:MG<nowiki>|</nowiki>KAS:ABS<nowiki>|</nowiki>MUG:MG | 11 | ncobj | _ | _ | +
-| 11 | erranen | erran | ADI | SIN | ADM:PART<nowiki>|</nowiki>ASP:GERO | 13 | menos | _ | _ | +
-| 12 | duen | *edun | ADL | ADL | ERL:ZHG<nowiki>|</nowiki>MDN:A1<nowiki>|</nowiki>NOR:HURA<nowiki>|</nowiki>NORK:HARK | 11 | auxmod | _ | _ | +
-| 13 | zain | zain | ADB | ARR | _ | 7 | cmod | _ | _ | +
-| 14 | , | , | PUNT_MARKA | PUNT_KOMA | _ | 13 | PUNC | _ | _ | +
-| 15 | haren | hura | DET | ERKARR | KAS:GEN<nowiki>|</nowiki>NUM:S<nowiki>|</nowiki>MUG:M | 16 | ncmod | _ | _ | +
-| 16 | arauen | arau | IZE | ARR | KAS:ABS<nowiki>|</nowiki>MUG:MG | 18 | ncmod | _ | _ | +
-| 17 | berehala | berehala | ADB | ARR | _ | 18 | ncmod | _ | _ | +
-| 18 | betetzeko | bete | ADI | SIN | ADM:ADIZE<nowiki>|</nowiki>ERL:HELB<nowiki>|</nowiki>KAS:ABS<nowiki>|</nowiki>MUG:MG | 7 | xmod | _ | _ | +
-| 19 | . | . | PUNT_MARKA | PUNT_PUNT | _ | 18 | PUNC | _ | _ |+
  
 ==== Parsing ==== ==== Parsing ====
  
-BDT is a mildly nonprojective treebank1925 of the 151,604 tokens of combined BDT-II training and test sets are attached nonprojectively (1.27%). +Nonprojectivities in SynTagRus are not frequentOnly 4146 of the 497,465 tokens are attached nonprojectively (0.83%).
- +
-The results of the CoNLL 2007 shared task are [[http://nextens.uvt.nl/depparse-wiki/AllScores|available online]]. They have been published in [[http://aclweb.org/anthology-new/D/D07/D07-1096.pdf|(Nivre et al., 2007)]]. The evaluation procedure was changed to include punctuation tokens. These are the best results for Basque:+
  
-^ Parser (Authors) ^ LAS ^ UAS ^ +Parsing results have been published by [[http://aclweb.org/anthology-new/C/C08/C08-1081.pdf|Nivre, Boguslavsky and Iomdin (2008)]] (note that they used different training-test data split from ours):
-| Malt (Nilsson et al.) | 76.94 82.84 | +
-| Titov et al. | 75.49 | 81.93 | +
-| Sagae | 74.64 | 81.19 | +
-| Carreras | 75.75 | 81.11 | +
-| Nakagawa | 72.56 | 81.04 | +
-| Malt (J. Hall et al.| 74.99 | 80.61 | +
-| Johansson et al. | 75.08 | 80.43 |+
  
-The two Malt parser results of 2007 (single malt and blended) are described in [[http://aclweb.org/anthology-new/D/D07/D07-1097.pdf|(Hall et al., 2007)]] and the details about the parser configuration are described [[http://w3.msi.vxu.se/users/jha/conll07/|here]].+^ Parser ^ LAS ^ UAS ^ 
 +Malt | 82.89.|
  
-Parsing results on BDT-II have been published in Kepa Bengoetxea, Koldo Gojenola: [[http://aclweb.org/anthology-new/W/W10/W10-1404.pdf|Application of Different Techniques to Dependency Parsing of Basque]]. In: Proceedings of the First Workshop on Statistical Parsing of Morphologically Rich Languages (SPMRL 2010), NAACL Workshop, Los Angeles, California, USA, 2010. They report only Labeled Attachment Score (LAS) and their best system achieved LAS = 78.98%. 

[ Back to the navigation ] [ Back to the content ]