[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » user » zeman » treebanks » hr

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
user:zeman:treebanks:hr [2014/07/17 21:16]
zeman 		user:zeman:treebanks:hr [2014/07/28 16:31] (current)
zeman Documentation of syntactic tags.
Line 28: Line 28:
   * Documentation   * Documentation
     * [[http://nlp.ffzg.hr/data/tagging/msd-hr.html|Multext-East v5 Croatian Tagset]], 2013.     * [[http://nlp.ffzg.hr/data/tagging/msd-hr.html|Multext-East v5 Croatian Tagset]], 2013.
 +    * A discussion of the syntactic tags is in Danijela Merkler, Željko Agić, Ana Agić: [[http://www.sciencedirect.com/science/article/pii/S1877042813041931#|Babel Treebank of Public Messages in Croatian]]. In: Procedia – Social and Behavioral Sciences, vol. 95, pp. 490-497, 2013.
  
 ==== Domain ==== ==== Domain ====
Line 38: Line 39:
  
 The improved pre-release version contains 83640 tokens in 3736 sentences, yielding 22.39 tokens per sentence on average. The improved pre-release version contains 83640 tokens in 3736 sentences, yielding 22.39 tokens per sentence on average.
 +
 +There is no official training-test division of the original data. For HamleDT, we have split the data 90:10, i.e. the first 3362 sentences (75236 tokens) for training and the remaining 374 sentences (8404 tokens) for testing.
  
 ==== Inside ==== ==== Inside ====
Line 70: Line 73:
 (The sum of the percentages exceeds 100% because of rounding.) (The sum of the percentages exceeds 100% because of rounding.)
  
-==== XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX ==== +=== Cycles ===
-==== Sample ====+
  
-The first three sentences of the CoNLL 2006 training data:+Eight dependency graphs in the pre-release version contain cycles. Most of the time these are individual nodes attached to themselves (according to Željko, this is the default in the annotation software, thus the annotator probably just forgot to attach the nodes). Five of them are punctuation nodes and fixing the attachment should be relatively easy. The only complicated case is the sentence #25 in the test file. Its dependency graph is wrong at multiple spots.
  
-| 1 | Глава | _ | N | Nc | _ | 0 | ROOT | 0 | ROOT | +train/006#247:a 
-| 2 | трета | _ | M | Mo | gen=f<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 1 | mod | 1 | mod | +Analitičari upozoravaju na kosovski trend: osnivanje novih političkih stranaka neposredno prije izbora, a od strane ljudi iz već postojećih političkih stranaka ili nekog drugog aspekta javnog života. 
-| |||||||||| + 
-| 1 | НАРОДНО | _ | A | An | gen=n<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 2 | mod | 2 | mod | +train/006#381:mnogo 
-| 2 | СЪБРАНИЕ | _ | N | Nc | gen=n<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 0 | ROOT | 0 | ROOT | +"Ne možemo mnogo učiniti kako bismo je spriječili da ide malo šetati ili plivati. 
-| |||||||||| + 
-| 1 | Народното | _ | A | An | gen=n<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=d | 2 | mod | 2 | mod | +train/006#399:, 
-| 2 | събрание | _ | N | Nc | gen=n<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 3 | subj | 3 | subj | +U međuvremenu, troškovi života porasli su: najamnina za mali stan u Podgorici iznosi oko 200 eura mjesečno -- što mnogima otežava spajanje kraja s krajem. 
-| 3 | осъществява | _ | V | Vpi | trans=t<nowiki>|</nowiki>mood=i<nowiki>|</nowiki>tense=r<nowiki>|</nowiki>pers=3<nowiki>|</nowiki>num=s | 0 | ROOT | 0 | ROOT | + 
-| 4 | законодателната | _ | A | Af | gen=f<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=d | 5 | mod | 5 | mod | +train/007#6:" 
-| 5 | власт | _ | N | Nc | _ | 3 | obj | 3 | obj | +"Nije riječ o tome da imamo jednu političku opciju koja tvrdi kako piramidu ne bi trebalo uništiti, dok druga smatra da je treba uništiti. 
-| 6 | и | _ | C | Cp | _ | 3 | conj | 3 | conj | + 
-| 7 | упражнява | _ | V | Vpi | trans=t<nowiki>|</nowiki>mood=i<nowiki>|</nowiki>tense=r<nowiki>|</nowiki>pers=3<nowiki>|</nowiki>num=s | 3 | conjarg | 3 | conjarg | +train/007#190:. 
-| 8 | парламентарен | _ | A | Am | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 9 | mod | 9 | mod | +"Moramo biti svjesni kako se kod naroda stvara strah", izjavio je čelnik stranke ORA Veton Surroi kosovskom dnevniku Express, piše Reuters. 
-| 9 | контрол | _ | N | Nc | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 7 | obj | 7 | obj | + 
-| 10 | . | _ | Punct | Punct | _ | 3 | punct | 3 | punct |+train/007#359:, 
 +Ulaganja u Srbiji dosegnula su rekordnih 1,5 milijardi eura u 2005. godini, priopćila je u srijedu vlada, izražavajući očekivanja glede nastavka rasta i u sljedećoj godini. 
 + 
 +One more Punc-CYCLE:1 occurred somewhere else. 
 + 
 +test/001#25:toga 
 +Rezultat je toga da je artikulacija praktičnih zajedničkih interesa postala teža, kao i definiranje konkretnih misija. 
 +Překlad s pomocí Google Translate: 
 +Důsledek toho je, že členění praktických společných zájmů se stalo těžší, jakož i vymezení konkrétních misí. 
 +Tohle je asi jediný zajímavý případ. Nejde o pověšení uzlu na sebe sama. "Rezultat" visí na "postala", "postala" na "da", "da" na "toga" a "toga" chtěli pověsit opět na "Rezultat". Je tam k tomu i celkem divoká neprojektivita. Celá ta věta je podle mě rozebraná špatně (je tam několik dalších chyb) a chtělo by to, abychom ji v průběhu harmonizace úplně předělali. 
 + 
 +JINÉ: 
 +V té větě train/006#247 nahoře: "političkih stranaka", "političkih" je označeno jako apozice. Opravit chybu. Pokud je jako apozice přídavné jméno, které visí na následujícím podstatném jméně a shoduje se s ním v rodě, čísle a pádě, není to Apposition, ale Atr. 
 + 
 +Věta test/001#1 má v kořeni pomocné sloveso "je" a jeho deprel není Pred, ale Aux! 
 + 
 +==== Sample ====
  
-The first three sentences of the CoNLL 2006 test data:+The first three sentences of the improved pre-relase version:
  
-| 1 | Единственото | _ | A | An | gen=n<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=d | 2 | mod | 2 | mod | +| 1 | Proces | proces | Ncmsn | Ncmsn | <nowiki>_</nowiki> | 0 | Elp | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 2 | решение | _ | N | Nc | gen=n<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 0 | ROOT | 0 | ROOT |+| 2 | privatizacije | privatizacija | Ncfsg | Ncfsg | <nowiki>_</nowiki> | 1 | Obj | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 3 | na | na | Sl | Sl | <nowiki>_</nowiki> | 1 | Prep | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 4 | Kosovu | Kosovo | Npnsl | Npnsl | <nowiki>_</nowiki> | 3 | Adv | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 5 | pod | pod | Si | Si | <nowiki>_</nowiki> | 0 | Prep | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 6 | povećalom | povećalo | Ncnsi | Ncnsi | <nowiki>_</nowiki> | 5 | Elp | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
 | |||||||||| | ||||||||||
-| 1 | Ерик | _ | N | Np | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 0 | ROOT | 0 | ROOT | +| 1 | Kosovo | Kosovo | Npnsn | Npnsn | <nowiki>_</nowiki> | 3 | Sb | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 2 | Франк | _ | N | Np | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 1 | mod | 1 | mod | +| 2 | ozbiljno | ozbiljno | Rgp | Rgp | <nowiki>_</nowiki> | 3 | Adv | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 3 | Ръсел | _ | H | Hm | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 2 | mod | 2 | mod |+| 3 | analizira | analizirati | Vmr3s | Vmr3s | <nowiki>_</nowiki> | 0 | Pred | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 4 | proces | proces | Ncmsan | Ncmsan | <nowiki>_</nowiki> | 3 | Obj | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 5 | privatizacije | privatizacija | Ncfsg | Ncfsg | <nowiki>_</nowiki> | 4 | Atr | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 6 | u | u | Sl | Sl | <nowiki>_</nowiki> | 3 | Prep | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 7 | svjetlu | svjetlo | Ncnsl | Ncnsl | <nowiki>_</nowiki> | 6 | Obj | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 8 | učestalih | učestao | Agpfpg | Agpfpg | <nowiki>_</nowiki> | 9 | Atr | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 9 | pritužbi | pritužba | Ncfpg | Ncfpg | <nowiki>_</nowiki> | 7 | Atr | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 10 | <nowiki>.</nowiki> | <nowiki>.</nowiki> | Z | Z | <nowiki>_</nowiki> | 0 | Punc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
 | |||||||||| | ||||||||||
-| 1 | Пълен | _ | A | Am | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 2 | mod | 2 | mod | +| 1 | Barem | barem | Rgp | Rgp | <nowiki>_</nowiki> | 2 | Oth | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 2 | мрак | _ | N | Nc | gen=m<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 0 | ROOT | 0 | ROOT | +| 2 | na | na | Sl | Sl | <nowiki>_</nowiki> | 5 | Prep | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 3 | и | _ | C | Cp | _ | 2 | conj | 2 | conj | +| 3 | papiru | papir | Ncmsl | Ncmsl | <nowiki>_</nowiki> | 2 | Obj | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 4 | пълна | _ | A | Af | gen=f<nowiki>|</nowiki>num=s<nowiki>|</nowiki>def=i | 5 | mod | 5 | mod | +| 4 | <nowiki>,</nowiki> | <nowiki>,</nowiki> | Z | Z | <nowiki>_</nowiki> | 2 | Punc | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 5 | самота | _ | N | Nc | _ | 2 | conjarg | 2 | conjarg | +| 5 | izgleda | izgledati | Vmr3s | Vmr3s | <nowiki>_</nowiki> | 0 | Pred | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
-| 6 | . | _ | Punct | Punct | _ | 2 | punct | 2 | punct |+| 6 | kao | kao | Cs | Cs | <nowiki>_</nowiki> | 8 | Oth | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 7 | odlična | odličan | Agpfsn | Agpfsn | <nowiki>_</nowiki> | 8 | Atr | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 8 | ideja | ideja | Ncfsn | Ncfsn | <nowiki>_</nowiki> | 5 | Adv | <nowiki>_</nowiki> | <nowiki>_</nowiki> | 
 +| 9 | <nowiki>.</nowiki> | <nowiki>.</nowiki> | Z | Z | <nowiki>_</nowiki> | 0 | Punc | <nowiki>_</nowiki> | <nowiki>_</nowiki> |
  
 ==== Parsing ==== ==== Parsing ====
  
-Nonprojectivities in BTB are rare. Only 747 of the 196,151 tokens in the CoNLL 2006 version are attached nonprojectively (0.38%). +Nonprojectivities in SETimes.HR are rare. Only 461 of the 83640 tokens in the pre-release version are attached nonprojectively (0.55%).
- +
-The results of the CoNLL 2006 shared task are [[http://ilk.uvt.nl/conll/results.html|available online]]. They have been published in [[http://aclweb.org/anthology-new/W/W06/W06-2920.pdf|(Buchholz and Marsi, 2006)]]. The evaluation procedure was non-standard because it excluded punctuation tokens. These are the best results for Bulgarian: +
- +
-^ Parser (Authors) ^ LAS ^ UAS ^ +
-| MST (McDonald et al.) | 87.57 | 92.04 | +
-| Malt (Nivre et al.) | 87.41 | 91.72 | +
-| Nara (Yuchang Cheng) | 86.34 | 91.30 |+
  
 +//Are there any published parsing results on this corpus?//

[ Back to the navigation ] [ Back to the content ]