===== Russian (ru) ===== [[http://www.ruscorpora.ru/en/search-syntax.html|Russian Dependency Treebank]] (RDT, SynTagRus) ==== Versions ==== * 2006 (small part obtained by Dan Zeman per e-mail from Igor Boguslavsky) * 2009 (newer and larger version obtained by Natalia Klyueva) * The version at the site of the [[http://www.ruscorpora.ru/en/search-syntax.html|Russian National Corpus]] (searchable on-line but not available for download) ==== Obtaining and License ==== There does not seem to be any regular distribution channel for the Russian Dependency Treebank. One can ask Igor Boguslavsky (Игор Богуславский, bogus (at) iitp (dot) ru) about availability of the corpus. Informally agreed upon terms: * no redistribution * cite the principal publication (see below) in publications * let the creators know about interesting research based on the corpus RDT was created by members of the [[http://www.iitp.ru/|Institute for Information Transmission Problems]] (Институт проблем передачи информации), Russian Academy of Sciences (Российская академия наук), RUS-127994, г.Москва, ГСП-4, Большой Каретный переулок, 19, стр.1. ==== References ==== * Website * //no website dedicated to the treebank// * Data * //no separate citation// * Principal publications * Igor Boguslavsky, Ivan Chardin, Svetlana Grigorieva, Nikolai Grigoriev, Leonid Iomdin, Leonid Kreidlin, Nadezhda Frid: [[http://cl.iitp.ru/bibitems/treebank_lrec.pdf|Development of a Dependency Treebank for Russian and its Possible Applications in NLP]] In: Proceedings of The Third International Conference on Language Resources and Evaluation (LREC 2002), pp. 852-856, Las Palmas, Spain, 2002. * Other publications * Joakim Nivre, Igor M. Boguslavsky, Leonid L. Iomdin: [[http://aclweb.org/anthology-new/C/C08/C08-1081.pdf|Parsing the SynTagRus Treebank of Russian]]. In: Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), pp. 641-648, Manchester, UK, 2008. * David Mareček, Natalia Kljueva: [[http://aclweb.org/anthology/W/W09/W09-4005.pdf|Converting Russian Treebank SynTagRus into Praguian PDT Style]]. In: Multilingual Resources, Technologies and Evaluation for Central and Eastern European Languages, pp. 26-31, Bulgaria, 2009. * Documentation * Daniel Zeman: {{:user:zeman:treebanks:russian_dependency_treebank.pdf|Russian Dependency Treebank}} //(written based on a Russian document pamjatka_korpus.doc)//, College Park, Maryland, USA, 2006 ==== Domain ==== Uppsala University Corpus of contemporary Russian prose (balanced fiction-journalistic, + small percentage of scientific and popular science). In addition, “several hundred short texts published in 2001-2002 on various Internet news portals” (yandex.ru, rbc.ru, polit.ru, lenta.ru, strana.ru, news.ru etc.) ==== Size ==== There are 497,465 tokens in 34895 sentences, yielding 14.26 tokens per sentence on average. The original data was not split to training and test. In our HamleDT experiments, we take one file (''Выживший_камикадзе.tgt'', 402 sentences, 3458 tokens) as the test data, while the rest serves for training. ==== Inside ==== The native file format of Syntagrus is the XML-based ''.tgt'' format. It uses the Windows-1251 encoding, which can be converted to UTF-8. Converting the file names is more of a challenge, depending on the file system (one typically gets a zipped archive containing files whose names use the Cyrillic alphabet, and the file system may store the names in a codepage different from Windows-1251). Morphological annotation has probably been done manually and it contains lemmas (uppercased). See references for a description of morphological tags (features) and syntactic tags (dependency relation labels). Note that the tags use the Cyrillic alphabet. The syntactic trees do not contain punctuation. Punctuation tokens have not been removed but they do not have independent nodes in the trees. ==== Sample ==== The first sentence of our test file in the native TGT format: Л, ТЕЛЕНЬ Интервью "МН" Е. Гайдара ЛИ ИБ 10.12.03 Егор Гайдар возглавлял первое российское правительство, которое называли правительством камикадзе. ==== Parsing ==== Nonprojectivities in SynTagRus are not frequent. Only 4146 of the 497,465 tokens are attached nonprojectively (0.83%). Parsing results have been published by [[http://aclweb.org/anthology-new/C/C08/C08-1081.pdf|Nivre, Boguslavsky and Iomdin (2008)]] (note that they used different training-test data split from ours): ^ Parser ^ LAS ^ UAS ^ | Malt | 82.3 | 89.1 |