[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Table of Contents

Russian (ru)

Russian Dependency Treebank (RDT, SynTagRus)

Versions

Obtaining and License

There does not seem to be any regular distribution channel for the Russian Dependency Treebank. One can ask Igor Boguslavsky (Игор Богуславский, bogus (at) iitp (dot) ru) about availability of the corpus.

Informally agreed upon terms:

RDT was created by members of the Institute for Information Transmission Problems (Институт проблем передачи информации), Russian Academy of Sciences (Российская академия наук), RUS-127994, г.Москва, ГСП-4, Большой Каретный переулок, 19, стр.1.

References

Domain

Uppsala University Corpus of contemporary Russian prose (balanced fiction-journalistic, + small percentage of scientific and popular science). In addition, “several hundred short texts published in 2001-2002 on various Internet news portals” (yandex.ru, rbc.ru, polit.ru, lenta.ru, strana.ru, news.ru etc.)

Size

There are 497,465 tokens in 34895 sentences, yielding 14.26 tokens per sentence on average. The original data was not split to training and test. In our HamleDT experiments, we take one file (Выживший_камикадзе.tgt, 402 sentences, 3458 tokens) as the test data, while the rest serves for training.

Inside

The native file format of Syntagrus is the XML-based .tgt format. It uses the Windows-1251 encoding, which can be converted to UTF-8. Converting the file names is more of a challenge, depending on the file system (one typically gets a zipped archive containing files whose names use the Cyrillic alphabet, and the file system may store the names in a codepage different from Windows-1251).

Morphological annotation has probably been done manually and it contains lemmas (uppercased). See references for a description of morphological tags (features) and syntactic tags (dependency relation labels). Note that the tags use the Cyrillic alphabet.

The syntactic trees do not contain punctuation. Punctuation tokens have not been removed but they do not have independent nodes in the trees.

Sample

The first sentence of our test file in the native TGT format:

<?xml version="1.0" encoding="windows-1251"?>
<text><inf>
<author>Л, ТЕЛЕНЬ</author>
<title>Интервью "МН" Е. Гайдара</title>
<source/>
<annot>ЛИ</annot>
<editor>ИБ</editor>
<date>10.12.03</date>
<comment/>
</inf>
<body>
<S ID="1">
<W DOM="3" EXTRAFEAT="CAP" FEAT="S ЕД МУЖ ИМ ОД" ID="1" LEMMA="ЕГОР" LINK="предик">Егор</W> 
<W DOM="1" EXTRAFEAT="CAP" FEAT="S ЕД МУЖ ИМ ОД" ID="2" LEMMA="ГАЙДАР" LINK="аппоз">Гайдар</W> 
<W DOM="_root" EXTRAFEAT="ЛИЧ" FEAT="V НЕСОВ ИЗЪЯВ ПРОШ ЕД МУЖ" ID="3" LEMMA="ВОЗГЛАВЛЯТЬ">возглавлял</W> 
<W DOM="6" FEAT="A ЕД СРЕД ВИН" ID="4" LEMMA="ПЕРВЫЙ" LINK="опред">первое</W> 
<W DOM="6" FEAT="A ЕД СРЕД ВИН" ID="5" LEMMA="РОССИЙСКИЙ" LINK="опред">российское</W> 
<W DOM="3" FEAT="S ЕД СРЕД ВИН НЕОД" ID="6" LEMMA="ПРАВИТЕЛЬСТВО" LINK="1-компл">правительство</W>, 
<W DOM="8" FEAT="S ЕД СРЕД ВИН" ID="7" LEMMA="КОТОРЫЙ" LINK="1-компл">которое</W> 
<W DOM="6" EXTRAFEAT="ЛИЧ" FEAT="V НЕСОВ ИЗЪЯВ ПРОШ МН" ID="8" LEMMA="НАЗЫВАТЬ" LINK="релят">называли</W> 
<W DOM="8" FEAT="S ЕД СРЕД ТВОР НЕОД" ID="9" LEMMA="ПРАВИТЕЛЬСТВО" LINK="2-компл">правительством</W> 
<W DOM="9" FEAT="S ЕД МУЖ РОД ОД" ID="10" LEMMA="КАМИКАДЗЕ" LINK="квазиагент">камикадзе</W>. 
</S>

Parsing

Nonprojectivities in SynTagRus are not frequent. Only 4146 of the 497,465 tokens are attached nonprojectively (0.83%).

Parsing results have been published by Nivre, Boguslavsky and Iomdin (2008) (note that they used different training-test data split from ours):

Parser LAS UAS
Malt 82.3 89.1

[ Back to the navigation ] [ Back to the content ]