[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

• ÚFAL Wiki Home
• ÚFAL Home
• Sitemap
• RSS
• ÚFAL calendar
• Recent changes
• Login
• Hledat:

[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

View differences: Side by SideInline Go

Link to this comparison view

Both sides previous revision Previous revision 2007/06/05 06:35 bojar jen formatovani2007/05/31 14:43 pajas 2007/05/28 16:59 pajas 2007/05/28 00:25 pajas 2007/05/28 00:16 pajas 2007/05/28 00:15 pajas 2007/05/25 01:49 bojar odkaz na pekny clanek se sirsim rozhledem2007/05/16 03:19 bojar odkaz na Honzovu ukazku validace2007/05/03 12:17 bojar 2007/05/03 02:53 bojar 2007/05/03 02:15 bojar 2007/05/02 08:27 stepanek complication with links2007/05/02 04:43 bojar 2007/05/02 04:42 bojar 2007/05/02 04:40 bojar 2007/05/02 04:37 bojar 2007/05/02 04:19 bojar 2007/05/02 04:00 bojar 2007/05/02 03:57 bojar 2007/05/02 03:43 bojar 2007/05/02 03:24 bojar 2007/05/02 03:19 bojar 2007/05/02 03:07 bojar 2007/05/02 02:57 bojar vytvořeno Go Next revision		Previous revision 2007/06/05 06:35 bojar jen formatovani2007/05/31 14:43 pajas 2007/05/28 16:59 pajas 2007/05/28 00:25 pajas 2007/05/28 00:16 pajas 2007/05/28 00:15 pajas 2007/05/25 01:49 bojar odkaz na pekny clanek se sirsim rozhledem2007/05/16 03:19 bojar odkaz na Honzovu ukazku validace2007/05/03 12:17 bojar 2007/05/03 02:53 bojar 2007/05/03 02:15 bojar 2007/05/02 08:27 stepanek complication with links2007/05/02 04:43 bojar 2007/05/02 04:42 bojar 2007/05/02 04:40 bojar 2007/05/02 04:37 bojar 2007/05/02 04:19 bojar 2007/05/02 04:00 bojar 2007/05/02 03:57 bojar 2007/05/02 03:43 bojar 2007/05/02 03:24 bojar 2007/05/02 03:19 bojar 2007/05/02 03:07 bojar 2007/05/02 02:57 bojar vytvořeno Go
pml-haters [2007/05/28 00:16] pajas		pml-haters [2007/06/05 06:35] (current) bojar jen formatovani
Line 14:		Line 14:
	Please strongly prefer SAX-based tools to DOM-based tools.		Please strongly prefer SAX-based tools to DOM-based tools.
		+
	===== Validation =====		===== Validation =====
-	Given a PML file, how do I validate it? I always forget... Please provide me with the one-liner to do the validation.	+	Given a PML file, how do I validate it?
-	See [[user:ptacek:tectomt|this snippet]] for some vague hints.	+	For most purposes, a libxml2 (DOM) based validator
		+	<code>/f/common/exec/validate_pml --pml-dir /f/common/share/pml --path /f/common/share/tred file_to_validate</code>should work fine and fast.
-	PP: there is a validation script at the [[http://ufal.mff.cuni.cz/jazz/pml/index_en.html|PML homepage]], but it uses DOM. A streaming variant that uses trang can be found in ''/home/pajas/bin/validate_pml_stream'' (no resource path support yet - you need to have your PML schemas next to your files).	+	For huge files, use<code>/f/common/exec/validate_pml_stream --path /f/common/share/tred file_to_validate</code>which is based on Jing (SAX); Jing has no Zlib or stdin support, so some space in /tmp will be needed for temporary files.
		+	Both scripts have decent user documentation. See inside the scripts if interested in the implementation details.
	===== XSH Won't Work: Blame XML Namespaces =====		===== XSH Won't Work: Blame XML Namespaces =====
Line 52:		Line 55:
	Most probably you'll still face problems when accessing attributes of XML elements, because namespacing rules apply differently to attributes and elements. You'll need to read XML (Namespaces) specification.		Most probably you'll still face problems when accessing attributes of XML elements, because namespacing rules apply differently to attributes and elements. You'll need to read XML (Namespaces) specification.
-
-
-
-
-
-
-
	===== Number of Sentences =====		===== Number of Sentences =====
Line 68:		Line 64:
	This XPath would quickly give you the number of sentences:		This XPath would quickly give you the number of sentences:
-	<code>count(tdata/trees/LM)	+	<code>count(pml:tdata/pml:trees/pml:LM)
	</code>		</code>
Line 77:		Line 73:
	<code>cat file.t.xml \		<code>cat file.t.xml \
	| xsh -I - -C "regns pml http://ufal.mff.cuni.cz/pdt/pml/; count(pml:tdata/pml:trees/pml:LM)" 2>/dev/null		| xsh -I - -C "regns pml http://ufal.mff.cuni.cz/pdt/pml/; count(pml:tdata/pml:trees/pml:LM)" 2>/dev/null
		+	</code>
		+
		+	or just the following, if you have the regns command in your ~/.xsh2rc:
		+
		+	<code>cat file.t.xml \
		+	| xsh -I - -C "count(pml:tdata/pml:trees/pml:LM)" 2>/dev/null
	</code>		</code>
Line 92:		Line 94:
	</code>		</code>
		+	Here is a one-liner in Perl that does not load the whole file into memory:
		+	<code>perl -MXML::LibXML::Reader -e 'my $r=XML::LibXML::Reader->new(location=>shift); $r->nextElement("trees"); $d=$r->depth; $r->read; while ($d<$r->depth) {$i++; $r->nextSibling} print $i,"\n"' file.t.xml
		+	</code>
	===== Restricting a Suite of PML Files to Contain only a Specific Sentence =====		===== Restricting a Suite of PML Files to Contain only a Specific Sentence =====
Line 101:		Line 105:
	How do I create a suite of files with just the problematic sentence 345, i.e. files test-w.xml, test-m.xml, test-a.xml and test-t.xml, all properly referenced? A XML-Reader based script by Petr Pajas demonstrates that:		How do I create a suite of files with just the problematic sentence 345, i.e. files test-w.xml, test-m.xml, test-a.xml and test-t.xml, all properly referenced? A XML-Reader based script by Petr Pajas demonstrates that:
-	<code>~pajas/projects/pml/separate_t_tree.pl file-t.xml 345	+	<code>~pajas/projects/pml/tools/separate_t_tree.pl file-t.xml 345
	</code>		</code>

---

[ Back to the navigation ] [ Back to the content ]