[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
courses:mapreduce-tutorial:step-4 [2012/01/29 23:38]
majlis
courses:mapreduce-tutorial:step-4 [2012/01/31 09:40]
straka Change Perl commandline syntax.
Line 3: Line 3:
 Sometimes it is useful to count events differently than outputting them as (key, value) pairs. For that reason Hadoop offers simple counter framework. Sometimes it is useful to count events differently than outputting them as (key, value) pairs. For that reason Hadoop offers simple counter framework.
  
-Hadoop maintains a collection of pre-defined and user-defined counters. Every counter is identified by its group name and counter name. To increment a counter, the following code can be used:+Hadoop maintains a collection of pre-defined and user-defined counters. Every counter is identified by its group name and counter name. The group name and counter name is an arbitrary string -- for example group "Documents" and name "Number of words". To increment a counter, the following code can be used:
  
 <code perl> <code perl>
Line 21: Line 21:
   # NOW EDIT THE FILE   # NOW EDIT THE FILE
   # $EDITOR step-4-exercise.pl   # $EDITOR step-4-exercise.pl
-  rm -rf step-4-out-ex; perl step-4-exercise.pl run /home/straka/wiki/cs-text-medium/ step-4-out-ex+  rm -rf step-4-out-ex; perl step-4-exercise.pl /home/straka/wiki/cs-text-medium/ step-4-out-ex
   less step-4-out-ex/part-*   less step-4-out-ex/part-*
  
Line 27: Line 27:
 You can also download the solution {{:courses:mapreduce-tutorial:step-4-solution.txt|step-4-solution.pl}} and check the correct output. You can also download the solution {{:courses:mapreduce-tutorial:step-4-solution.txt|step-4-solution.pl}} and check the correct output.
   wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-4-solution.txt' -O 'step-4-solution.pl'   wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-4-solution.txt' -O 'step-4-solution.pl'
-  # NOW EDIT THE FILE +  # NOW VIEW THE FILE 
-  # $EDITOR step-4-solution.pl +  # $EDITOR step-3-solution.pl 
-  rm -rf step-4-out-sol; perl step-4-solution.pl run /home/straka/wiki/cs-text-medium/ step-4-out-sol+  rm -rf step-4-out-sol; perl step-4-solution.pl /home/straka/wiki/cs-text-medium/ step-4-out-sol
   less step-4-out-sol/part-*   less step-4-out-sol/part-*
  

[ Back to the navigation ] [ Back to the content ]