[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
courses:mapreduce-tutorial:step-1 [2012/01/24 20:04]
straka
courses:mapreduce-tutorial:step-1 [2012/01/29 15:38]
straka
Line 1: Line 1:
 ====== MapReduce Tutorial : Setting the environment ====== ====== MapReduce Tutorial : Setting the environment ======
 +
 +===== Hadoop instalation =====
 +
 +===== The Perl API =====
  
 To use the Perl MapReduce API, you need To use the Perl MapReduce API, you need
  
-  * Perl package ''Moose''This is available in the UFAL environment, just add+  * Perl package ''Moose''. 
 +  * Perl package ''Hadoop''
 + 
 +===== The Moose package ===== 
 +The standard Moose package is available in the UFAL environment, just add
   . /net/work/projects/perl_repo/admin/bin/setup_platform   . /net/work/projects/perl_repo/admin/bin/setup_platform
-to ''.profile'' or ''.bashrc'' or type it in the shell.+to ''.profile'' or ''.bashrc'' or type it in the shell 
 + 
 +  echo -e "\n#MR Tutorial - Moose" >> ~/.bashrc 
 +  echo ". /net/work/projects/perl_repo/admin/bin/setup_platform" >> ~/.bashrc 
 + 
 + 
 +===== The Hadoop package ===== 
 +The custom Hadoop package is available in ''/net/projects/hadoop/perl'', just add 
 +  export PERLLIB="$PERLLIB:/net/projects/hadoop/perl/" 
 +  export PERL5LIB="$PERL5LIB:/net/projects/hadoop/perl" 
 +to ''.profile'', ''.bash_profile'', ''.bashrc'' or type it in the shell. 
 + 
 + 
 +  echo -e "\n#MR Tutorial - Hadoop" >> ~/.bashrc 
 +  echo 'export PERLLIB="$PERLLIB:/net/projects/hadoop/perl/"' >> ~/.bashrc 
 +  echo 'export PERL5LIB="$PERL5LIB:/net/projects/hadoop/perl"' >> ~/.bashrc
  
-  * Perl package ''Hadoop''. The package is available in '/home/straka/hadoop/perl', just add +----
-  export PERLLIB="$PERLLIB:/home/straka/hadoop/perl" +
-  export PERL5LIB="$PERL5LIB:/home/straka/hadoop/perl" +
-to ''.profile'' or ''.bashrc'' or type it in the shell.+
  
 +<html>
 +<table style="width:100%">
 +<tr>
 +<td style="text-align:left; width: 33%; "></html><html></td>
 +<td style="text-align:center; width: 33%; "></html>[[.|Overview]]<html></td>
 +<td style="text-align:right; width: 33%; "></html>[[step-2|Step 2]]: Input and output format, testing data.<html></td>
 +</tr>
 +</table>
 +</html>

[ Back to the navigation ] [ Back to the content ]