Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
courses:mapreduce-tutorial:step-1 [2012/01/26 23:07] straka |
courses:mapreduce-tutorial:step-1 [2012/01/29 15:55] straka |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== MapReduce Tutorial : Setting the environment ====== | ====== MapReduce Tutorial : Setting the environment ====== | ||
+ | |||
+ | ===== Hadoop installation ===== | ||
+ | |||
+ | The tutorial expects you to be logged to a computer in the UFAL cluster. In this environment, | ||
+ | |||
+ | You can go through the tutorial even without being connected to UFAL cluster, but you will need | ||
+ | * local Hadoop installation | ||
+ | - download '' | ||
+ | - unpack it | ||
+ | - edit '' | ||
+ | * the repository '' | ||
+ | * when using Perl API, set '' | ||
+ | * when using Java API, | ||
+ | |||
+ | - use '' | ||
+ | If you cannot | ||
+ | If | ||
+ | It is possible to | ||
+ | |||
+ | ===== The Perl API ===== | ||
To use the Perl MapReduce API, you need | To use the Perl MapReduce API, you need | ||
Line 6: | Line 26: | ||
* Perl package '' | * Perl package '' | ||
- | ===== The Moose package | + | ==== The Moose package ==== |
The standard Moose package is available in the UFAL environment, | The standard Moose package is available in the UFAL environment, | ||
. / | . / | ||
- | to '' | + | to '' |
+ | echo -e "\n#MR Tutorial - Moose" >> ~/.bashrc | ||
+ | echo ". / | ||
- | ===== The Hadoop package | + | |
+ | ==== The Hadoop package ==== | ||
The custom Hadoop package is available in ''/ | The custom Hadoop package is available in ''/ | ||
export PERLLIB=" | export PERLLIB=" | ||
Line 18: | Line 41: | ||
to '' | to '' | ||
+ | |||
+ | echo -e "\n#MR Tutorial - Hadoop" | ||
+ | echo ' | ||
+ | echo ' | ||
+ | |||
+ | ---- | ||
+ | |||
+ | < | ||
+ | <table style=" | ||
+ | <tr> | ||
+ | <td style=" | ||
+ | <td style=" | ||
+ | <td style=" | ||
+ | </tr> | ||
+ | </ | ||
+ | </ |