Differences
This shows you the differences between two versions of the page.
Both sides previous revision
Previous revision
Next revision
|
Previous revision
Next revision
Both sides next revision
|
courses:mapreduce-tutorial:step-6 [2012/01/27 16:58] straka |
courses:mapreduce-tutorial:step-6 [2012/01/28 13:31] majlis Added links to previous and next chapter. |
===== Example ===== | ===== Example ===== |
| |
Try running the {{:courses:mapreduce-tutorial:step-6.txt|wordcount.pl}} using | Try running the {{:courses:mapreduce-tutorial:step-6.txt|step-6-wordcount.pl}} using |
perl wordcount.pl run -c 1 -w 600 -Dmapred.max.split.size=1000000 /home/straka/wiki/cs-text-medium some_output_directory | wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-6.txt' -O 'step-6-wordcount.pl' |
| rm -rf step-6-out; perl step-6-wordcount.pl run -c 1 -w 600 -Dmapred.max.split.size=1000000 /home/straka/wiki/cs-text-medium step-6-out |
and explore the web interface. | and explore the web interface. |
| |
If you cannot access directly the ''*.ufal.hide.ms.mff.cuni.cz'' network, you can use | If you cannot access directly the ''*.ufal.hide.ms.mff.cuni.cz'' network, you can use |
ssh -N -L 50030:pandora3:50030 geri | ssh -N -L 50030:pandora3:50030 geri.ms.mff.cuni.cz |
to create a tunnel from local port 50030 to machine ''pandora3:50030''. Replace ''pandora3'' by your cluster_master, but leave the hostname ''geri'' unmodified. | on your computer to create a tunnel from local port 50030 to machine ''pandora3:50030''. Replace **''pandora3''** by your cluster_master, but leave the hostname **''geri.ms.mff.cuni.cz''** unmodified. Now you can access the web interface on the URL [[http://localhost:50030]] |
| |
| ---- |
| |
| <html> |
| <table style="width:100%"> |
| <tr> |
| <td style="text-align:left; width: 33%; "></html>[[step-5|Step 5]]: Basic reducer.<html></td> |
| <td style="text-align:center; width: 33%; "></html>[[.|Overview]]<html></td> |
| <td style="text-align:right; width: 33%; "></html>[[step-7|Step 7]]: Dynamic Hadoop cluster for several computations.<html></td> |
| </tr> |
| </table> |
| </html> |