Differences
This shows you the differences between two versions of the page.
| Both sides previous revision
Previous revision
Next revision
|
Previous revision
Next revision
Both sides next revision
|
courses:mapreduce-tutorial:step-6 [2012/01/25 21:59]
straka |
courses:mapreduce-tutorial:step-6 [2012/01/28 13:31]
majlis Added links to previous and next chapter. |
| ===== Example ===== | ===== Example ===== |
| |
| Try running the {{:courses:mapreduce-tutorial:step-6.txt|wordcount.pl}} using | Try running the {{:courses:mapreduce-tutorial:step-6.txt|step-6-wordcount.pl}} using |
| perl wordcount.pl -c 1 -w 600 -Dmapred.max.split.size=1000000 /home/straka/wiki/cs-text-medium some_output_directory | wget --no-check-certificate 'https://wiki.ufal.ms.mff.cuni.cz/_media/courses:mapreduce-tutorial:step-6.txt' -O 'step-6-wordcount.pl' |
| | rm -rf step-6-out; perl step-6-wordcount.pl run -c 1 -w 600 -Dmapred.max.split.size=1000000 /home/straka/wiki/cs-text-medium step-6-out |
| and explore the web interface. | and explore the web interface. |
| |
| If you cannot access directly the ''*.ufal.hide.ms.mff.cuni.cz'' network, you can use | If you cannot access directly the ''*.ufal.hide.ms.mff.cuni.cz'' network, you can use |
| ssh -N -L 50030:pandora3:50030 geri | ssh -N -L 50030:pandora3:50030 geri.ms.mff.cuni.cz |
| to create a tunnel from local port 50030 to machine ''pandora3:50030''. | on your computer to create a tunnel from local port 50030 to machine ''pandora3:50030''. Replace **''pandora3''** by your cluster_master, but leave the hostname **''geri.ms.mff.cuni.cz''** unmodified. Now you can access the web interface on the URL [[http://localhost:50030]] |
| |
| | ---- |
| | |
| | <html> |
| | <table style="width:100%"> |
| | <tr> |
| | <td style="text-align:left; width: 33%; "></html>[[step-5|Step 5]]: Basic reducer.<html></td> |
| | <td style="text-align:center; width: 33%; "></html>[[.|Overview]]<html></td> |
| | <td style="text-align:right; width: 33%; "></html>[[step-7|Step 7]]: Dynamic Hadoop cluster for several computations.<html></td> |
| | </tr> |
| | </table> |
| | </html> |
