[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
courses:mapreduce-tutorial:step-16 [2012/02/06 13:29]
straka
courses:mapreduce-tutorial:step-16 [2012/02/06 13:29] (current)
straka
Line 126: Line 126:
 You can run it using specified number of machines on the following input data: You can run it using specified number of machines on the following input data:
   * ''/​net/​projects/​hadoop/​examples/​inputs/​points-small'':​   * ''/​net/​projects/​hadoop/​examples/​inputs/​points-small'':​
-<​code>​M=machines; export CLUSTERS_NUM=50 CLUSTERS_FILE=/​net/​projects/​hadoop/​examples/​inputs/​points-small/​points.txt +<​code>​M=#​of_machines; export CLUSTERS_NUM=50 CLUSTERS_FILE=/​net/​projects/​hadoop/​examples/​inputs/​points-small/​points.txt 
-rm -rf step-16-out;​ perl kmeans.pl ​[-jt jobtracker | -c $M`/​net/​projects/​hadoop/​bin/​compute-splitsize $CLUSTERS_FILE $M` $CLUSTERS_FILE step-16-out</​code>​+rm -rf step-16-out;​ perl kmeans.pl -c $M `/​net/​projects/​hadoop/​bin/​compute-splitsize $CLUSTERS_FILE $M` $CLUSTERS_FILE step-16-out</​code>​
   * ''/​net/​projects/​hadoop/​examples/​inputs/​points-medium'':​   * ''/​net/​projects/​hadoop/​examples/​inputs/​points-medium'':​
-<​code>​M=machines; export CLUSTERS_NUM=100 CLUSTERS_FILE=/​net/​projects/​hadoop/​examples/​inputs/​points-medium/​points.txt +<​code>​M=#​of_machines; export CLUSTERS_NUM=100 CLUSTERS_FILE=/​net/​projects/​hadoop/​examples/​inputs/​points-medium/​points.txt 
-rm -rf step-16-out;​ perl kmeans.pl ​[-jt jobtracker | -c $M`/​net/​projects/​hadoop/​bin/​compute-splitsize $CLUSTERS_FILE $M` $CLUSTERS_FILE step-16-out</​code>​+rm -rf step-16-out;​ perl kmeans.pl -c $M `/​net/​projects/​hadoop/​bin/​compute-splitsize $CLUSTERS_FILE $M` $CLUSTERS_FILE step-16-out</​code>​
   * ''/​net/​projects/​hadoop/​examples/​inputs/​points-large'':​   * ''/​net/​projects/​hadoop/​examples/​inputs/​points-large'':​
-<​code>​M=machines; export CLUSTERS_NUM=200 CLUSTERS_FILE=/​net/​projects/​hadoop/​examples/​inputs/​points-large/​points.txt +<​code>​M=#​of_machines; export CLUSTERS_NUM=200 CLUSTERS_FILE=/​net/​projects/​hadoop/​examples/​inputs/​points-large/​points.txt 
-rm -rf step-16-out;​ perl kmeans.pl ​[-jt jobtracker | -c $M`/​net/​projects/​hadoop/​bin/​compute-splitsize $CLUSTERS_FILE $M` $CLUSTERS_FILE step-16-out</​code>​+rm -rf step-16-out;​ perl kmeans.pl -c $M `/​net/​projects/​hadoop/​bin/​compute-splitsize $CLUSTERS_FILE $M` $CLUSTERS_FILE step-16-out</​code>​
  
 Solution: {{:​courses:​mapreduce-tutorial:​step-16-solution3.txt|kmeans.pl}},​ much faster solution with distance computations written in C: {{:​courses:​mapreduce-tutorial:​step-16-solution3_c.txt|kmeans_C.pl}}. Solution: {{:​courses:​mapreduce-tutorial:​step-16-solution3.txt|kmeans.pl}},​ much faster solution with distance computations written in C: {{:​courses:​mapreduce-tutorial:​step-16-solution3_c.txt|kmeans_C.pl}}.
  

[ Back to the navigation ] [ Back to the content ]