[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki

[ Back to the navigation ]

You are here: start » courses » mapreduce-tutorial » step-15

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
courses:mapreduce-tutorial:step-15 [2012/01/28 23:23]
majlis Added links to previous and next chapter. 		courses:mapreduce-tutorial:step-15 [2012/01/29 16:40] (current)
straka
Line 7: Line 7:
 | ''/net/projects/hadoop/examples/inputs/points-large'' | 500000 | 200 | 200 | | ''/net/projects/hadoop/examples/inputs/points-large'' | 500000 | 200 | 200 |
  
-When dealing with iterative algorithms, each iteration is usually implemented as one Hadoop job. The Hadoop input_path contains the input data and each mapper also reads the current clusters. The reducers are used to aggregate the data and output new cluster centers. A controlling script is taking care of executing Hadoop jobs and stopping the iteration when the algorithm converges.+When dealing with iterative algorithms, each iteration is usually implemented as one Hadoop job. The Hadoop ''input_path'' should contain the input data and each mapper should also read the current clusters. The reducers are used to aggregate the data and output new cluster centers. A controlling script should take care of executing Hadoop jobs and stopping the iteration when the algorithm converges.
  
 ---- ----

[ Back to the navigation ] [ Back to the content ]