[ Skip to the content ]

Institute of Formal and Applied Linguistics Wiki


[ Back to the navigation ]

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
courses:mapreduce-tutorial:step-13 [2012/01/31 15:54]
straka
courses:mapreduce-tutorial:step-13 [2012/01/31 15:54] (current)
straka
Line 8: Line 8:
 You can assume that the integers are uniformly distributed. You can assume that the integers are uniformly distributed.
  
-Your task is to sort these data, comparing the key numerically and not lexicographically. The lines in the output file must be the same as in the input file, only in different order.+Your task is to sort these data, comparing the key numerically and not lexicographically. The lines in the output must be the same as in the input, only in different order.
  
 Your solution should work for TBs of data. For that reason, you must use multiple reducers. If your job is executed using //r// reducers, the output consists of //r// files, which when concatenated would produce sorted (key, value) pairs. In other words, each of the output files contains sorted (integer, data) pairs and all keys in one file are either smaller or larger than in other file. Your solution should work for any value //r// -- this value is given to [[.:step-8#partitioning|the partitioner]] as its fourth argument. Your solution should work for TBs of data. For that reason, you must use multiple reducers. If your job is executed using //r// reducers, the output consists of //r// files, which when concatenated would produce sorted (key, value) pairs. In other words, each of the output files contains sorted (integer, data) pairs and all keys in one file are either smaller or larger than in other file. Your solution should work for any value //r// -- this value is given to [[.:step-8#partitioning|the partitioner]] as its fourth argument.

[ Back to the navigation ] [ Back to the content ]