Explanation: Often, Mappers produce large amounts of intermediate data - The data must be passed to the Reducers - This can result in a lot of network traffic.
You can specify the Combiner, which is consider mini-reducer - Combiner runs locally on a single Mappers output. - Output from the Combiner is sent to the Reducers. - Input and Output data types for the Combiner and Reducer must be identical.
Combiner can be applied only when operation performed is commutative and associative.
Refer HadoopExam.com Recorded Training Module : 3Often, Mappers produce large amounts of intermediate data - The data must be passed to the Reducers - This can result in a lot of network traffic.
You can specify the Combiner, which is consider mini-reducer - Combiner runs locally on a single Mappers output. - Output from the Combiner is sent to the Reducers. - Input and Output data types for the Combiner and Reducer must be identical.
Combiner can be applied only when operation performed is commutative and associative.
Note : The Combiner may run once, or more than once, on the output from any given Mapper.
Do not put the in the Combiner which could influence your results if it runs more than once.
Refer HadoopExam.com Recorded Training Module : 3
Question : A combiner reduce the amount of data sent to the Reducer ?
Explanation: Often, Mappers produce large amounts of intermediate data - The data must be passed to the Reducers - This can result in a lot of network traffic.
You can specify the Combiner, which is consider mini-reducer - Combiner runs locally on a single Mappers output. - Output from the Combiner is sent to the Reducers. - Input and Output data types for the Combiner and Reducer must be identical.
Combiner can be applied only when operation performed is commutative and associative.
Note : The Combiner may run once, or more than once, on the output from any given Mapper.
Do not put the in the Combiner which could influence your results if it runs more than once.
Refer HadoopExam.com Recorded Training Module : 3
Question : Combiner reduces the network traffic but increases the amount of work needed to be done by the reducer ?
Explanation: Combiner decreases the amount of network traffic required during the shuffle and sort phase and often also decreases the amount of work needed to be done by the reducer.
Often, Mappers produce large amounts of intermediate data - The data must be passed to the Reducers - This can result in a lot of network traffic.
You can specify the Combiner, which is consider mini-reducer - Combiner runs locally on a single Mappers output. - Output from the Combiner is sent to the Reducers. - Input and Output data types for the Combiner and Reducer must be identical.
Combiner can be applied only when operation performed is commutative and associative.
Note : The Combiner may run once, or more than once, on the output from any given Mapper.
Do not put in the Combiner which could influence your results if it runs more than once.