Pass4sure CCD-410 Question Answer

QUESTION: 1

Combiners Increase the efficiency of a MapReduce program because:

A. They provide a mechanism for different mappers to communicate with each Other, thereby reducing synchronization overhead.
B. They provide an optimization and reduce the total number of computations that are needed to execute an algorithm by a factor of n, where is the number of reducer.
C. They aggregate intermediate map output locally on each individual machine and therefore reduce the amount of data that needs to be shuffled across the network to the reducers.
D. They aggregate intermediate map output horn a small number of nearby (i.e., rack-local) machines and therefore reduce the amount of data that needs to be shuffled across the network to the reducers.

Answer: C

Explanation:

Combiners are used to increase the efficiency of a MapReduce program. They are used to aggregate intermediate map output locally on individual mapper outputs. Combiners can help you reduce the amount of data that needs to be transferred across to the reducers. You can use your reducer code as a combiner if the operation performed is commutative and associative. The execution of combiner is not guaranteed, Hadoop may or may not execute a combiner. Also, if required it may execute it more than 1 times. Therefore your MapReduce jobs should not depend on the combiner’s execution

QUESTION: 2

In a large MapReduce job with m mappers and r reducers, how many distinct copy operations will there be in the sort/shuffle phase?

A. m
B. r
C. m+r (i.e., m plus r)
D. mxr (i.e., m multiplied by r)
E. mr (i.e., m to the power of r)

Answer: D