Question : Which statement is correct for the MapReduce 1. MapReduce is a method for distribution a task across multiple nodes 2. Each node processes data stored on that node 3. Access Mostly Uused Products by 50000+ Subscribers 4. All of the above
Question : Which of the following are responsibilities of the ApplicationMater
1. Before starting any task, create job's output directory for job's OutputCommitter. 2. Both map tasks and reduce tasks are created by Application Master. 3. Access Mostly Uused Products by 50000+ Subscribers 4. If job doesn't qualify as Uber task, Application Master requests containers for all map tasks and reduce tasks.
Explanation: Role of an Application Master: o Before starting any task, Job setup method is called to create job's output directory for job's OutputCommitter. o As noted above, Both map tasks and reduce tasks are created by Application Master. o If the submitted job is small, then Application Master runs the job in the same JVM on which Application Master is running. It reduces the overhead of creating new container and running tasks in parallel. These small jobs are called as Uber tasks. o Uber tasks are decided by three configuration parameters, number of mappers "less than and equal to" 10, number of reducers "less than and equal to" 1 and Input file size is less than or equal to an HDFS block size. These parameters can be configured via mapreduce.job.ubertask.maxmaps , mapreduce.job.ubertask.maxreduces , and mapreduce.job.ubertask.maxbytes properties in mapred-site.xml. o If job doesn't qualify as Uber task, Application Master requests containers for all map tasks and reduce tasks.
You can also Refer/Consider Advance Hadoop YARN Training by HadoopExam.com