Question : All of the files required for running a particular YARN application will be put here(Path) for the duration of the application run. Which of the following property in yarn-site.xml, will be used to configure this path
1. yarn.nodemanager.log-dirs
2. yarn.nodemanager.local-dirs
3. yarn.nodemanager.remote-app-log-dir
4. yarn.nodemanager.dirs
Correct Answer : 2
Explanation: yarn.nodemanager.local-dirs Specifies the URIs of the directories where the NodeManager stores its localized files. All of the files required for running a particular YARN application will be put here for the duration of the application run. Cloudera recommends that this property specify a directory on each of the JBOD mount points; for example, file:///data/1/yarn/local through /data/N/yarn/local. yarn.nodemanager.log-dirs Specifies the URIs of the directories where the NodeManager stores container log files. Cloudera recommends that this property specify a directory on each of the JBOD mount points; for example, file:///data/1/yarn/logs through file:///data/N/yarn/logs. yarn.nodemanager.remote-app-log-dir Specifies the URI of the directory where logs are aggregated. Set the value to hdfs://(namenode-host.company.com):8020/var/log/hadoop-yarn/apps,using the fully-qualified domain name of your NameNode host.
Question : Which of the following component in the MRv maintains the History of the JOB
1. MapReduce Server 2. MapReduce JobHistory Server 3. Application Master 4. 2 and 3 5. 1 , 2 and 3
Correct Answer : 2
As previously described in MapReduce 2.0 in Hadoop 0.23,the JobTracker no longer exists in MR2, and the job life cycle management functionality is now the responsibility of the short-lived Application Masters. For this reason, a new MapReduce JobHistory server was added to MR2, which maintains information about submitted MapReduce jobs after their Application Master terminates. The Resource Manager Web UI manages such forwarding of requests to the JobHistory server when the Application Master completes.
Question : YARN requires a staging directory for temporary files created by running jobs. By default it creates /tmp/hadoop-yarn/staging But user can not run the jobs, what could be reason.
1. Directory path is not correct 2. stagging directory is full 3. Directry has restrictive permissions 4. None of the above
Correct Answers: 3
Explanation: YARN requires a staging directory for temporary files created by running jobs. By default it creates /tmp/hadoop-yarn/staging with restrictive permissions that may prevent your users from running jobs
1. Stored as metadata on the NameNode 2. Stored along with the data in HDFS 3. Stored in the Metadata 4. Stored in ZooKeeper 5. Stored in Hive Metastore
1. Stop working 2. All jobs will hangs for some time 3. All jobs will be stopped and needs to be re-started 4. ResourceManager symmetrically request back resources from a running application