Question : As a general recommendation, allowing for ______ Containers per disk and per core gives the best balance for cluster utilization.
1. One 2. Two 3. Three 4. Four
Correct Answer : 2
Explanation: resources. As a general recommendation, allowing for two Containers per disk and per core gives the best balance for cluster utilization.
When determining the appropriate YARN and MapReduce memory configurations for a cluster node, start with the available hardware resources. Specifically, note the following values on each node:
RAM (Amount of memory)
CORES (Number of CPU cores)
DISKS (Number of disks)
The total available RAM for YARN and MapReduce should take into account the Reserved Memory. Reserved Memory is the RAM needed by system processes and other Hadoop processes (such as HBase).
Reserved Memory = Reserved for stack memory + Reserved for HBase Memory (If HBase is on the same node)
Use the following table to determine the Reserved Memory per node.
Question : In the Hadoop . framework, if HBase is also running on the same node for which available RAM is GB, so what is the ideal configuration for "Reserved System Memory"
1. 1GB 2. 2GB 3. 3GB 4. No need to reserve
Correct Answer : 1
The total available RAM for YARN and MapReduce should take into account the Reserved Memory. Reserved Memory is the RAM needed by system processes and other Hadoop processes (such as HBase).
Reserved Memory = Reserved for stack memory + Reserved for HBase Memory (If HBase is on the same node)
Use the following table to determine the Reserved Memory per node.
Question : The next calculation is to determine the maximum number of containers allowed per node. The following formula can be used:
# of containers = min (2*CORES, 1.8*DISKS, (Total available RAM) / MIN_CONTAINER_SIZE)
Where MIN_CONTAINER_SIZE is the minimum container size (in RAM). This value is dependent on the amount of RAM available -- in smaller memory nodes, the minimum container size should also be smaller
Available Total RAM per Node"is 24GB, then what is the "Recommended Minimum Container Size"
1. 256MB 2. 512MB 3. 1024MB 4. 2048 MB
Correct Answer : 4
The next calculation is to determine the maximum number of containers allowed per node. The following formula can be used:
# of containers = min (2*CORES, 1.8*DISKS, (Total available RAM) / MIN_CONTAINER_SIZE)
Where MIN_CONTAINER_SIZE is the minimum container size (in RAM). This value is dependent on the amount of RAM available -- in smaller memory nodes, the minimum container size should also be smaller. The following table outlines the recommended values:
Total RAM per Node Recommended Minimum Container Size Less than 4 GB 256 MB Between 4 GB and 8 GB 512 MB Between 8 GB and 24 GB 1024 MB Above 24 GB 2048 MB
1. When Job QT2 gets submitted, it will get assigned tasks, while job QT1 continues to run with fewer tasks 2. When Job QT2 gets submitted, Job QT1 has to finish first, before job QT1 can gets scheduled. 3. Access Mostly Uused Products by 50000+ Subscribers 4. When Job QT1 gets submitted, it consumes all the task slots.