Search notes:
Hadoop configuration parameters
hadoop.tmp.dir
Default:
/tmp/hadoop-${user.name}
mapreduce.job.reduces
The number of Reduce Tasks for a
MapReduce
job.
mapreduce.job.ubertask.enable
Set to
true
to enable
uber jobs
.
mapreduce.job.ubertask.maxmaps
uber jobs
will be used only if the number of
mappers
is less or equal to the value of mapreduce.job.ubertask.maxmaps.
Default: 9
mapreduce.job.ubertask.maxreduces
uber jobs
will be used only if the number of
reducers
is less or equal to the value of mapreduce.job.ubertask.maxreduces.
Default: 1
mapreduce.job.ubertask.maxbytes
uber jobs
will be used only if the size of data of a job is less than the value of value of mapreduce.job.ubertask.maxbytes.
Default: default block size
mapreduce.map.sort.spill.percent
Specifies how full a Mapper's
circular buffer
must become in order to start a
MapReduce's
Spilling
phase.
yarn.logaggregation.enable
Whether
log file
aggregation
is enabled or not.
Default: false.
yarn.nodemanager.delete.debug-delay-sec
Number of seconds after an
application
finishes before the
nodemanager's
Deletion Service will delete the application's localized file directory and log directory.
See also
yarn.nodemanager.log.retain-seconds
yarn.nodemanager.local-dirs
Default: ${
hadoop.tmp.dir
}/
nm-local-dir
yarn.nodemanager.log-aggregation.compression-type
If, and how,
aggregated logs
should be compressed.
Possible values:
none
,
lzo
and
gzip
.
Default: none
yarn.nodemanager.log-dirs
Specifies the directory into which
container
log files
are written.
Default: ${yarn.log.dir}/userlogs
yarn.nodemanager.log.retain-seconds
How long, in seconds, user
log files
should be retained.
Only applicable if
log aggregation
is disabled.
See also
#yarn-nodemanager.delete.debug-delay-sec
yarn.nodemanager.remote-app-log-dir
Default value:
/tmp/logs
yarn.nodemanager.remote-app-log-dir-suffix
Default value: logs
yarn.nodemanager.resource.memory-mb
Amount of physical memory allocatable for all
containers
managed by a
node manager
, in MB.
Default: 8192
yarn.resourcemanager.hostname
The hostname of the
resource manager
.
Default:
0.0.0.0
yarn.resourcemanager.webapp.address
The HTTP address of the
resource manager
web application
.
Default: ${
yarn.resourcemanager.hostname
}:8088
yarn.scheduler.minimum-allocation-mb
Minimum amount of memory, in MB, a
container
allocets when requested from the
resource manager
.
Default: 1024
See also
YARN configuration
Links
https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/core-default.xml
Index