Search notes:

Hadoop configuration parameters

hadoop.tmp.dir

Default: /tmp/hadoop-${user.name}

mapreduce.job.reduces

The number of Reduce Tasks for a MapReduce job.

mapreduce.job.ubertask.enable

Set to true to enable uber jobs.

mapreduce.job.ubertask.maxmaps

uber jobs will be used only if the number of mappers is less or equal to the value of mapreduce.job.ubertask.maxmaps.
Default: 9

mapreduce.job.ubertask.maxreduces

uber jobs will be used only if the number of reducers is less or equal to the value of mapreduce.job.ubertask.maxreduces.
Default: 1

mapreduce.job.ubertask.maxbytes

uber jobs will be used only if the size of data of a job is less than the value of value of mapreduce.job.ubertask.maxbytes.
Default: default block size

mapreduce.map.sort.spill.percent

Specifies how full a Mapper's circular buffer must become in order to start a MapReduce's Spilling phase.

yarn.logaggregation.enable

Whether log file aggregation is enabled or not.
Default: false.

yarn.nodemanager.delete.debug-delay-sec

Number of seconds after an application finishes before the nodemanager's Deletion Service will delete the application's localized file directory and log directory.
See also yarn.nodemanager.log.retain-seconds

yarn.nodemanager.local-dirs

Default: ${hadoop.tmp.dir}/nm-local-dir

yarn.nodemanager.log-aggregation.compression-type

If, and how, aggregated logs should be compressed.
Possible values: none, lzo and gzip.
Default: none

yarn.nodemanager.log-dirs

Specifies the directory into which container log files are written.
Default: ${yarn.log.dir}/userlogs

yarn.nodemanager.log.retain-seconds

How long, in seconds, user log files should be retained.
Only applicable if log aggregation is disabled.
See also #yarn-nodemanager.delete.debug-delay-sec

yarn.nodemanager.remote-app-log-dir

Default value: /tmp/logs

yarn.nodemanager.remote-app-log-dir-suffix

Default value: logs

yarn.nodemanager.resource.memory-mb

Amount of physical memory allocatable for all containers managed by a node manager, in MB.
Default: 8192

yarn.resourcemanager.hostname

The hostname of the resource manager.
Default: 0.0.0.0

yarn.resourcemanager.webapp.address

The HTTP address of the resource manager web application.
Default: ${yarn.resourcemanager.hostname}:8088

yarn.scheduler.minimum-allocation-mb

Minimum amount of memory, in MB, a container allocets when requested from the resource manager.
Default: 1024

See also

YARN configuration

Links

https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/core-default.xml

Index