Search notes:

YARN: log files

Each container has a specific (local) output directory (on the node that the container is running on) into which standard output, standard error and log messages are written.
Standard out and standard error messages go to distinct files.
If log aggregation is enabled (see yarn.logaggregation.enable), these log files are written to ${yarn.nodemanager.log-dirs}/application-id/container-id (See Application ID and Container ID.
If log aggregation is not enabled, the log files are retained for ${yarn.nodemanager.log.retain-seconds} seconds.
If log aggregation is enabled, they are retained for ${yarn.nodemanager.delete.debug-delay-sec} seconds

Viewing a log file

yarn logs -applicationId application_1466361633780_0001
This command needs the application to be finished and log aggregation to be enabled.
The logs of an application master can also be viewed in a browser in the resource manager UI on http://${yarn.resourcemanager.webapp.address}/cluster (http://localhost:8088 on a single node "cluster").

See also

log files

Index