Hadoop Code snippets

Hadoop Shell

List and kill jobs in Shell / Hadoop

The following code snippet shows how to list and kill Hadoop jobs including (MapReduce and YARN jobs).

View detail
Hadoop Shell

Check HDFS folder size in Shell / Hadoop

Hadoop provides a number of CLIs that can be used to perform many tasks/activities. This code snippet shows you how to check file/folder size in HDFS.

View detail
Hadoop Shell

List Hadoop running jobs in Shell / Hadoop

Hadoop provides a number of CLIs. hadoop job command can be used to retrieve running job list.

You can also use YARN resource manager UI to view the jobs too.

View detail