Shell Code snippets

Hadoop Shell

List and kill jobs in Shell / Hadoop

The following code snippet shows how to list and kill Hadoop jobs including (MapReduce and YARN jobs).

View detail
Shell

List environment variables in Shell

Environment variables are commonly used in many frameworks or programs.

View detail
Hadoop Shell

Check HDFS folder size in Shell / Hadoop

Hadoop provides a number of CLIs that can be used to perform many tasks/activities. This code snippet shows you how to check file/folder size in HDFS.

View detail
Hadoop Shell

List Hadoop running jobs in Shell / Hadoop

Hadoop provides a number of CLIs. hadoop job command can be used to retrieve running job list.

You can also use YARN resource manager UI to view the jobs too.

View detail