List Hadoop running jobs in Shell / Hadoop

access_time 2 years ago visibility29 comment 0

Hadoop provides a number of CLIs. hadoop job command can be used to retrieve running job list.

You can also use YARN resource manager UI to view the jobs too.

Run the command in Hadoop Edge nodes' terminal.

You can also use grep command to filter the results. For example:

hadoop job -list | grep username

The results also contain the track URL which you can open in browser. 

Code snippet

hadoop job -list
info Last modified by Raymond at 2 years ago copyright This page is subject to Site terms.
Like this article?
Share on

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

Want to publish your article on Kontext?

Learn more

Kontext Column

Created for everyone to publish data, programming and cloud related articles.
Follow three steps to create your columns.

Learn more arrow_forward

More from Kontext

local_offer hadoop local_offer shell

visibility 31
thumb_up 0
access_time 11 months ago

The following code snippet shows how to list and kill Hadoop jobs including (MapReduce and YARN jobs).

local_offer hadoop local_offer yarn local_offer big-data-on-linux

visibility 2883
thumb_up 0
access_time 3 years ago

When configuring YARN and MapReduce in Hadoop cluster, it is very important to configure the memory and virtual processors correctly. If the configurations are incorrect, the nodes may not be able to start properly and the applications may not be able to run successfully. For example, in the ...

local_offer hadoop local_offer hdfs local_offer parquet local_offer sqoop local_offer big-data-on-linux

visibility 2968
thumb_up 0
access_time 3 years ago

This page continues with the following documentation about configuring a Hadoop multi-nodes cluster via adding a new edge node to configure administration or client tools. Configure Hadoop 3.1.0 in a Multi Node Cluster In this page, I’m going to show you how to add a edge node into the ...

About column

Code snippets for various programming languages/frameworks.

rss_feed Subscribe RSS