List Hadoop running jobs in Shell / Hadoop

access_time 2 years ago visibility37 comment 0

Hadoop provides a number of CLIs. hadoop job command can be used to retrieve running job list.

You can also use YARN resource manager UI to view the jobs too.

Run the command in Hadoop Edge nodes' terminal.

You can also use grep command to filter the results. For example:

hadoop job -list | grep username

The results also contain the track URL which you can open in browser. 

Code snippet

hadoop job -list
info Last modified by Raymond 2 years ago copyright This page is subject to Site terms.
Like this article?
Share on

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

Follow Kontext

Get our latest updates on LinkedIn or Twitter.

Want to publish your article on Kontext?

Learn more

More from Kontext

visibility 2324
thumb_up 0
access_time 3 years ago

Apache doesn't provide native official .NET APIs for Hadoop HDFS. The HTTP REST API supports the complete FileSystem / FileContext interface for HDFS. Thus, we could use these web APIs to perform HDFS operations in other programming language like C#.

visibility 2091
thumb_up 6
access_time 10 months ago

When I was configuring Hive 3.0.0 in Hadoop 3.2.1 environment, I encountered the following error: Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V This issue happened because  guava lib ...

visibility 4006
thumb_up 1
access_time 3 years ago

SQL Server Integration Service ( SSIS ) has tasks to perform operations against Hadoop, for example: Hadoop File System Task Hadoop Hive Task Hadoop Pig Task In Data Flow Task, you can also use: Hadoop HDFS Source Hadoop HDFS Destination In this page, I’m going to demonstrate how to ...