Default Ports Used by Hadoop Services (HDFS, MapReduce, YARN)
articleArticles 555
codeCode 5
imageDiagrams 54
descriptionNotebooks 0
chat_bubble_outlineThreads 8
commentComments 297
loyaltyKontext Points 6182
account_circle Profile
more_vert
This page summarizes the default ports used by Hadoop services. It is useful when configuring network interfaces in a cluster.
Hadoop 3.1.0
HDFS
The secondary namenode http/https server address and port.| Service | Servers | Default Ports Used | Protocol | Configuration Parameter | Comments |
WebUI for NameNode |
Master (incl. back-up NameNodes) | 9870/9871 | http/https | The address and the base port where the dfs namenode web ui will listen on. The namenode secure http server address and port. |
|
| Metadata service (NameNode) | Master (incl. back-up NameNodes) | IPC | The name of the default file system. For example, hdfs://hdp-master:19000 |
||
| Data Node | All slave nodes | 9864/9865 | http/https | dfs.datanode.http.address | The secondary namenode http/https server address and port. |
| Data Node | All slave nodes | 9866 | dfs.datanode.address | The datanode server address and port for data transfer. | |
| Data Node | All slave nodes | 9867 | IPC | dfs.datanode.ipc.address | The datanode ipc server address and port (for metadata operations). |
| Secondary NameNode | Secondary NameNode and any backup NameNodes | 9868/9869 | http/https | ||
| JournalNode | 8485 | IPC | dfs.journalnode.rpc-address | The JournalNode RPC server address and port. | |
| JournalNode | 8480/8481 | http/https | The address and port the JournalNode http/https server listens on. | ||
| Aliasmap Server | NameNode | 50200 | dfs.provided.aliasmap.inmemory.dnrpc-address | The address where the aliasmap server will be running
|
MapReduce
| Service | Servers | Default Ports Used | Protocol | Configuration Parameter | Comments |
| MapReduce Job History | 10020 | mapreduce.jobhistory.address | MapReduce JobHistory Server IPC host:port | ||
| MapReduce Job History UI | 19888/19890 | http/https |
MapReduce JobHistory Server Web UI URL (http/https) | ||
| History server admin | 10033 | IPC | mapreduce.jobhistory.admin.address | The address of the History server admin interface. |
YARN
| Service | Servers | Default Ports Used | Protocol | Configuration Parameter | Comments |
| 8032 | IPC | yarn.resourcemanager.address | The address of the applications manager interface in the RM. | ||
| 8030 | IPC | yarn.resourcemanager.scheduler.address | The address of the scheduler interface. | ||
| 8088/8090 | http/https | The http/https address of the RM web application. | |||
| 8031 | yarn.resourcemanager.resource-tracker.address | ||||
| 8033 | yarn.resourcemanager.admin.address | The address of the RM admin interface. | |||
| 0 | yarn.nodemanager.address | The address of the container manager in the NM. | |||
| 8040 | yarn.nodemanager.localizer.address | Address where the localizer IPC is. | |||
| 8048 | yarn.nodemanager.collector-service.address | Address where the collector service IPC is. | |||
| 8042/8044 | http/https | The http/https address of the NM web application.
| |||
| 10200 | yarn.timeline-service.address | This is default address for the timeline server to start the
RPC server. | |||
| 8188/8190 | The http/https address of the timeline service web application. | ||||
| 8047 | yarn.sharedcache.admin.address | The address of the admin interface in the SCM (shared cache manager) | |||
| 8788 | yarn.sharedcache.webapp.address | The address of the web application in the SCM (shared cache manager) | |||
| 8046 | yarn.sharedcache.uploader.server.address | The address of the node manager interface in the SCM
(shared cache manager) | |||
| 8045 | yarn.sharedcache.client-server.address | The address of the client interface in the SCM
(shared cache manager) | |||
| 8049 | yarn.nodemanager.amrmproxy.address | The address of the AMRMProxyService listener.
| |||
| 8089/8091 | The http/https address of the Router web application. | ||||
References
The following links provide information about all the default configurations for Hadoop v3.1.0.
info Last modified by Raymond 12 months ago
copyright
This page is subject to Site terms.
comment Comments
G
geek
access_time 12 months ago
more_vert
#1765 Re: Default Ports Used by Hadoop Services (HDFS, MapReduce, YARN)
8032 8030 10033 are ipc port , not http port
Log in with external accounts
warning Please login first to view stats information.
Thanks for pointing this out and you are right. I've updated them accordingly.
person geek access_time 12 months ago
Re: Default Ports Used by Hadoop Services (HDFS, MapReduce, YARN)
8032 8030 10033 are ipc port , not http port