Default Ports Used by Hadoop Services (HDFS, MapReduce, YARN)
This page summarizes the default ports used by Hadoop services. It is useful when configuring network interfaces in a cluster.
Hadoop 3.1.0
HDFS
The secondary namenode http/https server address and port.Service | Servers | Default Ports Used | Protocol | Configuration Parameter | Comments |
WebUI for NameNode |
Master (incl. back-up NameNodes) | 9870/9871 | http/https | The address and the base port where the dfs namenode web ui will listen on. The namenode secure http server address and port. |
|
Metadata service (NameNode) | Master (incl. back-up NameNodes) | IPC | The name of the default file system. For example, hdfs://hdp-master:19000 |
||
Data Node | All slave nodes | 9864/9865 | http/https | dfs.datanode.http.address | The secondary namenode http/https server address and port. |
Data Node | All slave nodes | 9866 | dfs.datanode.address | The datanode server address and port for data transfer. | |
Data Node | All slave nodes | 9867 | IPC | dfs.datanode.ipc.address | The datanode ipc server address and port (for metadata operations). |
Secondary NameNode | Secondary NameNode and any backup NameNodes | 9868/9869 | http/https | ||
JournalNode | 8485 | IPC | dfs.journalnode.rpc-address | The JournalNode RPC server address and port. | |
JournalNode | 8480/8481 | http/https | The address and port the JournalNode http/https server listens on. | ||
Aliasmap Server | NameNode | 50200 | dfs.provided.aliasmap.inmemory.dnrpc-address | The address where the aliasmap server will be running
|
MapReduce
Service | Servers | Default Ports Used | Protocol | Configuration Parameter | Comments |
MapReduce Job History | 10020 | mapreduce.jobhistory.address | MapReduce JobHistory Server IPC host:port | ||
MapReduce Job History UI | 19888/19890 | http/https |
MapReduce JobHistory Server Web UI URL (http/https) | ||
History server admin | 10033 | IPC | mapreduce.jobhistory.admin.address | The address of the History server admin interface. |
YARN
Service | Servers | Default Ports Used | Protocol | Configuration Parameter | Comments |
8032 | IPC | yarn.resourcemanager.address | The address of the applications manager interface in the RM. | ||
8030 | IPC | yarn.resourcemanager.scheduler.address | The address of the scheduler interface. | ||
8088/8090 | http/https | The http/https address of the RM web application. | |||
8031 | yarn.resourcemanager.resource-tracker.address | ||||
8033 | yarn.resourcemanager.admin.address | The address of the RM admin interface. | |||
0 | yarn.nodemanager.address | The address of the container manager in the NM. | |||
8040 | yarn.nodemanager.localizer.address | Address where the localizer IPC is. | |||
8048 | yarn.nodemanager.collector-service.address | Address where the collector service IPC is. | |||
8042/8044 | http/https | The http/https address of the NM web application.
| |||
10200 | yarn.timeline-service.address | This is default address for the timeline server to start the
RPC server. | |||
8188/8190 | The http/https address of the timeline service web application. | ||||
8047 | yarn.sharedcache.admin.address | The address of the admin interface in the SCM (shared cache manager) | |||
8788 | yarn.sharedcache.webapp.address | The address of the web application in the SCM (shared cache manager) | |||
8046 | yarn.sharedcache.uploader.server.address | The address of the node manager interface in the SCM
(shared cache manager) | |||
8045 | yarn.sharedcache.client-server.address | The address of the client interface in the SCM
(shared cache manager) | |||
8049 | yarn.nodemanager.amrmproxy.address | The address of the AMRMProxyService listener.
| |||
8089/8091 | The http/https address of the Router web application. | ||||
References
The following links provide information about all the default configurations for Hadoop v3.1.0.
8032 8030 10033 are ipc port , not http port