arrow_back Install Hadoop 3.0.0 on Windows (Single Node)
person David Serrano access_time 6 years ago
Did you follow all the exact steps in my post? It seems like Java path (configured in environment variables) doesn't include some of the jar files Hadoop is using. However. it's hard to debug without access to your environment.
person XO3 ZDT access_time 6 years ago
I'm using JDK 8.
I tried setting yarn-nodemanager-opts and yarn-resourcemanager-opts like the link you gave me but no luck the error is still there
I'm using JDK 8.
I tried setting yarn-nodemanager-opts and yarn-resourcemanager-opts like the link you gave me but no luck the error is still there
Hi,
It seems your problem is similar like the following: https://issues.apache.org/jira/browse/HADOOP-14978
Are you using JDK9 or above?
Can you try with JDK 8? I have not tried with JDK 9 or above as it was not fully supported. It may work now but Java 8 is the one recommended from the official website.
person XO3 ZDT access_time 6 years ago
I can't start up the resource manager and node manager
i got the error:
//////////////
WARN webapp.WebAppContext: Failed startup of context o.e.j.w.WebAppContext@53830483{/,file:///C:/Users/ASUS/AppData/Local/Temp/jetty-0.0.0.0-8088-cluster-_-any-16441570173546812728.dir/webapp/,UNAVAILABLE}{/cluster}
com.google.inject.ProvisionException: Unable to provision, see the following errors:
1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource at org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:41)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebApp.setup(RMWebApp.java:54)
while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver
//////////////////////
I can't start up the resource manager and node manager
i got the error:
//////////////
WARN webapp.WebAppContext: Failed startup of context o.e.j.w.WebAppContext@53830483{/,file:///C:/Users/ASUS/AppData/Local/Temp/jetty-0.0.0.0-8088-cluster-_-any-16441570173546812728.dir/webapp/,UNAVAILABLE}{/cluster}
com.google.inject.ProvisionException: Unable to provision, see the following errors:
1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource at org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:41)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebApp.setup(RMWebApp.java:54)
while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver
//////////////////////
Thanks again. I finally installed hadoop on WLS but have problem on this article. in the step
%HADOOP_HOME%\sbin\start-dfs.cmd
I get error "datanode.DataNode: Exception in secureMain" and there is no resolution over the web :(
Hi, this post is about installing 3.0.0 and I have not tried 3.2.0 using this approach yet. Some configuration properties have changed.
Your error message looks like that the Username was not configured correctly due to some reason.
However, since you are using Windows 10, I'd suggest you to follow the post below to install 3.2.0 in Windows Subsystem for Linux (WSL).
Install Hadoop 3.2.0 on Windows 10 using Windows Subsystem for Linux (WSL)
person Muhammad Adnan access_time 6 years ago
Hi,
I tried your guidelines for installing Hadoop 3.2.0 on my Windows 10 but unfortunately I am unable to start it. I am stuck at the point where you stated the command hadoop namenode -format . I am getting this message at the end of the command Shutting down NameNode at {Username}/192.168.0.200.
But no descriptive error other than that. Can you help me please?
Hi there,
I have installed the Hadoop 3 as per instructions mentioned above. Please suggest the steps to load data in Hadoop through cmd in windows 10 and also to perform operation on it.
Regards,
Swati