arrow_back Install Hadoop 3.0.0 on Windows (Single Node)

comment Comments
hide_source Anonymous #73 access_time 5 years ago more_vert

Hi there,

I have installed the Hadoop 3 as per instructions mentioned above. Please suggest the steps to load data in Hadoop through cmd in windows 10 and also to  perform operation on it.

Regards,

Swati

#196 access_time 5 years ago more_vert
@Raymond Tang I run in console. i did not do double click on the cmd file.
Raymond Raymond #203 access_time 5 years ago more_vert
When you run the cmd script, did you directly open the script file or run the command line in Command Prompt?
format_quote

person David Serrano access_time 5 years ago

Hi,
I see your tutorial about the installation of hadoop on windows
However i am gettin this error when try to run the yarn demons with start-yarn.cmd:

This file does not have an app associated with it for performing this action. Please install an app or, if one is already installed, create an association in the defaul apps settings page.

Do you know some solution for that?

Thanks in advance.
hide_source Anonymous #76 access_time 5 years ago more_vert
Hi,
I see your tutorial about the installation of hadoop on windows
However i am gettin this error when try to run the yarn demons with start-yarn.cmd:

This file does not have an app associated with it for performing this action. Please install an app or, if one is already installed, create an association in the defaul apps settings page.

Do you know some solution for that?

Thanks in advance.
Raymond Raymond #202 access_time 5 years ago more_vert

Did you follow all the exact steps in my post? It seems like Java path (configured in environment variables) doesn't include some of the jar files Hadoop is using. However. it's hard to debug without access to your environment. 

format_quote

person XO3 ZDT access_time 5 years ago

I'm using JDK 8.

I tried setting yarn-nodemanager-opts and yarn-resourcemanager-opts  like the link you gave me but no luck the error is still there


hide_source Anonymous #75 access_time 5 years ago more_vert

I'm using JDK 8.

I tried setting yarn-nodemanager-opts and yarn-resourcemanager-opts  like the link you gave me but no luck the error is still there


Raymond Raymond #201 access_time 5 years ago more_vert

Hi,

It seems your problem is similar like the following: https://issues.apache.org/jira/browse/HADOOP-14978

Are you using JDK9 or above?

Can you try with JDK 8? I have not tried with JDK 9 or above as it was not fully supported. It may work now but Java 8 is the one recommended from the official website. 

format_quote

person XO3 ZDT access_time 5 years ago

I can't start up the resource manager and node manager

i got the error: 

//////////////

 WARN webapp.WebAppContext: Failed startup of context o.e.j.w.WebAppContext@53830483{/,file:///C:/Users/ASUS/AppData/Local/Temp/jetty-0.0.0.0-8088-cluster-_-any-16441570173546812728.dir/webapp/,UNAVAILABLE}{/cluster}

com.google.inject.ProvisionException: Unable to provision, see the following errors:

1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource at org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:41)

  at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebApp.setup(RMWebApp.java:54)

  while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver

//////////////////////



hide_source Anonymous #74 access_time 5 years ago more_vert

I can't start up the resource manager and node manager

i got the error: 

//////////////

 WARN webapp.WebAppContext: Failed startup of context o.e.j.w.WebAppContext@53830483{/,file:///C:/Users/ASUS/AppData/Local/Temp/jetty-0.0.0.0-8088-cluster-_-any-16441570173546812728.dir/webapp/,UNAVAILABLE}{/cluster}

com.google.inject.ProvisionException: Unable to provision, see the following errors:

1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource at org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:41)

  at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebApp.setup(RMWebApp.java:54)

  while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver

//////////////////////



hide_source Anonymous #77 access_time 5 years ago more_vert

Thanks again. I finally installed hadoop on WLS but have problem on this article. in the step 

%HADOOP_HOME%\sbin\start-dfs.cmd

I get error "datanode.DataNode: Exception in secureMain" and there is no resolution over the web :(

Raymond Raymond #200 access_time 5 years ago more_vert

Hi, this post is about installing 3.0.0 and I have not tried 3.2.0 using this approach yet. Some configuration properties have changed. 

Your error message looks like that the Username was not configured correctly due to some reason. 

However, since you are using Windows 10, I'd suggest you to follow the post below to install 3.2.0 in Windows Subsystem for Linux (WSL). 

Install Hadoop 3.2.0 on Windows 10 using Windows Subsystem for Linux (WSL)

format_quote

person Muhammad Adnan access_time 5 years ago

Hi,
I tried your guidelines for installing Hadoop 3.2.0 on my Windows 10 but unfortunately I am unable to start it. I am stuck at the point where you stated the command hadoop namenode -format . I am getting this message at the end of the command Shutting down NameNode at {Username}/192.168.0.200.
But no descriptive error other than that. Can you help me please?

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts