arrow_back Install Hadoop 3.2.1 on Windows 10 Step by Step Guide

comment Comments
Raymond Raymond #1492 access_time 3 years ago more_vert

You are welcome. Hope it helps. 

format_quote

person Mohamad access_time 3 years ago

Thank You 

Have a good Life

M Mohamad KonteratChi #1491 access_time 3 years ago more_vert

Thank You 

Have a good Life

Raymond Raymond #412 access_time 4 years ago more_vert

The error you got indicates that Hadoop required JAR libraries are not loaded properly.

The fix I provided was for missing the right winutil native libs not JAR libs. Make sure your JAVA_HOME, HADDOP_HOME environment variables and other configurations are done properly. If you are not following all the steps in my article, I would suggest you follow this article. 

format_quote

person Morar access_time 4 years ago

After I use the fix you mentioned namenode format still doesn't work

hdfs namenode -format

Error: Could not find or load main class org.apache.hadoop.hdfs.server.namenode.NameNode

M Morar Ciprian #411 access_time 4 years ago more_vert

After I use the fix you mentioned namenode format still doesn't work

hdfs namenode -format

Error: Could not find or load main class org.apache.hadoop.hdfs.server.namenode.NameNode

Raymond Raymond #347 access_time 4 years ago more_vert

Hi Ankit,

Yes, please refer to this series: https://kontext.tech/tag/big-data-on-windows-10.

It includes installation guide of Spark, Hive, Sqoop and Zeppelin on Windows. 

-Raymond

format_quote

person Ankit access_time 4 years ago

Hi Raymond, By any chance, have you also installed hive and other hadoop softwares, on a windows machine. If yes, would it be possible for you to share the installation guides? Regards, Ankit
A Ankit Tiwari #346 access_time 4 years ago more_vert
Hi Raymond, By any chance, have you also installed hive and other hadoop softwares, on a windows machine. If yes, would it be possible for you to share the installation guides? Regards, Ankit
A Ankit Tiwari #344 access_time 4 years ago more_vert

Hi Raymond,

Thanks for your reply :)

Looks like it may have happened due to mixing of different versions of Hadoop libraries. I started Hadoop installation by watching few YouTube videos (for older versions of Hadoop) where they later provided a modified version of bin folder. But my name-node was failing continuously. When I googled for the error message, I found your link and then followed the installation steps and could install Hadoop 3.2.1.

Thank you for taking out time to reply and clarify my confusion.

Regards,

Ankit

format_quote

person Raymond access_time 4 years ago

I'm glad it helped you. For the issue you mentioned, I don't think it is related to this tutorial. If you follow all the steps in this tutorial, you will not get that issue as this has been tested out by quite a few different people. I've also tested the steps in a new Windows 10 environment too. 

It seems you may have mixed different versions of Hadoop libraries when doing the installation.

This installation guide is only for Hadoop 3.2.1. Can you confirm whether you exactly followed all the steps in this guide and also was using Hadoop 3.2.1 release for installation?


Raymond Raymond #343 access_time 4 years ago more_vert

I'm glad it helped you. For the issue you mentioned, I don't think it is related to this tutorial. If you follow all the steps in this tutorial, you will not get that issue as this has been tested out by quite a few different people. I've also tested the steps in a new Windows 10 environment too. 

It seems you may have mixed different versions of Hadoop libraries when doing the installation.

This installation guide is only for Hadoop 3.2.1. Can you confirm whether you exactly followed all the steps in this guide and also was using Hadoop 3.2.1 release for installation?


format_quote

person Ankit access_time 4 years ago

Thank you so much.

I was struggling for Hadoop installation on my Windows, but your article helped me install it properly.

Just faced a small issue with resource manager, which I fixed by referring to the following link.

If possible, could you please update your blog with this entry also, that should make your article exhaustive :)

Thanks again :)

https://stackoverflow.com/questions/51118358/noclassdeffounderror-org-apache-hadoop-yarn-server-timelineservice-collector-tim


A Ankit Tiwari #342 access_time 4 years ago more_vert

Thank you so much.

I was struggling for Hadoop installation on my Windows, but your article helped me install it properly.

Just faced a small issue with resource manager, which I fixed by referring to the following link.

If possible, could you please update your blog with this entry also, that should make your article exhaustive :)

Thanks again :)

https://stackoverflow.com/questions/51118358/noclassdeffounderror-org-apache-hadoop-yarn-server-timelineservice-collector-tim


A Andika Syahputra #326 access_time 4 years ago more_vert

Alright. Cool. Thanks for replying.

format_quote

person Raymond access_time 4 years ago

Further update:

I could not compile all Hadoop 3.3.0 projects on Windows 10 but I can compile the winutils project successfully. 

You can follow this guide to install Hadoop 3.3.0 on Windows 10 without using WSL:

Install Hadoop 3.3.0 on Windows 10 Step by Step Guide


Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts