You are welcome. Hope it helps.
person Mohamad access_time 3 years ago
Have a good Life
The error you got indicates that Hadoop required JAR libraries are not loaded properly.
The fix I provided was for missing the right winutil native libs not JAR libs. Make sure your JAVA_HOME, HADDOP_HOME environment variables and other configurations are done properly. If you are not following all the steps in my article, I would suggest you follow this article.
person Morar access_time 4 years ago
After I use the fix you mentioned namenode format still doesn't work
hdfs namenode -format
Error: Could not find or load main class org.apache.hadoop.hdfs.server.namenode.NameNode
Yes, please refer to this series: https://kontext.tech/tag/big-data-on-windows-10.
It includes installation guide of Spark, Hive, Sqoop and Zeppelin on Windows.
person Ankit access_time 4 years ago
Thanks for your reply :)
Looks like it may have happened due to mixing of different versions of Hadoop libraries. I started Hadoop installation by watching few YouTube videos (for older versions of Hadoop) where they later provided a modified version of bin folder. But my name-node was failing continuously. When I googled for the error message, I found your link and then followed the installation steps and could install Hadoop 3.2.1.
Thank you for taking out time to reply and clarify my confusion.
person Raymond access_time 4 years ago
I'm glad it helped you. For the issue you mentioned, I don't think it is related to this tutorial. If you follow all the steps in this tutorial, you will not get that issue as this has been tested out by quite a few different people. I've also tested the steps in a new Windows 10 environment too.
It seems you may have mixed different versions of Hadoop libraries when doing the installation.
This installation guide is only for Hadoop 3.2.1. Can you confirm whether you exactly followed all the steps in this guide and also was using Hadoop 3.2.1 release for installation?
Thank you so much.
I was struggling for Hadoop installation on my Windows, but your article helped me install it properly.
Just faced a small issue with resource manager, which I fixed by referring to the following link.
If possible, could you please update your blog with this entry also, that should make your article exhaustive :)
Thanks again :)
Alright. Cool. Thanks for replying.
I could not compile all Hadoop 3.3.0 projects on Windows 10 but I can compile the winutils project successfully.
You can follow this guide to install Hadoop 3.3.0 on Windows 10 without using WSL:
Install Hadoop 3.3.0 on Windows 10 Step by Step Guide
Please log in or register to comment.
Please log in or register first.