Hadoop 3.3.1 winutils
Winutils is required when installing Hadoop on Windows environment.
Hadoop 3.3.1 winutils
I've compiled Hadoop 3.3.1 on Windows 10 using CMake and Visual Studio (MSVC x64).
Follow these two steps to download it:
- https://github.com/kontext-tech/winutils
- Go to subfolder hadoop-3.3.1/bin to download the binaries.
Verify the tool
You can run the winutils.exe program in your Windows PC to make sure it works:
Feedback
If you encounter any issues, please comment here.
Hi Craig,
For 3.3.1, it is not easy to compile on Windows. I tried to get it work but unfortunately there were too many errors I encountered. Eventually, I only complied the native HDFS project and reused the JARs from binary package provided by ASF.
person Craig access_time 2 years ago
Re: Hadoop 3.3.1 winutils
Thanks so much for this post and even more so your post about how to compile Hadoop 3.2.1 winutils. I followed those instructions to the letter with great success (starting with a blank Windows 10 VM is definitely a critical starting point!). I have just tried following the same steps to compile 3.3.1 but ran into additional compiler errors on the native HDFS libraries. By chance, did you have to make any tweaks to any files similar to ones you made for 3.2.1 file src\main\native\libhdfs-tests\test_libhdfs_threaded.c? Or any other environment/tool changes you may have made from 3.2.1? Thanks for any feedback you might have.
Thanks so much for this post and even more so your post about how to compile Hadoop 3.2.1 winutils. I followed those instructions to the letter with great success (starting with a blank Windows 10 VM is definitely a critical starting point!). I have just tried following the same steps to compile 3.3.1 but ran into additional compiler errors on the native HDFS libraries. By chance, did you have to make any tweaks to any files similar to ones you made for 3.2.1 file src\main\native\libhdfs-tests\test_libhdfs_threaded.c? Or any other environment/tool changes you may have made from 3.2.1? Thanks for any feedback you might have.
Thanks for the suggestion. I've added the Hadoop project license file in as Hadoop project actually has different license for different part of the project.
https://github.com/kontext-tech/winutils/blob/master/LICENSE.txt
person Dinesh access_time 2 years ago
Re: Hadoop 3.3.1 winutils
Hi - can you please add back the original Apache License to the gitbug (all repos forked from https://github.com/steveloughran/winutils/blob/master/ which is on Apache 2.0)
Hi - can you please add back the original Apache License to the gitbug (all repos forked from https://github.com/steveloughran/winutils/blob/master/ which is on Apache 2.0)
Ah, understood. Luckily, it seems the 3.2.1 winutils files work just fine with the 3.3.1 stock files, so that's good enough for me. Thanks for the quick reply, cheers!
person Raymond access_time 2 years ago
Re: Hadoop 3.3.1 winutils
Hi Craig,
For 3.3.1, it is not easy to compile on Windows. I tried to get it work but unfortunately there were too many errors I encountered. Eventually, I only complied the native HDFS project and reused the JARs from binary package provided by ASF.