arrow_back Install Hadoop 3.3.1 on Windows 10 Step by Step Guide

comment Comments
A Arya Sanjaya #1599 access_time 3 years ago more_vert

tried to reinstall  the winutils from github, but still error like this



Error while running command to get file permissions : java.io.IOException: Cannot run program "C:\hadoop-3.3.1\bin\winutils.exe": CreateProcess error=216, This version of %1 is not compatible with the version of Windows you're running. Check your computer's system information and then contact the software publisher
format_quote

person Raymond access_time 3 years ago

I have not tried installing this on Windows 11 thus wouldn't be able to provide accurate advice about this one. However, can you try winutils directly instead of winutils.exe? The path winutils.exe.exe in the error message is not right.

Raymond Raymond #1598 access_time 3 years ago more_vert

That usually means the installation was not successful and you will need to look into details to find out the actual error. Did you successfully complete all the steps before starting DFS and YARN?

format_quote

person Arya access_time 3 years ago

I always get my datanode and namenode shutdown after using comman startdfs.cmd and start-yarn.cmd. any advise how to settler?
Thanks


Raymond Raymond #1597 access_time 3 years ago more_vert

I have not tried installing this on Windows 11 thus wouldn't be able to provide accurate advice about this one. However, can you try winutils directly instead of winutils.exe? The path winutils.exe.exe in the error message is not right.

format_quote

person Arya access_time 3 years ago

Hi I am having issues with winutils.exe. pls advise

ARYA (arya.sanjaya@pradita.ac.id)

the returned on  command is: 


Program 'winutils.exe.exe' failed to run: The specified executable is not a valid application for this OS platform.At line:1 char:1 + winutils.exe +  CategoryInfo : ResourceUnavailable: (:) [], ApplicationFailedException + FullyQualifiedErrorId : NativeCommandFailed


system info: 
OS Name: Microsoft Windows 11 Pro OS Version: 10.0.22000 N/A Build 22000 OS Manufacturer: Microsoft Corporation OS Configuration: Standalone Workstation OS Build Type: Multiprocessor Free Registered Owner: arya.sanjaya@outlook.com Registered Organization: N/A Product ID: 00330-52275-85811-AAOEM Original Install Date: 11-Nov-21, 1:22:08 AM System Boot Time: 04-Feb-22, 1:54:58 PM System Manufacturer: Acer System Model: TravelMate P2410-G2-M System Type: x64-based PC Processor(s): 1 Processor(s) Installed. [01]: Intel64 Family 6 Model 142 Stepping 10 GenuineIntel ~1600 Mhz BIOS Version: Insyde Corp. V3.02, 12-Nov-18 Windows Directory: C:\WINDOWS System Directory: C:\WINDOWS\system32 Boot Device: \Device\HarddiskVolume1 System Locale: en-us;English (United States) Input Locale: en-us;English (United States) Time Zone: (UTC+07:00) Bangkok, Hanoi, Jakarta Total Physical Memory: 16,261 MB Available Physical Memory: 7,949 MB Virtual Memory: Max Size: 21,758 MB Virtual Memory: Available: 8,754 MB Virtual Memory: In Use: 13,004 MB Page File Location(s): C:\pagefile.sys Domain: WORKGROUP Logon Server: \\ARYA-DUGI-LAPTO Hotfix(s): 5 Hotfix(s) Installed. [01]: KB5008880 [02]: KB5004567 [03]: KB5008295 [04]: KB5009566 [05]: KB5007414 Network Card(s): 4 NIC(s) Installed. [01]: TAP-Windows Adapter V9 Connection Name: Ethernet 2 Status: Media disconnected [02]: Intel(R) Ethernet Connection I219-LM Connection Name: Ethernet Status: Media disconnected [03]: Intel(R) Dual Band Wireless-AC 7265 Connection Name: Wi-Fi DHCP Enabled: Yes DHCP Server: 192.168.1.1 IP address(es) [01]: 192.168.1.18 [02]: fe80::7c59:ef36:46a1:13b5 [04]: Bluetooth Device (Personal Area Network) Connection Name: Bluetooth Network Connection Status: Media disconnected Hyper-V Requirements: VM Monitor Mode Extensions: Yes Virtualization Enabled In Firmware: Yes Second Level Address Translation: Yes Data Execution Prevention Available: Yes


A Arya Sanjaya #1596 access_time 3 years ago more_vert

I always get my datanode and namenode shutdown after using comman startdfs.cmd and start-yarn.cmd. any advise how to settler?
Thanks


A Arya Sanjaya #1595 access_time 3 years ago more_vert

Hi I am having issues with winutils.exe. pls advise

ARYA (arya.sanjaya@pradita.ac.id)

the returned on  command is: 


Program 'winutils.exe.exe' failed to run: The specified executable is not a valid application for this OS platform.At line:1 char:1 + winutils.exe +  CategoryInfo : ResourceUnavailable: (:) [], ApplicationFailedException + FullyQualifiedErrorId : NativeCommandFailed


system info: 
OS Name: Microsoft Windows 11 Pro OS Version: 10.0.22000 N/A Build 22000 OS Manufacturer: Microsoft Corporation OS Configuration: Standalone Workstation OS Build Type: Multiprocessor Free Registered Owner: arya.sanjaya@outlook.com Registered Organization: N/A Product ID: 00330-52275-85811-AAOEM Original Install Date: 11-Nov-21, 1:22:08 AM System Boot Time: 04-Feb-22, 1:54:58 PM System Manufacturer: Acer System Model: TravelMate P2410-G2-M System Type: x64-based PC Processor(s): 1 Processor(s) Installed. [01]: Intel64 Family 6 Model 142 Stepping 10 GenuineIntel ~1600 Mhz BIOS Version: Insyde Corp. V3.02, 12-Nov-18 Windows Directory: C:\WINDOWS System Directory: C:\WINDOWS\system32 Boot Device: \Device\HarddiskVolume1 System Locale: en-us;English (United States) Input Locale: en-us;English (United States) Time Zone: (UTC+07:00) Bangkok, Hanoi, Jakarta Total Physical Memory: 16,261 MB Available Physical Memory: 7,949 MB Virtual Memory: Max Size: 21,758 MB Virtual Memory: Available: 8,754 MB Virtual Memory: In Use: 13,004 MB Page File Location(s): C:\pagefile.sys Domain: WORKGROUP Logon Server: \\ARYA-DUGI-LAPTO Hotfix(s): 5 Hotfix(s) Installed. [01]: KB5008880 [02]: KB5004567 [03]: KB5008295 [04]: KB5009566 [05]: KB5007414 Network Card(s): 4 NIC(s) Installed. [01]: TAP-Windows Adapter V9 Connection Name: Ethernet 2 Status: Media disconnected [02]: Intel(R) Ethernet Connection I219-LM Connection Name: Ethernet Status: Media disconnected [03]: Intel(R) Dual Band Wireless-AC 7265 Connection Name: Wi-Fi DHCP Enabled: Yes DHCP Server: 192.168.1.1 IP address(es) [01]: 192.168.1.18 [02]: fe80::7c59:ef36:46a1:13b5 [04]: Bluetooth Device (Personal Area Network) Connection Name: Bluetooth Network Connection Status: Media disconnected Hyper-V Requirements: VM Monitor Mode Extensions: Yes Virtualization Enabled In Firmware: Yes Second Level Address Translation: Yes Data Execution Prevention Available: Yes


Raymond Raymond #1594 access_time 3 years ago more_vert

jps command is located in bin sub folder of JDK home folder (JAVA_HOME). If it doesn't work, it usally means your PATH environment variable doesn't include %JAVA_HOME%\bin.


format_quote

person Rakesh access_time 3 years ago

Everything worked except jps command. 

R Rakesh Sharma #1593 access_time 3 years ago more_vert

Everything worked except jps command. 

Raymond Raymond #1590 access_time 3 years ago more_vert

You are welcome. Iā€™m glad that everything now works for you. Have fun learning big data.

format_quote

person White access_time 3 years ago

šŸ˜„ Everything worked. šŸ‘šŸ‘šŸ‘

Thank you very much! šŸ˜


W White Portal #1589 access_time 3 years ago more_vert

šŸ˜„ Everything worked. šŸ‘šŸ‘šŸ‘

Thank you very much! šŸ˜


Raymond Raymond #1588 access_time 3 years ago more_vert

You have several options:

  1. Download Eclipse versions (earlier versions) that supports JDK 1.8. 
  2. or replace JDK1.8 with JDK 11 since it is supported for Hadoop 3.3.1 (i.e. change JAVA_HOME to JDK 11 installation folder). In this way, your JAVA_HOME will work for both (Hadoop and Eclipse).
  3. or install additional JDK11 however keep JAVA_HOME as 1.8 version and then change Eclipse config ini file (eclipse.ini in your Eclipse installation folder if I remember correctly) to use JDK11 directly. 
format_quote

person White access_time 3 years ago

Now when opening Eclipse IDE 2021ā€‘12, this happens:

Would I have to use https://eclipse.en.uptodown.com/windows/download/2065150 ? šŸ¤”

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts