access_time 12 months ago languageEnglish
more_vert

Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

visibility 15,080 comment 36
This detailed step-by-step guide shows you how to install the latest Hadoop v3.3.0 on Windows 10. It leverages Hadoop 3.3.0 winutils tool and WSL is not required. This version was released on July 14 2020. It is the first release of Apache Hadoop 3.3 line. There are significant changes compared ...
info Last modified by Raymond 1 month ago
thumb_up 15

comment Comments

9 days ago link more_vert

I need your system information:

OS Name:                   Microsoft Windows 10 Pro
OS Version:                10.0.19043 N/A Build 19043
OS Manufacturer:           Microsoft Corporation
OS Configuration:          Standalone Workstation
OS Build Type:             Multiprocessor Free
...
System Type:               x64-based PC
Processor(s):              1 Processor(s) Installed.
                           [01]: Intel64 Family 6 Model 94 Stepping 3 GenuineIntel ~2601 Mhz

You can get it from systeminfo command. 

format_quote

person Antonio access_time 11 days ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

I'm facing the same issue, do you want my powershell version is

Name                           Value
----                           -----
PSVersion                      5.1.19041.1023
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.19041.1023
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1



11 days ago link more_vert

I'm facing the same issue, do you want my powershell version is

Name                           Value
----                           -----
PSVersion                      5.1.19041.1023
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.19041.1023
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1



format_quote

person Raymond access_time 1 month ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

Can you provide your system information here? The one I compiled is for x64 systems. 

1 month ago link more_vert

Thanks for the feedback. I've update it. :)

format_quote

person Şahin access_time 1 month ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

You could cd $client_dir instead of cd F:/big-data

1 month ago link more_vert

Can you provide your system information here? The one I compiled is for x64 systems. 

format_quote

person Şahin access_time 1 month ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

After writing winutils.exe, I get the error:

Program 'winutils.exe' failed to run: The specified executable is not a valid application for this OS platform.At line:

1 char:1

+ .\winutils.exe

+ ~~~~~~~~~~~~~~.

At line:1 char:1

+ .\winutils.exe

+ ~~~~~~~~~~~~~~

    + CategoryInfo          : ResourceUnavailable: (:) [], ApplicationFailedException

    + FullyQualifiedErrorId : NativeCommandFailed

1 month ago link more_vert

After writing winutils.exe, I get the error:

Program 'winutils.exe' failed to run: The specified executable is not a valid application for this OS platform.At line:

1 char:1

+ .\winutils.exe

+ ~~~~~~~~~~~~~~.

At line:1 char:1

+ .\winutils.exe

+ ~~~~~~~~~~~~~~

    + CategoryInfo          : ResourceUnavailable: (:) [], ApplicationFailedException

    + FullyQualifiedErrorId : NativeCommandFailed

1 month ago link more_vert

You could cd $client_dir instead of cd F:/big-data

5 months ago link more_vert

It is confirmed by Naseemuddin that the special build I did for non-English Windows 10 system is working for him:

Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide - Kontext

winutils/hadoop-3.3.0-YARN-8246/bin at master · kontext-tech/winutils · GitHub



format_quote

person R4F access_time 5 months ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

HI did you find a solution i have the same issu..

5 months ago link more_vert

Hi Chenhao,

Is this guide working for you? 

-Raymond

format_quote

person Chenghao access_time 5 months ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

Thank u,it doesn’t work after installing it many times, just use yours for a while

5 months ago link more_vert

HI did you find a solution i have the same issu..

format_quote

person Raymond access_time 6 months ago
Re: Install Hadoop 3.3.0 on Windows 10 Step by Step Guide

Hi, for the winutils I built for Hadoop 3.3.0, I didn't face any issue like that.

Hadoop 3.3.0 winutils

Can you try if the ones I published work for you?

If you want to build winutils by yourself, you need to complete these steps:

  1. You can follow the commit in the PR to apply changes to your local Hadoop 3.3.0 repo: YARN-8246 winutils - fix failure to retrieve disk and network perf co… by pgoron · Pull Request #458 · apache/hadoop (github.com)
  2. Refer to Compile and Build Hadoop 3.2.1 on Windows 10 Guide  about how to build Hadoop on Windows 10. You need to change some of the dependencies (tools/frameworks) to the Hadoop 3.3.0 ones based on the Build.txt requirements of 3.3.0 release. 
5 months ago link more_vert

Thank u,it doesn’t work after installing it many times, just use yours for a while

Forum discussions for column Hadoop.

Follow Kontext

Get our latest updates on LinkedIn.

Want to contribute on Kontext to help others?

Learn more