Big Data Tools on WSL

This series provides detailed tutorials about installing big data tools such as Hadoop, Spark, Hive, Sqoop, etc. on Windows 10 via WSL (Windows Subsystem for Linux). 

* Logos used in the picture are registered trademarks of Apache or Linux foundations. 

Big Data Tools on WSL
Install Hadoop 3.3.0 on Windows 10 using WSL

local_offer linux local_offer hadoop local_offer WSL local_offer big-data-on-wsl

visibility 2806
thumb_up 6
access_time 4 months ago

Hadoop 3.3.0 was released on July 14 2020. It is the first release of Apache Hadoop 3.3 line. There are significant changes compared with Hadoop 3.2.0, such as Java 11 runtime support, protobuf upgrade to 3.7.1, scheduling of opportunistic containers, non-volatile SCM support in HDFS ...

local_offer linux local_offer sqoop local_offer WSL local_offer big-data-on-wsl

visibility 1631
thumb_up 0
access_time 2 years ago

This page summarizes the steps required to install Apache Sqoop (v1.4.7) in Windows 10 environment via Windows Subsystem for Linux (WSL). If you have already installed Hadoop 3.2.0 in WSL, ignore the following steps as you don’t need to install it again. Follow  the following pages to ...

local_offer spark local_offer linux local_offer WSL local_offer big-data-on-wsl

visibility 7964
thumb_up 0
access_time 2 years ago

This pages summarizes the steps to install the latest version 2.4.3 of Apache Spark on Windows 10 via Windows Subsystem for Linux (WSL). Follow either of the following pages to install WSL in a system or non-system drive on your Windows 10. Install Windows Subsystem for Linux on a Non-System ...

local_offer zeppelin local_offer spark local_offer linux local_offer WSL local_offer big-data-on-wsl

visibility 3218
thumb_up 0
access_time 2 years ago

This page summarizes the steps to install Zeppelin version 0.7.3 on Windows 10 via Windows Subsystem for Linux (WSL). When running Zeppelin in Ubuntu, the server may pick up one host address that is not accessible, for example 169.254.148.100, and the the remote interpreter connection cannot be ...

Apache Hive 3.1.1 Installation on Windows 10 using Windows Subsystem for Linux

local_offer hadoop local_offer hive local_offer WSL local_offer big-data-on-wsl

visibility 5004
thumb_up 0
access_time 2 years ago

Previously, I demonstrated how to configured Apache Hive 3.0.0 on Windows 10. Apache Hive 3.0.0 Installation on Windows 10 Step by Step Guide On this page, I’m going to show you how to install the latest version Apache Hive 3.1.1 on Windows 10 using Windows Subsystem for Linux (WSL) Ubuntu ...

local_offer linux local_offer WSL local_offer ubuntu local_offer big-data-on-wsl

visibility 12874
thumb_up 6
access_time 2 years ago

This page shows how to install Windows Subsystem for Linux (WSL) system on a non-system drive manually. Open PowerShell as Administrator and run the following command to enable WSL feature: Enable-WindowsOptionalFeature -Online -FeatureName Microsoft-Windows-Subsystem-Linux Run the following ...

local_offer hadoop local_offer linux local_offer WSL local_offer big-data-on-wsl

visibility 19849
thumb_up 11
access_time 2 years ago

In my previous post , I showed how to configure a single node Hadoop instance on Windows 10. The steps are not too difficult to follow if you have Java programming background. However there is one step that is not very straightforward: native Hadoop executable (winutils.exe) is not included in the ...

Read more

Find more tags on tag cloud.

launch Tag cloud