Re: Apache Spark 2.4.3 Installation on Windows 10 using Windows Subsystem for Linux

Jo*** about 23 days ago

Hi,

Thanks for pointing out the error. I did as you suggested and it works now! Great post on setting up Apache and Hadoop in WSL!

Jonathan

Add comment

Comments (4)

Raym*** about 23 days ago

@Jonathan

I’m glad to hear that it’s now working for you.

Jo*** about 23 days ago

Hi,

Thanks for pointing out the error. I did as you suggested and it works now! Great post on setting up Apache and Hadoop in WSL!

Jonathan

Jo*** about 23 days ago

Hi,

Thanks for pointing out the error. I did as you suggested and it works now! Great post on setting up Apache and Hadoop in WSL!

Jonathan

Raym*** about 27 days ago

Hi,

run-example is a command not an Scala function. The script file exists in $SPARK_HOME/bin folder. Thus please directly run it in bash (WSL terminal) instead of running it in Spark shell.

Let me know if you have other questions.

Jo*** about 27 days ago

I folllowed your instructions and installed scala after installing hadoop. But when I try to run the SparkPi example, i get the following;

scala> run-example SparkPi 10

<console>:24: error: not found: value run

       run-example SparkPi 10

       ^

<console>:24: error: not found: value example

       run-example SparkPi 10

Not sure what the error is. Thanks.

Sincerely

Jonathan

Jo*** about 27 days ago

I folllowed your instructions and installed scala after installing hadoop. But when I try to run the SparkPi example, i get the following;

scala> run-example SparkPi 10

<console>:24: error: not found: value run

       run-example SparkPi 10

       ^

<console>:24: error: not found: value example

       run-example SparkPi 10

Not sure what the error is. Thanks.

Sincerely

Jonathan