spark

Articles tagged with spark.

local_offer spark local_offer hdfs local_offer scala local_offer parquet local_offer spark-file-operations

visibility 14585
thumb_up 0
access_time 3 years ago

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page, I am going to demonstrate how to write and read parquet files in HDFS. import ...

local_offer spark local_offer scala local_offer parquet local_offer spark-file-operations

visibility 20873
thumb_up 0
access_time 3 years ago

In this page, I’m going to demonstrate how to write and read parquet files in Spark/Scala by using Spark SQLContext class. Go the following project site to understand more about parquet. https://parquet.apache.org/ If you have not installed Spark, follow this page to setup: Install Big Data ...

local_offer zeppelin local_offer spark local_offer hadoop local_offer rdd local_offer spark-file-operations

visibility 6757
thumb_up 0
access_time 3 years ago

This page provides an example to load text file from HDFS through SparkContext in Zeppelin (sc). The details about this method can be found at: https://spark.apache.org/docs/2.2.1/api/java/org/apache/spark/SparkContext.html#textFile-java.lang.String-int- ...

local_offer spark

visibility 2190
thumb_up 0
access_time 3 years ago

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. GIT Bash Command Prompt Windows 10 Download the latest binary from the following site: https://spark.apache.org/downloads.html In my case, I am saving the file to folder: F:\DataAnalytics. Open Git ...

local_offer zeppelin local_offer spark local_offer big-data-on-windows-10

visibility 5499
thumb_up 0
access_time 3 years ago

This post summarizes the steps to install Zeppelin 0.7.3 in Windows environment. GIT Bash Command Prompt Windows 10 Download the latest binary package from the following website: http://zeppelin.apache.org/download.html In my case, I am saving the file to folder: F:\DataAnalytics Open ...

Read more

Find more tags on tag cloud.

launch Tag cloud