spark

local_offer spark local_offer hdfs local_offer scala local_offer parquet local_offer spark-file-operations

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page, I am going to demonstrate how to write and read parquet files in HDFS. import ...

local_offer spark local_offer scala local_offer parquet local_offer spark-file-operations

In this page, I’m going to demonstrate how to write and read parquet files in Spark/Scala by using Spark SQLContext class. Go the following project site to understand more about parquet. https://parquet.apache.org/ If you have not installed Spark, follow this page to setup: Install Big Data ...

local_offer zeppelin local_offer spark local_offer hadoop local_offer rdd local_offer spark-file-operations

This page provides an example to load text file from HDFS through SparkContext in Zeppelin (sc). The details about this method can be found at: https://spark.apache.org/docs/2.2.1/api/java/org/apache/spark/SparkContext.html#textFile-java.lang.String-int- ...

local_offer spark

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. GIT Bash Command Prompt Windows 10 Download the latest binary from the following site: https://spark.apache.org/downloads.html In my case, I am saving the file to folder: F:\DataAnalytics. Open Git ...

local_offer zeppelin local_offer spark local_offer big-data-on-windows-10

This post summarizes the steps to install Zeppelin 0.7.3 in Windows environment. GIT Bash Command Prompt Windows 10 Download the latest binary package from the following website: http://zeppelin.apache.org/download.html In my case, I am saving the file to folder: F:\DataAnalytics Open ...