Tag - spark

Load Data into HDFS from SQL Server via Sqoop

19 views   0 comments last modified about 3 days ago spark

This page shows how to import data from SQL Server into Hadoop via Apache Sqoop. Prerequisites Please follow the link below to install Sqoop in your machine if you don’t have one environment ready. ...

View detail

Write and Read Parquet Files in HDFS through Spark/Scala

59 views   0 comments last modified about 2 months ago spark

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page...

View detail

Write and Read Parquet Files in Spark/Scala

34 views   0 comments last modified about 2 months ago spark

In this page, I’m going to demonstrate how to write and read parquet files in Spark/Scala by using Spark SQLContext class. Reference What is parquet format? Go the following project site to understand more about parquet. ...

View detail

Read Text File from Hadoop in Zeppelin through Spark Context

75 views   0 comments last modified about 2 months ago spark

Background This page provides an example to load text file from HDFS through SparkContext in Zeppelin (sc). Reference The details about this method can be found at: SparkContext.textFile ...

View detail

Install Zeppelin 0.7.3 in Windows

192 views   0 comments last modified about 2 months ago spark

This post summarizes the steps to install Zeppelin 0.7.3 in Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary package from the following website: ...

View detail

Install Spark 2.2.1 in Windows

38 views   0 comments last modified about 3 months ago spark

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary from the following site: ...

View detail