spark-file-operations

PySpark - Read and Write JSON

PySpark - Read and Write Orc Files

PySpark - Read and Write Avro Files

Load CSV File in PySpark

PySpark Read Multiline (Multiple Lines) from CSV File

Read and Write XML files in PySpark

Save DataFrame as CSV File in Spark

Read JSON file as Spark DataFrame in Python / Spark

Spark has easy fluent APIs that can be used to read data from JSON file as DataFrame object.

Write and read parquet files in Python / Spark

Parquet is columnar store format published by Apache. It's commonly used in Hadoop ecosystem. There are many programming language APIs that have been implemented to support writing and reading parquet files.

Write and Read Parquet Files in HDFS through Spark/Scala

Write and Read Parquet Files in Spark/Scala

Read Text File from Hadoop in Zeppelin through Spark Context