Show Headings (Column Names) in spark-sql CLI Result

visibility 940 event 2020-12-28 access_time 3 years ago language English

more_vert

In Spark-SQL CLI tool, the result print will omit headings (column names) by default. To display columns, we need to update Spark setting spark.hadoop.hive.cli.print.header.

Update Spark defaults file

To make the changes for all spark-sql sessions, edit file $SPARK_HOME/conf/spark-defaults.conf.

Add the following line into the file:

spark.hadoop.hive.cli.print.header true

Pass config value when starting session

If you only want to make this config effective for the session, start spark-sql CLI with the following argument:

spark-sql --conf "spark.hadoop.hive.cli.print.header=true"

Log in with external accounts

toc Table of contents

Update Spark defaults file
Pass config value when starting session

insights Stats

warning Please login first to view stats information.

tag spark

article Spark cache() and persist() Differences article Install Zeppelin 0.7.3 on Windows article Get Started on .NET 5 with Apache Spark article Write and read parquet files in Python / Spark article Error: Failed to load class org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver Read more (126)

tagSpark SQL