Raymond Raymond / Spark & PySpark

Show Headings (Column Names) in spark-sql CLI Result

event 2020-12-28 visibility 1,306 comment 0 insights toc
insights Stats

In Spark-SQL CLI tool, the result print will omit headings (column names) by default. To display columns, we need to update Spark setting spark.hadoop.hive.cli.print.header.

Update Spark defaults file

To make the changes for all spark-sql sessions, edit file $SPARK_HOME/conf/spark-defaults.conf.

Add the following line into the file:

spark.hadoop.hive.cli.print.header true

Pass config value when starting session

If you only want to make this config effective for the session, start spark-sql CLI with the following argument:

spark-sql --conf "spark.hadoop.hive.cli.print.header=true"
More from Kontext
comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts