When running with master 'yarn' either HADOOP_CONF_DIR or YARN_CONF_DIR must be set
visibility 3,227
comment 0
When submitting a Spark application to run in a Hadoop YARN cluster, it may fail with the following error: Exception in thread "main" org.apache.spark.SparkException: When running with master 'yarn' either HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment.
at ...
thumb_up 2
Log in with external accounts
comment Comments
No comments yet.