By using this site, you acknowledge that you have read and understand our Cookie policy, Privacy policy and Terms .
access_time 9 months ago comment 0 languageEnglish
visibility 1142 arrow_upward arrow_downward

When running pyspark or spark-submit command in Windows to execute python scripts, you may encounter the following error:

PermissionError: [WinError 5] Access is denied

As it’s self-explained, permissions are not setup correctly.

To resolve this issue you can try different approaches:

  • Run the program as an Administrator
  • Or configure the security for your PySpark executable properly.

pyspark command exists in your ‘bin’ subfolder under Spark home folder. Make sure the permissions are configured correctly for the user that you are using to execute the script.

image

In my system, the error occurred because my current user has no permission to the Spark folder and its subfolders.

info Last modified by Raymond at 9 months ago

Please log in or register to comment. account_circle Log in person_add Register
comment Comments (0)
No comments yet.
account_circle Raymond

Articles about Apache Spark

open_in_new View