The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-
Recently when I run Spark + HDFS on Win7 desktop. I always got following error message in Spark's driver log.
java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-
Somebody suggested if I can run winutils ls /tmp/hive in Win7. I tried, and got this error.
access denied or FindFileOwnerAndPermission error (1789): The trust relationship between this workstation and the primary domain failed.
It seems something was wrong in my local Win7. I struggled for a time, and finally found the reason. Recently I modified my DNS of local network connection, and provided a wrong IP address. Winutils just could not connect to our Domain Controller for user verification. Once I set up a correct DNS of my network, and restart the machine, the issue was gone!

0 Comments:
Post a Comment
<< Home