arrow_back Apache Hive 3.1.1 Installation on Windows 10 using Windows Subsystem for Linux
person Guy access_time 4 years ago
thank you for reply !
while starting this command:
$HIVE_HOME/bin/hive --service metastore
i got this error in the log:
2021-01-29T18:10:30,565 ERROR [main] metastore.HiveMetaStore: Metastore Thrift Server threw an exception...
org.apache.hadoop.hive.metastore.api.MetaException: Version information not found in metastore.
and this:
Caused by: java.net.ConnectException: Call From guyHP/127.0.1.1 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
this command:
$HIVE_HOME/bin/hive --service hiveserver2
seems to run ok.
guya@guyHP:~$ $HIVE_HOME/bin/hive --service hiveserver2
2021-01-29 18:12:26: Starting HiveServer2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/guya/hadoop/apache-hive-3.1.2-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/guya/hadoop/hadoop-3.3.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Hive Session ID = 91577ee2-3d67-4369-a63d-0165f6221a62
Hive Session ID = 69299ff5-af98-44e5-a473-d102a1b28d93
thank you for reply !
while starting this command:
$HIVE_HOME/bin/hive --service metastore
i got this error in the log:
2021-01-29T18:10:30,565 ERROR [main] metastore.HiveMetaStore: Metastore Thrift Server threw an exception...
org.apache.hadoop.hive.metastore.api.MetaException: Version information not found in metastore.
and this:
Caused by: java.net.ConnectException: Call From guyHP/127.0.1.1 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
this command:
$HIVE_HOME/bin/hive --service hiveserver2
seems to run ok.
guya@guyHP:~$ $HIVE_HOME/bin/hive --service hiveserver2
2021-01-29 18:12:26: Starting HiveServer2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/guya/hadoop/apache-hive-3.1.2-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/guya/hadoop/hadoop-3.3.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Hive Session ID = 91577ee2-3d67-4369-a63d-0165f6221a62
Hive Session ID = 69299ff5-af98-44e5-a473-d102a1b28d93
person Raymond access_time 4 years ago
That potentially suggests that your Hive metastore and HiveServer2 services are not started successfully. Can you please check the log files to find out the actual errors?
The logs are located here:
/tmp/<userid>/hive.log
/tmp/<userid>/hive.log.**
That potentially suggests that your Hive metastore and HiveServer2 services are not started successfully. Can you please check the log files to find out the actual errors?
The logs are located here:
/tmp/<userid>/hive.log
/tmp/<userid>/hive.log.**
person Guy access_time 4 years ago
hello
i followed your hadoop install in wsl guide and it worked fine. but this one for hive is not. i am not able to connect to local web gui and not with python . port 10000 is not listening. i also cannot find any help about it.
thank you
hello
i followed your hadoop install in wsl guide and it worked fine. but this one for hive is not. i am not able to connect to local web gui and not with python . port 10000 is not listening. i also cannot find any help about it.
thank you
Hi,
Sorry for the late reply.
From the screenshot, I can see you are installing Hive 3.1.2 with Hadoop 3.3.0.
This guide was only tested with Hive 3.1.1.
Can you ensure you use the 3.1.1 binary package to install?
The error you encountered seems to be related to different versions of JAR packages in your Hadoop and Hive library folder.
person Jesdin access_time 4 years ago
I am unable to initialize schema
$HIVE_HOME/conf/hive-site.xml
<configuration>
<property>
<name>hive.metastore.event.db.notification.api.auth</name>
<value>false</value>
<description>
Should metastore do authorization against database notification related APIs such as get_next_notification.
If set to true, then only the superusers in proxy settings have the permission
</description>
</property>
</configuration>
$HADOOP_HOME/etc/hadoop/core-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>hadoop.proxyuser.dataflair.groups</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.dataflair.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.jesdin.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.jesdin.groups</name>
<value>*</value>
</property>
</configuration>
I am unable to initialize schema
$HIVE_HOME/conf/hive-site.xml
<configuration>
<property>
<name>hive.metastore.event.db.notification.api.auth</name>
<value>false</value>
<description>
Should metastore do authorization against database notification related APIs such as get_next_notification.
If set to true, then only the superusers in proxy settings have the permission
</description>
</property>
</configuration>
$HADOOP_HOME/etc/hadoop/core-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>hadoop.proxyuser.dataflair.groups</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.dataflair.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.jesdin.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.jesdin.groups</name>
<value>*</value>
</property>
</configuration>
This article is for Hive 3.1.1 installation on Windows 10 using WSL. All the command line needs to run in WSL bash window (not Command Prompt).
Based on your screenshot, you are trying to install it on Windows 10 directly. If that's the case, please following the following article:
Apache Hive 3.0.0 Installation on Windows 10 Step by Step Guide
It has been tested by quite a few users with successful installation.
person Yathish access_time 4 years ago
How do we run schematool in windows.
Also failing to run with cygwin available
How do we run schematool in windows.
Also failing to run with cygwin available
If it doesn’t exist, you can create one using the template file in the same directory : hive-site.xml.template.
If the template file didn’t exist either, you can create this file directly. The root element for this XML file is configuration:
<configuration>
...
</configuration>
person Arun access_time 5 years ago
Hi Mate, we couldn't find file "$HIVE_HOME/conf/hive-site.xml" in 3.1.1 package. Alternatively tried other versions couldn't find same file there too.
Please let me know how do I get/fix it.
Many Thanks
Hi Mate, we couldn't find file "$HIVE_HOME/conf/hive-site.xml" in 3.1.1 package. Alternatively tried other versions couldn't find same file there too.
Please let me know how do I get/fix it.
Many Thanks
Hi Guy,
Most likely it is because that your Hive Metastore database schema is not correct, for example, init schema operation was not done properly.
Can you conduct the following two actions?
These tables are used by Hive to store metadata of your objects in Hive database.
If you cannot start metastore service successfully, HiveServer2 thrift service will not be able to function properly.