版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/yvigmmwfn/article/details/78679429
软件环境
CentOS 6.8
Hadoop 2.6.0-cdh5.9.0
Hive 1.1.0-cdh5.9.0
Zookeeper 3.4.5-cdh5.9.0
工作原理
常规连接
HiverServer HA
- 配置Hive HA
前置条件先安装好Hadoop、Zookeeper
vi $HIVE_HOME/conf/hive-site.xml
添加配置如下:
<property>
<name>hive.server2.support.dynamic.service.discovery</name>
<value>true</value>
</property>
<property>
<name>hive.server2.zookeeper.namespace</name>
<value>hiveserver2_zk</value>
</property>
<property>
<name>hive.zookeeper.quorum</name>
<value>dw1:2181,dw2:2181,dw3:2181</value>
</property>
<property>
<name>hive.zookeeper.client.port</name>
<value>2181</value>
</property>
<property>
<name>hive.server2.thrift.bind.host</name>
<value>主机名(强烈建议使用主机名防止IP发生变化)</value>
</property>
启动HiveServer2
$HIVE_HOME/bin/hiveserver2
//默认端口为10000检查Zookeeper注册
登录Zookeeper对应的服务器
执行zookeeper-client如下:
[zk: localhost:2181(CONNECTED) 0] ls /hiveserver2_zk
[serverUri=dw2:10000;version=1.1.0-cdh5.9.0;sequence=0000000006, serverUri=dw1:10000;version=1.1.0-cdh5.9.0;sequence=0000000007]
[zk: localhost:2181(CONNECTED) 1]
以上表示注册成功
- 连接hiveserver2
连接字符串如下:
$HIVE_HOME/bin/beeline -u "jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk" hadoop hadoop
连接成功信息如下:
hadoop@dw6:~$ $HIVE_HOME/bin/beeline -u "jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk" hadoop hadoop
scan complete in 1ms
Connecting to jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk
17/11/30 18:40:52 [main]: INFO jdbc.HiveConnection: Connected to dw1:10000
Connected to: Apache Hive (version 1.1.0-cdh5.9.0)
Driver: Hive JDBC (version 1.1.0-cdh5.9.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.1.0-cdh5.9.0 by Apache Hive
0: jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/de> show tables;
+----------------+--+
| tab_name |
+----------------+--+
| test_datediff |
| web_logs |
| web_logs_1 |
| web_logs_orc |
| web_logs_text |
+----------------+--+
5 rows selected (0.147 seconds)
0: jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/de>
- 文章参考
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_hadoop-ha/content/ch_HA-Hive.html
http://lxw1234.com/archives/2016/05/675.htm