Hive安装教程

前提条件

已经安装好hadoop集群以及mysql

CentOS7搭建Hadoop3集群教程

CentOS7安装MySQL教程

下载hive

hive3.1.3下载连接：https://archive.apache.org/dist/hive/hive-3.1.3/apache-hive-3.1.3-bin.tar.gz

登录master服务器hadoop，将压缩包上传到/opt/software

解压

tar -zxvf apache-hive-3.1.3-bin.tar.gz -C /opt/module/

将MySQL的驱动包，放入hive的lib目录

下载MySQL驱动包：
https://repo1.maven.org/maven2/mysql/mysql-connector-java/5.1.34/mysql-connector-java-5.1.34.jar

cd /opt/module/apache-hive-3.1.3-bin/lib

修改配置

创建mysql用户 hive/hive

赋权：

grant all privileges on *.* to 'hive'@'%' with grant option;commit;flush privileges;

修改Hadoop配置

core-site.xml增加

vim /opt/module/hadoop-3.1.3/etc/hadoop/core-site.xml

<property><name>hadoop.proxyuser.hive.hosts</name><value>*</value>
</property>
<property><name>hadoop.proxyuser.hive.groups</name><value>*</value>
</property>

su root
vim /etc/profile.d/hadoop.sh

添加

export HADOOP_USER_NAME=hive

配置hive环境变量

cd /opt/module/apache-hive-3.1.3-bin/conf
mv hive-env.sh.template hive-env.sh
vim hive-env.sh最后面添加
export HIVE_CONF_DIR=/export/server/apache-hive-3.1.3-bin/conf
export HIVE_AUX_JARS_PATH=/export/server/apache-hive-3.1.3-bin/lib
保存退出

配置hive-site.xml

cd /opt/module/apache-hive-3.1.3-bin/conf
vim hive-site.xml

<configuration><property><name>javax.jdo.option.ConnectionURL</name><value>jdbc:mysql://hadoop-master:3306/hive?createDatabaseIfNotExist=true&amp;useSSL=false&amp;useUnicode=true&amp;characterEncoding=UTF-8</value></property><property><name>javax.jdo.option.ConnectionDriverName</name><value>com.mysql.jdbc.Driver</value></property><property><name>javax.jdo.option.ConnectionUserName</name><value>hive</value></property><property><name>javax.jdo.option.ConnectionPassword</name><value>hive</value></property><property><name>hive.server2.thrift.bind.host</name><value>hadoop-master</value></property><property><name>hive.metastore.uris</name><value>thrift://hadoop-master:9083</value></property><property><name>hive.metastore.event.db.notification.api.auth</name><value>false</value></property></configuration>

初始化元数据

CREATE DATABASE hive CHARSET UTF8;

cd /opt/module/hadoop-3.1.3/share/hadoop/common/lib
cp guava-27.0-jre.jar /opt/module/apache-hive-3.1.3-bin/lib/cd /opt/module/apache-hive-3.1.3-bin/lib
mv guava-19.0.jar guava-19.0.jar.bakcd /opt/module/apache-hive-3.1.3-bin/bin
./schematool -initSchema -dbType mysql -verbos

启动

cd /opt/module/apache-hive-3.1.3-bin
mkdir logs
cd /opt/module/apache-hive-3.1.3-bin
nohup bin/hive --service metastore >> logs/metastore.log 2>&1 &
tail -f logs/metastore.log
./bin/hiveserver2

测试

cd /opt/module/apache-hive-3.1.3-bin
bin/hiveshow databases

http://192.168.126.110:10002/