Hive安装配置笔记


Hive元数据三种存储方式
1.Derby:hive默认的存储模式,不可以并发调用hive
2.本地MySQL
3.远程MySQL

采用第二种方式,安装MySQL,启动并创建Hive用户,创建Hive元数据库

insert into mysql.user(Host,User,Password) values("localhost","hive",password("hive"));

create database hive;

grant all on hive.* to hive@'%' identified by 'hive';

grant all on hive.* to hive@'localhost' identified by 'hive';

flush privileges;

配置Hive环境变量

vim /etc/profile

修改Hive配置

修改hive-site.xml

<property>

name>javax.jdo.option.ConnectionURL </name>

value>jdbc:mysql://localhost:3306/hive </value>

</property>

<property>

name>javax.jdo.option.ConnectionDriverName </name>

value>com.mysql.jdbc.Driver </value>

</property>

<property>

name>javax.jdo.option.ConnectionPassword </name>

value>hive </value>

</property>

<property>

name>hive.hwi.listen.port </name>

value>9999 </value>

description>This is the port the Hive Web Interface will listen on </descript ion>

</property>

<property>

name>datanucleus.autoCreateSchema </name>

value>true</value>

</property>

<property>

name>datanucleus.fixedDatastore </name>

value>false</value>

</property>

</property>

property>

name>javax.jdo.option.ConnectionUserName</name>

value>hive</value>

description>Username to use against metastore database</description>

/property>

property>

name>hive.exec.local.scratchdir</name>

value>/home/hdpsrc/hive/iotmp</value>

description>Local scratch space for Hive jobs</description>

/property>

property>

name>hive.downloaded.resources.dir</name>

value>/home/hdpsrc/hive/iotmp</value>

description>Temporary local directory for added resources in the remote file system.</description>

/property>

property>

name>hive.querylog.location</name>

value>/home/hdpsrc/hive/iotmp</value>

description>Location of Hive run time structured log file</description>

/property>

注意事项

  • 找到mysql的jdbc驱动,比如mysql-connector-java-5.1.6-bin.jar拷贝到hive/lib目录下
  • hive/lib/jline-2.12.jar拷贝到/Hadoop/yarn/lib/目录下

启动Hive,测试

在hive中新建表

在MySQL中查看

Hive编程指南 PDF 中文高清版 

基于Hadoop集群的Hive安装

Hive内表和外表的区别

Hadoop + Hive + Map +reduce 集群安装部署

Hive本地独立模式安装

Hive学习之WordCount单词统计

Hive运行架构及配置部署

Hive 的详细介绍:请点这里
Hive 的下载地址:请点这里

本文永久更新链接地址

相关内容

    暂无相关文章