
一、集群部署说明
| 节点 | linux版本 | ip | impala服务 |
| node1 | centos7 | 192.168.88.161 | impalad,dataNode |
| node2 | centos7 | 192.168.88.162 | impalad,dataNode |
| node3 | centos7 | 192.168.88.163 | impalad,dataNode impala state store impala catalogd, impala-shell |
二、安装版本、配置本地http服务、配置本地yum源
| impala版本 | 说明 |
| impala-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm | |
| impala-catalog-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm | |
| impala-server-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm | |
| impala-shell-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm | |
| impala-state-store-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm |
本地yum源配置参考:kudu 1.10.0-cdh6.3.0 本地yum源安装
https://blog.csdn.net/yxluojiecpp/article/details/126485942
三、开始安装,如下图所示
node3:yum install -y impala impala-server impala-state-store impala-catalog impala-shell
node2:yum install -y impala-server
node1:yum install -y impala-server
四、修改Hadoop配置
在3个节点操作:mkdir -p /var/run/hdfs-sockets
在node1上操作:vim /export/server/hadoop/etc/hadoop/hdfs-site.xml,配置impalad与相同节点的dataNode之间的通信,然后分发给node2,node3,重启hadoop服务。
dfs.client.read.shortcircuit
true
dfs.domain.socket.path
/var/run/hdfs-sockets/dn
dfs.client.file-block-storage-locations.timeout.millis
10000
dfs.datanode.hdfs-blocks-metadata.enabled
true
五、修改hive配置
在node1上操作,vim /export/server/hive/conf/hive-site.xml,配置hiveserve2和metastore服务,然后分发给node2,node3,重启hiveserver2和metastore服务。
hive.server2.thrift.bind.host
node1
hive.metastore.uris
thrift://node1:9083
六、复制Hadoop、Hive配置文件给impala,3个节点都要操作。
cp /export/server/hadoop/etc/hadoop/core-site.xml /etc/impala/conf/core-site.xml cp /export/server/hadoop/etc/hadoop/hdfs-site.xml /etc/impala/conf/hdfs-site.xml cp /export/server/hive/conf/hive-site.xml /etc/impala/conf/hive-site.xml
七、修改impala配置
node3的配置如下图
node2和node1的配置如下图
八、修改bigtop配置,配置java路径,3台节点都要操作
九、启动impala
node3:
node2、node1
十、访问impalad-webui
十一、访问statestored-webui
十二、impala成功与hive关联
十二、删除impalad服务的前端java进程
十三、感谢其他网友的分享
Impala集群搭建报错,主节点启动成功,但是worker节点的impalad启动失败
https://blog.csdn.net/weixin_42492886/article/details/122666437
impala 由于python版本的启动问题_jaysen1005的博客-CSDN博客
https://blog.csdn.net/weixin_36636708/article/details/105764481