ambari-server 执行
VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'`
sudo git clone https://github.com/julyme/ambari-impala-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/IMPALA
所有服务器配置impala.repo
[cloudera-cdh5] # Packages for Cloudera's Distribution for Hadoop, Version 5, on RedHat or CentOS 7 x86_64 name=Cloudera's Distribution for Hadoop, Version 5 baseurl=https://cloudera.proxy.ustclug.org/cdh5/redhat/7/x86_64/cdh/5/ gpgkey=https://cloudera.proxy.ustclug.org/cdh5/redhat/7/x86_64/cdh/RPM-GPG-KEY-cloudera gpgcheck = 1
https://cloudera.proxy.ustclug.org 中科大镜像源
https://archive.cloudera.com 官方
然后执行
yum clean all yum list update yum makecache yum repolist
在ambari上添加impala服务,然后配置hdfs
5.hdfs增加配置 #HDFS config we need add below config to /etc/hadoop/conf/core-site.xml <property> <name>dfs.client.read.shortcircuit</name> <value>true</value> </property> <property> <name>dfs.client.read.shortcircuit.skip.checksum</name> <value>false</value> </property> <property> <name>dfs.datanode.hdfs-blocks-metadata.enabled</name> <value>true</value> </property> we need add below config to /etc/hadoop/conf/hdfs-site.xml <property> <name>dfs.datanode.hdfs-blocks-metadata.enabled</name> <value>true</value> </property> <property> <name>dfs.block.local-path-access.user</name> <value>impala</value> </property> <property> <name>dfs.client.file-block-storage-locations.timeout.millis</name> <value>60000</value> </property>
安装后无法启动Impala,查看日志
cd /var/log/impala/
cat impala-state-store.log
ind: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory /usr/lib/impala/sbin/statestored: error while loading shared libraries: libjsig.so: cannot open shared object file: No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory /usr/lib/impala/sbin/statestored: error while loading shared libraries: libjsig.so: cannot open shared object file: No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory /usr/lib/impala/sbin/statestored: error while loading shared libraries: libjsig.so: cannot open shared object file: No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory /usr/lib/impala/sbin/statestored: error while loading shared libraries: libjsig.so: cannot open shared object file: No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory /usr/lib/impala/sbin/statestored: error while loading shared libraries: libjsig.so: cannot open shared object file: No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory find: '/usr/jdk64//': No such file or directory /usr/lib/impala/sbin/statestored: error while loading shared libraries: libjsig.so: cannot open shared object file: No such file or directory
通过命令查找
find / -name libjsig.so
/usr/local/java/jdk1.8.0_111/jre/lib/amd64/libjsig.so
/usr/local/java/jdk1.8.0_111/jre/lib/amd64/server/libjsig.so
猜测是JAVA_HOME问题
修改/etc/default/bigtop-utils
把其中的JAVA_HOME改正确
export JAVA_HOME=/usr/local/java/jdk1.8.0_111