安装Hadoop需要JVM环境首先下载JAVA
1:下载
http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
2:解压
tar -zxvf jdk-8u144-linux-x64.tar.gz -C /usr/local
1:下载Hadoop
http://archive.apache.org/dist/hadoop/common/hadoop-2.7.4/hadoop-2.7.4.tar.gz
2:解压
tar -zxvf hadoop-2.7.4.tar.gz -C /usr/local
3:配置环境变量 vim /etc/profile ,在下面添加:
#java
JAVA_HOME=/usr/local/java/jdk8
JRE_HOME=/usr/local/java/jdk8/jre
PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
CLASSPATH=.:$JAVA_HOME/lib/jt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib
export JAVA_HOME JRE_HOME PATH CLASSPATH
#HADOOP
export HADOOP_HOME=/usr/local/hadoop-2.7.1
export PATH=${PATH}:${HADOOP_HOME}/bin:${PATH}:${HADOOP_HOME}/sbin
4:source /etc/profile 生效
查看是否成功
java -version
hadoop version #这个没有 -
5:配置
vim /usr/local/hadoop-2.7.1/etc/hadoop/hadoop-env.sh
# 把相对路径换成绝对路径
#export JAVA_HOME=${JAVA_HOME}
export JAVA_HOME=/usr/local/java/jdk8
6:测试小demo
#首先创建一个文件夹名字为bigdatacase
mkdir /usr/local/bigdatacase
#拷贝 hadoop etc/hadoop 所有以.xml结尾文件 to 创建的文件夹
cp ./etc/hadoop/*.xml /usr/local/bigdatacase/
#执行命令
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar wordcount /usr/local/bigdatacase/ /usr/local/bigdataout/00
#查看是否成功
ll /usr/local/bigdataout/00
出现两个文件 一个文件名 为_SUCCESS 代表成功,成功数据在对应的另外一个文件
cat part-r-00000