目标平台:Cnetos6.8
要求:默认关闭防火墙,禁用selinux,网络正常,配置计算机名称
上传hadoop的tar包和jdk的rpm包
rpm -ivh jdk-8u172-linux-x64.rpm
tar -zxf hadoop-3.1.1.tar.gz -C/opt
免密钥登录:
ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
chmod 0600 ~/.ssh/authorized_keys
环境变量设置:
export JAVA_HOME=/usr/java/jdk1.8.0_172-amd64
export HADOOP_HOME=/opt/hadoop-3.1.1
export HDFS_NAMENODE_USER=root
export HDFS_DATANODE_USER=root
export HDFS_SECONDARYNAMENODE_USER=root
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
hadoop-env.sh配置文件
export JAVA_HOME=/usr/java/jdk1.8.0_172-amd64
NameNode配置:
etc/hadoop/core-site.xml:
<property>
<name>fs.defaultFS</name>
<value>hdfs://node1:9000</value>
</property>
hadoop.tmp.dir
etc/hadoop/core-site.xml:
<property>
<name>hadoop.tmp.dir</name>
<value>/var/bjsxt/hadoop/pseudo</value>
</property>
默认副本数配置
etc/hadoop/hdfs-site.xml:
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
SecondaryNameNode配置
etc/hadoop/hdfs-site.xml:
<property>
<name>dfs.namenode.secondary.http-address</name>
<value>node1:9868</value>
</property>
DataNode配置:
etc/hadoop/workers:
node1
格式化:
hdfs namenode -format
启动
start-dfs.sh
查看进程
jps