9-hadoop-0.20 单节点安装

编程语言 2018-05-12 15:30:35 阅读次数: 0

1）安装JAVA

2)SSH免密码

3）解压hadoop

这些安装与 1.03 一样。

1.03   的安装，请参照： http://pftzzg.iteye.com/blog/1910153

4)设置

 

a)

 

[root@centerOsMaster home]# vim /etc/profile 

 

export JAVA_HOME=/usr/java/jdk1.6.0_31

export PATH=$JAVA_HOME/bin:$PATH

export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

export TERM=linux

export HADOOP_HOME=/hadoop/hadoop-0.20.2

export PATH=$HADOOP_HOME/bin:$PATH

 

[root@centerOsMaster home]# source /etc/profile

b)

[hadoop@centerOsMaster conf]$ vim hadoop-env.sh



 

c)

[hadoop@centerOsMaster conf]$ vim core-site.xml

  
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
  <name>hadoop.tmp.dir</name>
  <value>/hadoop/data/tmp</value>
</property>
<property>
  <name>fs.default.name</name>
  <value>hdfs://centerOsMaster:9000</value>
</property>
</configuration>
 

 

d)

[hadoop@centerOsMaster conf]$ vi hdfs-site.xml

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
  <name>dfs.name.dir</name>
  <value>/hadoop/data/name</value>
</property>
<property>
   <name>dfs.data.dir</name>
  <value>/hadoop/data/data</value>
</property>
<property>
  <name>dfs.replication</name>
  <value>1</value>
</property>
</configuration>

 

e)

[hadoop@centerOsMaster conf]$  vi mapred-site.xml 

 

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
  <name>mapred.job.tracker</name>
 <value>hdfs://centerOsMaster:9001</value>
</property>
<property>
   <name>mapred.local.dir</name>
  <value>/hadoop/data/local</value>
</property>

</configuration>

 

 

 

6)使用

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/local

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/name

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/data

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/tmp

 

 

[hadoop@centerOsMaster bin]$ hadoop  namenode  -format

12/12/08 23:47:19 INFO namenode.NameNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting NameNode

STARTUP_MSG:   host = centerOsMaster/192.168.80.55

STARTUP_MSG:   args = [-format]

STARTUP_MSG:   version = 0.20.2

STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010

************************************************************/

Re-format filesystem in /hadoop/data/name ? (Y or N) Y

12/12/08 23:47:21 INFO namenode.FSNamesystem: fsOwner=hadoop,hadoop

12/12/08 23:47:21 INFO namenode.FSNamesystem: supergroup=supergroup

12/12/08 23:47:21 INFO namenode.FSNamesystem: isPermissionEnabled=true

12/12/08 23:47:21 INFO common.Storage: Image file of size 96 saved in 0 seconds.

12/12/08 23:47:21 INFO common.Storage: Storage directory /hadoop/data/name has been successfully formatted.

12/12/08 23:47:21 INFO namenode.NameNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down NameNode at centerOsMaster/192.168.80.55

************************************************************/



 

这是是大写。是区分大小写的。

 

 

 

 

 [hadoop@centerOsMaster bin]$ ./start-all.sh

starting namenode, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-namenode-centerOsMaster.out

localhost: starting datanode, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-datanode-centerOsMaster.out

localhost: starting secondarynamenode, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-secondarynamenode-centerOsMaster.out

starting jobtracker, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-jobtracker-centerOsMaster.out

localhost: starting tasktracker, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-tasktracker-centerOsMaster.out

[hadoop@centerOsMaster bin]$



 

 

 

总结：1）注意端口

              2）注意版本

 

       集群的安装请参考：http://pftzzg.iteye.com/blog/1910171

   hadoop-0.20 请参考：http://pftzzg.iteye.com/admin/blogs/1911023

               1.03  请参考：http://pftzzg.iteye.com/admin/blogs/1910153

1）安装JAVA

2)SSH免密码

3）解压hadoop

这些安装与 1.03 一样。

1.03   的安装，请参照： http://pftzzg.iteye.com/blog/1910153

4)设置

 

a)

 

[root@centerOsMaster home]# vim /etc/profile 

 

export JAVA_HOME=/usr/java/jdk1.6.0_31

export PATH=$JAVA_HOME/bin:$PATH

export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

export TERM=linux

export HADOOP_HOME=/hadoop/hadoop-0.20.2

export PATH=$HADOOP_HOME/bin:$PATH

 

[root@centerOsMaster home]# source /etc/profile

b)

[hadoop@centerOsMaster conf]$ vim hadoop-env.sh



 

c)

[hadoop@centerOsMaster conf]$ vim core-site.xml

  
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
  <name>hadoop.tmp.dir</name>
  <value>/hadoop/data/tmp</value>
</property>
<property>
  <name>fs.default.name</name>
  <value>hdfs://centerOsMaster:9000</value>
</property>
</configuration>
 

 

d)

[hadoop@centerOsMaster conf]$ vi hdfs-site.xml

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
  <name>dfs.name.dir</name>
  <value>/hadoop/data/name</value>
</property>
<property>
   <name>dfs.data.dir</name>
  <value>/hadoop/data/data</value>
</property>
<property>
  <name>dfs.replication</name>
  <value>1</value>
</property>
</configuration>

 

e)

[hadoop@centerOsMaster conf]$  vi mapred-site.xml 

 

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
  <name>mapred.job.tracker</name>
 <value>hdfs://centerOsMaster:9001</value>
</property>
<property>
   <name>mapred.local.dir</name>
  <value>/hadoop/data/local</value>
</property>

</configuration>

 

 

 

6)使用

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/local

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/name

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/data

[hadoop@centerOsMaster conf]$ mkdir -p /hadoop/data/tmp

 

 

[hadoop@centerOsMaster bin]$ hadoop  namenode  -format

12/12/08 23:47:19 INFO namenode.NameNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting NameNode

STARTUP_MSG:   host = centerOsMaster/192.168.80.55

STARTUP_MSG:   args = [-format]

STARTUP_MSG:   version = 0.20.2

STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010

************************************************************/

Re-format filesystem in /hadoop/data/name ? (Y or N) Y

12/12/08 23:47:21 INFO namenode.FSNamesystem: fsOwner=hadoop,hadoop

12/12/08 23:47:21 INFO namenode.FSNamesystem: supergroup=supergroup

12/12/08 23:47:21 INFO namenode.FSNamesystem: isPermissionEnabled=true

12/12/08 23:47:21 INFO common.Storage: Image file of size 96 saved in 0 seconds.

12/12/08 23:47:21 INFO common.Storage: Storage directory /hadoop/data/name has been successfully formatted.

12/12/08 23:47:21 INFO namenode.NameNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down NameNode at centerOsMaster/192.168.80.55

************************************************************/



 

这是是大写。是区分大小写的。

 

 

 

 

 [hadoop@centerOsMaster bin]$ ./start-all.sh

starting namenode, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-namenode-centerOsMaster.out

localhost: starting datanode, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-datanode-centerOsMaster.out

localhost: starting secondarynamenode, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-secondarynamenode-centerOsMaster.out

starting jobtracker, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-jobtracker-centerOsMaster.out

localhost: starting tasktracker, logging to /hadoop/hadoop-0.20.2/bin/../logs/hadoop-hadoop-tasktracker-centerOsMaster.out

[hadoop@centerOsMaster bin]$



 

 

 

总结：1）注意端口

              2）注意版本

 

       集群的安装请参考：http://pftzzg.iteye.com/blog/1910171

   hadoop-0.20 请参考：http://pftzzg.iteye.com/admin/blogs/1911023

               1.03  请参考：http://pftzzg.iteye.com/admin/blogs/1910153

猜你喜欢

转载自pftzzg.iteye.com/blog/1911023
今日推荐
周排行
深度学习------Lingvo框架下的加速通道GPipe
webjars管理静态资源
C专家编程_2.2
mysql 源码安装
json文件操作
123231432
注解的实现
Spring MVC 控制器
《人月神话》读后感二
C#使用HttpWebRequest和HttpWebResponse上传文件示例
每日归档
更多
2024-09-08(0)
2024-09-07(0)
2024-09-06(0)
2024-09-05(0)
2024-09-04(0)
2024-09-03(0)
2024-09-02(0)
2024-09-01(0)
2024-08-31(0)
2024-08-30(0)

代码天地 © 2018 codetd.com

境外服务器   最新电视剧2022