HBase的相关操作

版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/zzw0221/article/details/82220175

1、启动shell命令行

[root@master hbase-1.2.0]# bin/hbase-daemon.sh start master
starting master, logging to /opt/cdh5.14.2/hbase-1.2.0/bin/../logs/hbase-root-master-master.cdh.com.out
[root@master hbase-1.2.0]# bin/hbase shell
2018-08-25 18:17:32,998 INFO  [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2018-08-25 18:17:37,750 WARN  [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 1.2.0-cdh5.14.2, rUnknown, Tue Mar 27 13:31:54 PDT 2018

hbase(main):001:0> 

2 、创建namespace

create_namespace 'namespace'

查询 namespace:

hbase(main):005:0> list_namespace
NAMESPACE                                                                                                                                                                            
default                                                                                                                                                                              
hbase                                                                                                                                                                                
namespace                                                                                                                                                                            
3 row(s) in 0.0660 seconds

3、删除namespace

drop_namespace 'namespace'

 查询 namespace是否删除:

hbase(main):007:0> list_namespace
NAMESPACE                                                                                                                                                                            
default                                                                                                                                                                              
hbase                                                                                                                                                                                
2 row(s) in 0.0190 seconds

4、创建表:

     官方给的范例:create 'ns1:t1', {NAME => 'f1', VERSIONS => 5}

     a、ns1指namespacem

     b、t1指table name

     c、f1指的列簇

     d、VERSIONS 指的能够存储的版本数

      f、在HBase中=>代表等于

      g、可以指定多个列簇,一个大括号只能指定一个列簇

     还有更简洁的写法:create 't1', 'f1', 'f2', 'f3'

hbase(main):011:0> create 't1', 'f1', 'f2', 'f3'
0 row(s) in 1.4360 seconds

=> Hbase::Table - t1
hbase(main):012:0> list
TABLE                                                                                                                                                                                
t1                                                                                                                                                                                   
1 row(s) in 0.0080 seconds

=> ["t1"]
hbase(main):013:0> desc 't1'
Table t1 is ENABLED                                                                                                                                                                  
t1                                                                                                                                                                                   
COLUMN FAMILIES DESCRIPTION                                                                                                                                                          
{NAME => 'f1', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DEL
ETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}                                                                                             
{NAME => 'f2', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DEL
ETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}                                                                                             
{NAME => 'f3', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DEL
ETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}                                                                                             
3 row(s) in 0.1590 seconds

 5、删除表:在HBase中表有启动和禁用的状态区分,在删除表前需要先禁用再操作

hbase(main):006:0> drop 'ns_test:t1'

ERROR: Table ns_test:t1 is enabled. Disable it first.

Drop the named table. Table must first be disabled:
  hbase> drop 't1'
  hbase> drop 'ns1:t1'

先disable 表,再删除:

hbase(main):007:0> disable 'ns_test:t1'
0 row(s) in 2.3470 seconds

hbase(main):008:0> drop 'ns_test:t1'
0 row(s) in 1.3010 seconds

6、put操作:put 'ns1:t1', 'r1', 'c1', 'value'

a、r1代表rowkey

b、c1代表列+列簇

c、value代表插入的值

具体例子:

hbase(main):015:0> create 'ns_test:tb1','info'
0 row(s) in 1.2920 seconds

=> Hbase::Table - ns_test:tb1
hbase(main):016:0> put 'ns_test:tb1','20180830','info:name','Lucy'
0 row(s) in 0.1200 seconds

hbase(main):017:0> put 'ns_test:tb1','20180830','info:age','30'
0 row(s) in 0.0080 seconds

hbase(main):018:0> put 'ns_test:tb1','20180830','info:sex','woman'
0 row(s) in 0.0120 seconds

7、查询数据:get

hbase(main):023:0> get 'ns_test:tb1','20180830'
COLUMN                                         CELL                                                                                                                                  
 info:age                                      timestamp=1535205653726, value=30                                                                                                     
 info:name                                     timestamp=1535205633199, value=Lucy                                                                                                   
 info:sex                                      timestamp=1535205702203, value=woman                                                                                                  
3 row(s) in 0.0380 seconds

 查询表中指定列的值:

hbase(main):028:0> get 'ns_test:tb1','20180830',{COLUMN => 'info:age'}
COLUMN                                         CELL                                                                                                                                  
 info:age                                      timestamp=1535205653726, value=30                                                                                                     
1 row(s) in 0.0150 seconds

可以查询更多get的用法:

hbase(main):024:0> help 'get'
Get row or cell contents; pass table name, row, and optionally
a dictionary of column(s), timestamp, timerange and versions. Examples:

  hbase> get 'ns1:t1', 'r1'
  hbase> get 't1', 'r1'
  hbase> get 't1', 'r1', {TIMERANGE => [ts1, ts2]}
  hbase> get 't1', 'r1', {COLUMN => 'c1'}
  hbase> get 't1', 'r1', {COLUMN => ['c1', 'c2', 'c3']}
  hbase> get 't1', 'r1', {COLUMN => 'c1', TIMESTAMP => ts1}
  hbase> get 't1', 'r1', {COLUMN => 'c1', TIMERANGE => [ts1, ts2], VERSIONS => 4}
  hbase> get 't1', 'r1', {COLUMN => 'c1', TIMESTAMP => ts1, VERSIONS => 4}
  hbase> get 't1', 'r1', {FILTER => "ValueFilter(=, 'binary:abc')"}
  hbase> get 't1', 'r1', 'c1'
  hbase> get 't1', 'r1', 'c1', 'c2'
  hbase> get 't1', 'r1', ['c1', 'c2']
  hbase> get 't1', 'r1', {COLUMN => 'c1', ATTRIBUTES => {'mykey'=>'myvalue'}}
  hbase> get 't1', 'r1', {COLUMN => 'c1', AUTHORIZATIONS => ['PRIVATE','SECRET']}
  hbase> get 't1', 'r1', {CONSISTENCY => 'TIMELINE'}
  hbase> get 't1', 'r1', {CONSISTENCY => 'TIMELINE', REGION_REPLICA_ID => 1}

Besides the default 'toStringBinary' format, 'get' also supports custom formatting by
column.  A user can define a FORMATTER by adding it to the column name in the get
specification.  The FORMATTER can be stipulated: 

 1. either as a org.apache.hadoop.hbase.util.Bytes method name (e.g, toInt, toString)
 2. or as a custom class followed by method name: e.g. 'c(MyFormatterClass).format'.

Example formatting cf:qualifier1 and cf:qualifier2 both as Integers: 
  hbase> get 't1', 'r1' {COLUMN => ['cf:qualifier1:toInt',
    'cf:qualifier2:c(org.apache.hadoop.hbase.util.Bytes).toInt'] } 

Note that you can specify a FORMATTER by column only (cf:qualifier).  You cannot specify
a FORMATTER for all columns of a column family.
    
The same commands also can be run on a reference to a table (obtained via get_table or
create_table). Suppose you had a reference t to table 't1', the corresponding commands
would be:

  hbase> t.get 'r1'
  hbase> t.get 'r1', {TIMERANGE => [ts1, ts2]}
  hbase> t.get 'r1', {COLUMN => 'c1'}
  hbase> t.get 'r1', {COLUMN => ['c1', 'c2', 'c3']}
  hbase> t.get 'r1', {COLUMN => 'c1', TIMESTAMP => ts1}
  hbase> t.get 'r1', {COLUMN => 'c1', TIMERANGE => [ts1, ts2], VERSIONS => 4}
  hbase> t.get 'r1', {COLUMN => 'c1', TIMESTAMP => ts1, VERSIONS => 4}
  hbase> t.get 'r1', {FILTER => "ValueFilter(=, 'binary:abc')"}
  hbase> t.get 'r1', 'c1'
  hbase> t.get 'r1', 'c1', 'c2'
  hbase> t.get 'r1', ['c1', 'c2']
  hbase> t.get 'r1', {CONSISTENCY => 'TIMELINE'}
  hbase> t.get 'r1', {CONSISTENCY => 'TIMELINE', REGION_REPLICA_ID => 1}

8、全表扫描:scan,用得比较少

hbase(main):029:0> scan 'ns_test:tb1'
ROW                                            COLUMN+CELL                                                                                                                           
 20180830                                      column=info:age, timestamp=1535205653726, value=30                                                                                    
 20180830                                      column=info:name, timestamp=1535205633199, value=Lucy                                                                                 
 20180830                                      column=info:sex, timestamp=1535205702203, value=woman                                                                                 
1 row(s) in 0.0630 seconds

 STARTROW、ENDROW用法:

hbase(main):039:0> scan 'ns_test:tb1'
ROW                                            COLUMN+CELL                                                                                                                           
 20180830                                      column=info:age, timestamp=1535205653726, value=30                                                                                    
 20180830                                      column=info:name, timestamp=1535205633199, value=Lucy                                                                                 
 20180830                                      column=info:sex, timestamp=1535205702203, value=woman                                                                                 
 20180831                                      column=info:name, timestamp=1535208181737, value=Tom                                                                                  
 20180901                                      column=info:name, timestamp=1535208173653, value=Peppa                                                                                
3 row(s) in 0.0260 seconds

hbase(main):040:0> scan 'ns_test:tb1',{STARTROW => '20180831'}
ROW                                            COLUMN+CELL                                                                                                                           
 20180831                                      column=info:name, timestamp=1535208181737, value=Tom                                                                                  
 20180901                                      column=info:name, timestamp=1535208173653, value=Peppa                                                                                
2 row(s) in 0.0210 seconds

hbase(main):042:0> scan 'ns_test:tb1',{ENDROW => '20180901'}
ROW                                            COLUMN+CELL                                                                                                                           
 20180830                                      column=info:age, timestamp=1535205653726, value=30                                                                                    
 20180830                                      column=info:name, timestamp=1535205633199, value=Lucy                                                                                 
 20180830                                      column=info:sex, timestamp=1535205702203, value=woman                                                                                 
 20180831                                      column=info:name, timestamp=1535208181737, value=Tom                                                                                  
2 row(s) in 0.0170 seconds

9、delete用法:

a、删除列

hbase(main):003:0> scan 'ns_test:tb1'
ROW                                            COLUMN+CELL                                                                                                                           
 20180830                                      column=info:age, timestamp=1535205653726, value=30                                                                                    
 20180830                                      column=info:name, timestamp=1535205633199, value=Lucy                                                                                 
 20180830                                      column=info:sex, timestamp=1535205702203, value=woman                                                                                 
 20180831                                      column=info:name, timestamp=1535208181737, value=Tom                                                                                  
 20180901                                      column=info:name, timestamp=1535208173653, value=Peppa                                                                                
3 row(s) in 0.4990 seconds

hbase(main):004:0> delete 'ns_test:tb1','20180830','info:age'
0 row(s) in 0.0690 seconds

hbase(main):005:0> scan 'ns_test:tb1'
ROW                                            COLUMN+CELL                                                                                                                           
 20180830                                      column=info:name, timestamp=1535205633199, value=Lucy                                                                                 
 20180830                                      column=info:sex, timestamp=1535205702203, value=woman                                                                                 
 20180831                                      column=info:name, timestamp=1535208181737, value=Tom                                                                                  
 20180901                                      column=info:name, timestamp=1535208173653, value=Peppa                                                                                
3 row(s) in 0.0370 seconds

 b、删除整个rowkey的数据

hbase(main):006:0> delete 'ns_test:tb1','20180830'
0 row(s) in 0.0080 seconds

hbase(main):007:0> scan 'ns_test:tb1'
ROW                                            COLUMN+CELL                                                                                                                           
 20180831                                      column=info:name, timestamp=1535208181737, value=Tom                                                                                  
 20180901                                      column=info:name, timestamp=1535208173653, value=Peppa                                                                                
2 row(s) in 0.0200 seconds

猜你喜欢

转载自blog.csdn.net/zzw0221/article/details/82220175