0.实验前的环境检查与配置
[student@workstation ~]$ lab tiering-lab setup
1.存储信息
gluster volume info prod-vol查看存储卷的信息。注意:此时只有副本模式的2个存储条。for I in server{c,d}对两个节点进行遍历,发现可用的存储条。
[root@serverc ~]# gluster volume info prod-vol
Volume Name: prod-vol
Type: Replicate
Volume ID: 9b5b97c7-499e-4781-b405-20badc9042ce
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: serverc:/bricks/brick-c1/brick
Brick2: serverd:/bricks/brick-d1/brick
Options Reconfigured:
performance.readdir-ahead: on
[student@workstation ~]$ for I in server{c,d}
> do
> ssh ${I} "mount | grep brick"
> done
Warning: Permanently added 'serverc,172.25.250.12' (ECDSA) to the list of known hosts.
/dev/mapper/vg_bricks-brick--c1 on /bricks/brick-c1 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c2 on /bricks/brick-c2 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c3 on /bricks/brick-c3 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c4 on /bricks/brick-c4 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c5 on /bricks/brick-c5 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--c6 on /bricks/brick-c6 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
Warning: Permanently added 'serverd,172.25.250.13' (ECDSA) to the list of known hosts.
/dev/mapper/vg_bricks-brick--d1 on /bricks/brick-d1 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d2 on /bricks/brick-d2 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d3 on /bricks/brick-d3 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d4 on /bricks/brick-d4 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d5 on /bricks/brick-d5 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
/dev/mapper/vg_bricks-brick--d6 on /bricks/brick-d6 type xfs (rw,relatime,seclabel,attr2,inode64,logbsize=64k,sunit=128,swidth=128,noquota)
2.添加存储条
gluster volume tier prod-vol attach replica 2添加c2 d2两个存储条,并且设置为副本模式。
[root@serverc ~]# gluster volume tier prod-vol attach replica 2 \
> serverc:/bricks/brick-c2/brick \
> serverd:/bricks/brick-d2/brick
volume attach-tier: success
Tiering Migration Functionality: prod-vol: success: Attach tier is successful on prod-vol. use tier status to check the status.
ID: eeb17f63-83a8-4941-a5a9-1297e4a5923b
3.存储信息
gluster volume info prod-vol查看存储信息。注意:此时已有了热区分层,即刚添加的两个存储条,而之前已经存在的两个存储条则变为冷区分层。
[root@serverc ~]# gluster volume info prod-vol
Volume Name: prod-vol
Type: Tier
Volume ID: 9b5b97c7-499e-4781-b405-20badc9042ce
Status: Started
Number of Bricks: 4
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick1: serverd:/bricks/brick-d2/brick
Brick2: serverc:/bricks/brick-c2/brick
Cold Tier:
Cold Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick3: serverc:/bricks/brick-c1/brick
Brick4: serverd:/bricks/brick-d1/brick
Options Reconfigured:
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
4.分层状态
gluster volume tier prod-vol status查看分层状态信息。
[root@serverc ~]# gluster volume tier prod-vol status
Node Promoted files Demoted files Status
--------- --------- --------- ---------
localhost 0 0 in progress
serverd.lab.example.com 0 0 in progress
Tiering Migration Functionality: prod-vol: success
5.存储信息
gluster volume info dev-vol查看存储信息。注意:此时有6个存储条,其中4个用于热区分层,模式为分布副本模式,2个用于冷区分层,模式为副本模式。
[root@serverc ~]# gluster volume info dev-vol
Volume Name: dev-vol
Type: Tier
Volume ID: 86419ff5-3593-42e7-865b-71cb3742b1fb
Status: Started
Number of Bricks: 6
Transport-type: tcp
Hot Tier :
Hot Tier Type : Distributed-Replicate
Number of Bricks: 2 x 2 = 4
Brick1: serverd:/bricks/brick-d6/brick
Brick2: serverc:/bricks/brick-c6/brick
Brick3: serverd:/bricks/brick-d5/brick
Brick4: serverc:/bricks/brick-c5/brick
Cold Tier:
Cold Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick5: serverc:/bricks/brick-c4/brick
Brick6: serverd:/bricks/brick-d4/brick
Options Reconfigured:
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
6.配置拓展
gluster volume tier dev-vol detach start开启存储分区调整。gluster volume tier dev-vol detach status查看状态信息。 gluster volume tier dev-vol detach commit确认调整开始。rm -rf /bricks/brick-c6/brick删除原有存储条。mkdir /bricks/brick-c6/brick新建存储条。serverd参照serverc进行操作。gluster volume tier dev-vol attach replica 2 添加存储条并设置副本模式参数为2。
[root@serverc ~]# gluster volume tier dev-vol detach start
volume detach-tier start: success
ID: 62482dd0-e0c3-46bd-b81a-8be348f657fc
[root@serverc ~]# gluster volume tier dev-vol detach status
Node Rebalanced-files size scanned failures skipped status run time in secs
--------- ----------- ----------- ----------- ----------- ----------- ------------ --------------
localhost 0 0Bytes 0 0 0 completed 1.00
serverd.lab.example.com 0 0Bytes 0 0 0 completed 2.00
[root@serverc ~]# gluster volume tier dev-vol detach commit
Removing tier can result in data loss. Do you want to Continue? (y/n) y
volume detach-tier commit: success
Check the detached bricks to ensure all files are migrated.
If files with data are found on the brick path, copy them via a gluster mount point before re-purposing the removed brick.
[root@serverc ~]# rm -rf /bricks/brick-c6/brick
[root@serverc ~]# mkdir /bricks/brick-c6/brick
[root@serverd ~]# rm -rf /bricks/brick-d6/brick
[root@serverd ~]# mkdir /bricks/brick-d6/brick
[root@serverc ~]# gluster volume tier dev-vol attach replica 2 \
> serverc:/bricks/brick-c6/brick \
> serverd:/bricks/brick-d6/brick
volume attach-tier: success
Tiering Migration Functionality: dev-vol: success: Attach tier is successful on dev-vol. use tier status to check the status.
ID: a4e4d4c9-37cc-4704-bc61-ee18196c5179
7.存储信息
gluster volume info dev-vol查看存储卷的信息。注意:此时只有4个存储条。其中c6 d6即刚添加的新存储条为热区分层,而原来的冷区分层并未发生改变。
[root@serverc ~]# gluster volume info dev-vol
Volume Name: dev-vol
Type: Tier
Volume ID: 86419ff5-3593-42e7-865b-71cb3742b1fb
Status: Started
Number of Bricks: 4
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick1: serverd:/bricks/brick-d6/brick
Brick2: serverc:/bricks/brick-c6/brick
Cold Tier:
Cold Tier Type : Replicate
Number of Bricks: 1 x 2 = 2
Brick3: serverc:/bricks/brick-c4/brick
Brick4: serverd:/bricks/brick-d4/brick
Options Reconfigured:
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
8.任务测评
lab tiering-lab grade进行任务测评。主要包括:热区分层的启用,热区分层存储条的使用等。
[student@workstation ~]$ lab tiering-lab grade
Grading the student's work:
· Checking hot tier enabled for prod-vol...................... PASS
· Checking hot tier enabled for dev-vol....................... PASS
· Checking hot tier bricks for prod-vol....................... PASS
· Checking hot tier bricks for dev-vol........................ PASS
Overall lab grade.............................................. PASS