1.连好串口线,用超级终端或PUTTY软件登录到存储或者使用telnet登录
Data ONTAP (netapp3210B.hangtianjinsui.net)
login: root
Password:
Sat Nov 26 09:10:38 CST [netapp3210B: telnet_0:info]: root logged in from host
2.运行disk show –v,查看故障硬盘
netapp3210B> disk show -v
DISK OWNER POOL SERIAL NUMBER HOME CHKSUM
------------ ------------- ----- ------------- ------------- ------
0b.01.18 netapp3210A(1573857221) Pool0 JZV95J1J netapp3210A(1573857221) Block
0a.01.15 netapp3210A(1573857221) Pool0 CZY8DPUN netapp3210A(1573857221) Block
0b.01.20 netapp3210A(1573857221) Pool0 JZV91WYJ netapp3210A(1573857221) Block
0b.01.16 netapp3210A(1573857221) Pool0 JZV19P7J netapp3210A(1573857221) Block
0a.01.11 netapp3210A(1573857221) Pool0 JZV9467J netapp3210A(1573857221) Block
0b.01.8 netapp3210A(1573857221) Pool0 JZV8XGNJ netapp3210A(1573857221) Block
0a.01.3 netapp3210A(1573857221) Pool0 JZV91LYJ netapp3210A(1573857221) Block
0a.01.13 netapp3210B(1573852909) Pool0 JZV9KYJJ netapp3210B(1573852909) Block
0a.01.5 FAILED JZV9479J Block
0b.01.2 netapp3210A(1573857221) Pool0 JZV9136J netapp3210A(1573857221) Block
0b.01.10 netapp3210A(1573857221) Pool0 JZV7SAYJ netapp3210A(1573857221) Block
0a.01.19 netapp3210A(1573857221) Pool0 JZVA2U2J netapp3210A(1573857221) Block
0b.01.4 netapp3210A(1573857221) Pool0 JZV8SN4J netapp3210A(1573857221) Block
0a.01.1 netapp3210A(1573857221) Pool0 JZV74KHJ netapp3210A(1573857221) Block
0a.01.21 netapp3210A(1573857221) Pool0 JZV7ESAJ netapp3210A(1573857221) Block
0b.01.22 netapp3210A(1573857221) Pool0 JZV97BSJ netapp3210A(1573857221) Block
0a.01.17 netapp3210A(1573857221) Pool0 JZV90LGJ netapp3210A(1573857221) Block
0b.01.14 netapp3210B(1573852909) Pool0 JZV9J0KJ netapp3210B(1573852909) Block
0b.01.12 netapp3210B(1573852909) Pool0 JZV9KZSJ netapp3210B(1573852909) Block
0a.01.7 netapp3210A(1573857221) Pool0 JZV8MW4J netapp3210A(1573857221) Block
0b.01.6 netapp3210A(1573857221) Pool0 JZV95EUJ netapp3210A(1573857221) Block
0b.01.0 netapp3210A(1573857221) Pool0 JZV7GLUJ netapp3210A(1573857221) Block
0a.01.9 netapp3210A(1573857221) Pool0 6SLAWVLK0000N636075Q netapp3210A(1573857221) Block
0a.01.23 netapp3210A(1573857221) Pool0 JZVA2MUJ netapp3210A(1573857221) Block
发现0a.01.5 这块硬盘故障
备注:上面的硬盘没有显示属于哪个存储控制器的原因是由于在新购硬盘没有到货之前,B控上面还有多余的冗余硬盘,而A控故障一块硬盘之后没有冗余硬盘了,我把B控的冗余硬盘剔除一块,分到A控上作为冗余硬盘,所以出现这个问题。
具体命令是
在B控上面 执行 remove [-w]
在A控上面执行 assign {
3.aggr status -r 可以清楚的看到硬盘所在的位置,具体到硬盘的物理位置为第几柜子的几号槽位,这个硬盘黄灯会亮 。
N3700A> aggr status -r
Aggregate systemA (online, raid4) (block checksums)
Plex /systemA/plex0 (online, normal, active)
RAID group /systemA/plex0/rg0 (normal)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
parity 0b.17 0b 1 1 FC:A - FCAL 10000 68000/139264000 69536/142410400
data 0b.18 0b 1 2 FC:A - FCAL 10000 68000/139264000 69536/142410400
Aggregate AIXMAIL (online, raid4) (block checksums)
Plex /AIXMAIL/plex0 (online, normal, active)
RAID group /AIXMAIL/plex0/rg0 (normal)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
parity 0b.37 0b 2 5 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.36 0b 2 4 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.45 0b 2 13 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.34 0b 2 2 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.33 0b 2 1 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.32 0b 2 0 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.39 0b 2 7 FC:A - ATA 7200 423111/866531584 423889/868126304
RAID group /AIXMAIL/plex0/rg1 (normal)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
parity 0b.41 0b 2 9 FC:A - ATA 7200 423111/866531584 423889/868126304
data 0b.43 0b 2 11 FC:A - ATA 7200 423111/866531584 423889/868126304
Spare disks (empty)
Broken disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
failed 0a.01.5 0b 2 3 FC:A - ATA 7200 423111/866531584 423889/868126304
清楚知道 0a.01.5 这个硬盘的物理位置为第2柜子的3号槽位.
4.拔掉故障硬盘,换上新硬盘,运行disk show -v
netapp3210B> disk show -v
DISK OWNER POOL SERIAL NUMBER HOME CHKSUM
------------ ------------- ----- ------------- ------------- ------
0b.01.18 netapp3210A(1573857221) Pool0 JZV95J1J netapp3210A(1573857221) Block
0a.01.15 netapp3210A(1573857221) Pool0 CZY8DPUN netapp3210A(1573857221) Block
0b.01.20 netapp3210A(1573857221) Pool0 JZV91WYJ netapp3210A(1573857221) Block
0b.01.16 netapp3210A(1573857221) Pool0 JZV19P7J netapp3210A(1573857221) Block
0a.01.11 netapp3210A(1573857221) Pool0 JZV9467J netapp3210A(1573857221) Block
0b.01.8 netapp3210A(1573857221) Pool0 JZV8XGNJ netapp3210A(1573857221) Block
0a.01.5 Not Owned NONE J9YYZDLM Block
0a.01.3 netapp3210A(1573857221) Pool0 JZV91LYJ netapp3210A(1573857221) Block
0a.01.13 netapp3210B(1573852909) Pool0 JZV9KYJJ netapp3210B(1573852909) Block
0b.01.2 netapp3210A(1573857221) Pool0 JZV9136J netapp3210A(1573857221) Block
0b.01.10 netapp3210A(1573857221) Pool0 JZV7SAYJ netapp3210A(1573857221) Block
0a.01.19 netapp3210A(1573857221) Pool0 JZVA2U2J netapp3210A(1573857221) Block
0b.01.4 netapp3210A(1573857221) Pool0 JZV8SN4J netapp3210A(1573857221) Block
0a.01.1 netapp3210A(1573857221) Pool0 JZV74KHJ netapp3210A(1573857221) Block
0a.01.21 netapp3210A(1573857221) Pool0 JZV7ESAJ netapp3210A(1573857221) Block
0b.01.22 netapp3210A(1573857221) Pool0 JZV97BSJ netapp3210A(1573857221) Block
0a.01.17 netapp3210A(1573857221) Pool0 JZV90LGJ netapp3210A(1573857221) Block
0b.01.14 netapp3210B(1573852909) Pool0 JZV9J0KJ netapp3210B(1573852909) Block
0b.01.12 netapp3210B(1573852909) Pool0 JZV9KZSJ netapp3210B(1573852909) Block
0a.01.7 netapp3210A(1573857221) Pool0 JZV8MW4J netapp3210A(1573857221) Block
0b.01.6 netapp3210A(1573857221) Pool0 JZV95EUJ netapp3210A(1573857221) Block
0b.01.0 netapp3210A(1573857221) Pool0 JZV7GLUJ netapp3210A(1573857221) Block
0a.01.9 netapp3210A(1573857221) Pool0 6SLAWVLK0000N636075Q netapp3210A(1573857221) Block
0a.01.23 netapp3210A(1573857221) Pool0 JZVA2MUJ netapp3210A(1573857221) Block
可以看到新盘没有OWNER,显示为Not Owned
5.硬盘原属于netapp3210B,而当前操作的也是B控制器,所以直接运行disk assign 0a.01.5,系统会默认把0b.35硬盘分配给当前控制器
netapp3210B> disk assign 0a.01.5
Sat Nov 26 14:20:59 CST [netapp3210B:diskown.changingOwner:info]: changing ownership for disk 0a.01.5 (S/N J9YYZDLM) from unowned (ID 4294967295) to netapp3210B (ID 1573852909)
6.通过disk show -v 和aggr status -r看看新替换的硬盘是否正常并处于spare disk。
netapp3210B> disk show -v
DISK OWNER POOL SERIAL NUMBER HOME CHKSUM
------------ ------------- ----- ------------- ------------- ------
0b.01.18 netapp3210A(1573857221) Pool0 JZV95J1J netapp3210A(1573857221) Block
0a.01.15 netapp3210A(1573857221) Pool0 CZY8DPUN netapp3210A(1573857221) Block
0b.01.20 netapp3210A(1573857221) Pool0 JZV91WYJ netapp3210A(1573857221) Block
0b.01.16 netapp3210A(1573857221) Pool0 JZV19P7J netapp3210A(1573857221) Block
0a.01.11 netapp3210A(1573857221) Pool0 JZV9467J netapp3210A(1573857221) Block
0b.01.8 netapp3210A(1573857221) Pool0 JZV8XGNJ netapp3210A(1573857221) Block
0a.01.3 netapp3210A(1573857221) Pool0 JZV91LYJ netapp3210A(1573857221) Block
0a.01.13 netapp3210B(1573852909) Pool0 JZV9KYJJ netapp3210B(1573852909) Block
0a.01.5 netapp3210B(1573852909) Pool0 J9YYZDLM netapp3210B(1573852909) Block
0b.01.2 netapp3210A(1573857221) Pool0 JZV9136J netapp3210A(1573857221) Block
0b.01.10 netapp3210A(1573857221) Pool0 JZV7SAYJ netapp3210A(1573857221) Block
0a.01.19 netapp3210A(1573857221) Pool0 JZVA2U2J netapp3210A(1573857221) Block
0b.01.4 netapp3210A(1573857221) Pool0 JZV8SN4J netapp3210A(1573857221) Block
0a.01.1 netapp3210A(1573857221) Pool0 JZV74KHJ netapp3210A(1573857221) Block
0a.01.21 netapp3210A(1573857221) Pool0 JZV7ESAJ netapp3210A(1573857221) Block
0b.01.22 netapp3210A(1573857221) Pool0 JZV97BSJ netapp3210A(1573857221) Block
0a.01.17 netapp3210A(1573857221) Pool0 JZV90LGJ netapp3210A(1573857221) Block
0b.01.14 netapp3210B(1573852909) Pool0 JZV9J0KJ netapp3210B(1573852909) Block
0b.01.12 netapp3210B(1573852909) Pool0 JZV9KZSJ netapp3210B(1573852909) Block
0a.01.7 netapp3210A(1573857221) Pool0 JZV8MW4J netapp3210A(1573857221) Block
0b.01.6 netapp3210A(1573857221) Pool0 JZV95EUJ netapp3210A(1573857221) Block
0b.01.0 netapp3210A(1573857221) Pool0 JZV7GLUJ netapp3210A(1573857221) Block
0a.01.9 netapp3210A(1573857221) Pool0 6SLAWVLK0000N636075Q netapp3210A(1573857221) Block
0a.01.23 netapp3210A(1573857221) Pool0 JZVA2MUJ netapp3210A(1573857221) Block
netapp3210B> aggr status -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0b.01.12 0b 1 12 SA:A 0 SAS 15000 560000/1146880000 560879/1148681096
parity 0a.01.13 0a 1 13 SA:B 0 SAS 15000 560000/1146880000 560879/1148681096
data 0b.01.14 0b 1 14 SA:A 0 SAS 15000 560000/1146880000 560879/1148681096
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.01.5 0a 1 5 SA:B 0 SAS 15000 560000/1146880000 560879/1148681096
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 0a.01.23 0a 1 23 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.22 0b 1 22 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.0 0b 1 0 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.6 0b 1 6 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.9 0a 1 9 SA:B 0 SAS 15000 0/0 560208/1147307688
partner 0a.01.1 0a 1 1 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.7 0a 1 7 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.3 0a 1 3 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.18 0b 1 18 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.21 0a 1 21 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.2 0b 1 2 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.17 0a 1 17 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.16 0b 1 16 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.11 0a 1 11 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.4 0b 1 4 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.19 0a 1 19 SA:B 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.10 0b 1 10 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.8 0b 1 8 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0b.01.20 0b 1 20 SA:A 0 SAS 15000 0/0 560879/1148681096
partner 0a.01.15 0a 1 15 SA:B 0 SAS 15000 0/0 560879/1148681096
netapp3210B> disk show -v
DISK OWNER POOL SERIAL NUMBER HOME CHKSUM
------------ ------------- ----- ------------- ------------- ------
0b.01.18 netapp3210A(1573857221) Pool0 JZV95J1J netapp3210A(1573857221) Block
0a.01.15 netapp3210A(1573857221) Pool0 CZY8DPUN netapp3210A(1573857221) Block
0b.01.20 netapp3210A(1573857221) Pool0 JZV91WYJ netapp3210A(1573857221) Block
0b.01.16 netapp3210A(1573857221) Pool0 JZV19P7J netapp3210A(1573857221) Block
0a.01.11 netapp3210A(1573857221) Pool0 JZV9467J netapp3210A(1573857221) Block
0b.01.8 netapp3210A(1573857221) Pool0 JZV8XGNJ netapp3210A(1573857221) Block
0a.01.3 netapp3210A(1573857221) Pool0 JZV91LYJ netapp3210A(1573857221) Block
0a.01.13 netapp3210B(1573852909) Pool0 JZV9KYJJ netapp3210B(1573852909) Block
0a.01.5 netapp3210B(1573852909) Pool0 J9YYZDLM netapp3210B(1573852909) Block
0b.01.2 netapp3210A(1573857221) Pool0 JZV9136J netapp3210A(1573857221) Block
0b.01.10 netapp3210A(1573857221) Pool0 JZV7SAYJ netapp3210A(1573857221) Block
0a.01.19 netapp3210A(1573857221) Pool0 JZVA2U2J netapp3210A(1573857221) Block
0b.01.4 netapp3210A(1573857221) Pool0 JZV8SN4J netapp3210A(1573857221) Block
0a.01.1 netapp3210A(1573857221) Pool0 JZV74KHJ netapp3210A(1573857221) Block
0a.01.21 netapp3210A(1573857221) Pool0 JZV7ESAJ netapp3210A(1573857221) Block
0b.01.22 netapp3210A(1573857221) Pool0 JZV97BSJ netapp3210A(1573857221) Block
0a.01.17 netapp3210A(1573857221) Pool0 JZV90LGJ netapp3210A(1573857221) Block
0b.01.14 netapp3210B(1573852909) Pool0 JZV9J0KJ netapp3210B(1573852909) Block
0b.01.12 netapp3210B(1573852909) Pool0 JZV9KZSJ netapp3210B(1573852909) Block
0a.01.7 netapp3210A(1573857221) Pool0 JZV8MW4J netapp3210A(1573857221) Block
0b.01.6 netapp3210A(1573857221) Pool0 JZV95EUJ netapp3210A(1573857221) Block
0b.01.0 netapp3210A(1573857221) Pool0 JZV7GLUJ netapp3210A(1573857221) Block
0a.01.9 netapp3210A(1573857221) Pool0 6SLAWVLK0000N636075Q netapp3210A(1573857221) Block
0a.01.23 netapp3210A(1573857221) Pool0 JZVA2MUJ netapp3210A(1573857221) Block
显示新更换的硬盘已经成为spare disk,即完成故障硬盘更换。
7.如果在换盘之后,硬盘出现bad label
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
bad label 0b.44 0b 2 12 FC:A - FCAL 15000 272000/557056000 280104/573653840
执行如下命令:
priv set advanced #进入高级维护模式
disk unfail -s 0b.44 #处理bad label错误
8.如果换盘之后出现 Not zeroed,执行如下命令
disk zero spares
这时没有零化的热备盘会开始零化,这可能需要一段时间,可通过vol status -s监控