netapp3210存储更换故障硬盘过程

1.连好串口线,用超级终端或PUTTY软件登录到存储或者使用telnet登录


Data ONTAP (netapp3210B.hangtianjinsui.net)
login: root
Password: 
Sat Nov 26 09:10:38 CST [netapp3210B: telnet_0:info]: root logged in from host

2.运行disk show –v,查看故障硬盘

netapp3210B> disk show -v
  DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
------------ -------------          -----  -------------           -------------            ------
0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
0a.01.5                                 FAILED JZV9479J             Block
0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block

发现0a.01.5  这块硬盘故障

备注:上面的硬盘没有显示属于哪个存储控制器的原因是由于在新购硬盘没有到货之前,B控上面还有多余的冗余硬盘,而A控故障一块硬盘之后没有冗余硬盘了,我把B控的冗余硬盘剔除一块,分到A控上作为冗余硬盘,所以出现这个问题。

具体命令是

在B控上面 执行 remove [-w]

在A控上面执行 assign {

3.aggr status -r 可以清楚的看到硬盘所在的位置,具体到硬盘的物理位置为第几柜子的几号槽位,这个硬盘黄灯会亮 。

N3700A> aggr status -r
Aggregate systemA (online, raid4) (block checksums)
  Plex /systemA/plex0 (online, normal, active)
    RAID group /systemA/plex0/rg0 (normal)
      RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
      ---------	------	------------- ---- ---- ---- ----- --------------    --------------
      parity  	0b.17	0b    1   1   FC:A   -  FCAL 10000 68000/139264000   69536/142410400 
      data    	0b.18	0b    1   2   FC:A   -  FCAL 10000 68000/139264000   69536/142410400 
Aggregate AIXMAIL (online, raid4) (block checksums)
  Plex /AIXMAIL/plex0 (online, normal, active)
    RAID group /AIXMAIL/plex0/rg0 (normal)
      RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
      ---------	------	------------- ---- ---- ---- ----- --------------    --------------
      parity  	0b.37	0b    2   5   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.36	0b    2   4   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.45	0b    2   13  FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.34	0b    2   2   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.33	0b    2   1   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.32	0b    2   0   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.39	0b    2   7   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
    RAID group /AIXMAIL/plex0/rg1 (normal)
      RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
      ---------	------	------------- ---- ---- ---- ----- --------------    --------------
      parity  	0b.41	0b    2   9   FC:A   -  ATA   7200 423111/866531584  423889/868126304 
      data    	0b.43	0b    2   11  FC:A   -  ATA   7200 423111/866531584  423889/868126304 

Spare disks (empty)

Broken disks
RAID Disk	Device	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
---------	------	------------- ---- ---- ---- ----- --------------    --------------
failed  	    0a.01.5 	0b    2   3   FC:A   -  ATA   7200 423111/866531584  423889/868126304 

清楚知道 0a.01.5 这个硬盘的物理位置为第2柜子的3号槽位.

4.拔掉故障硬盘,换上新硬盘,运行disk show -v

netapp3210B> disk show -v
  DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
------------ -------------          -----  -------------           -------------            ------
0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
0a.01.5      Not Owned                  NONE   J9YYZDLM             Block
0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block

可以看到新盘没有OWNER,显示为Not Owned

5.硬盘原属于netapp3210B,而当前操作的也是B控制器,所以直接运行disk assign 0a.01.5,系统会默认把0b.35硬盘分配给当前控制器

netapp3210B> disk assign 0a.01.5
Sat Nov 26 14:20:59 CST [netapp3210B:diskown.changingOwner:info]: changing ownership for disk 0a.01.5 (S/N J9YYZDLM) from unowned (ID 4294967295) to netapp3210B (ID 1573852909)  

6.通过disk show -v 和aggr status -r看看新替换的硬盘是否正常并处于spare disk。

netapp3210B> disk show -v       
  DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
------------ -------------          -----  -------------           -------------            ------
0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
0a.01.5      netapp3210B(1573852909)    Pool0  J9YYZDLM              netapp3210B(1573852909)  Block
0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block
netapp3210B> aggr status -r
Aggregate aggr0 (online, raid_dp) (block checksums)
  Plex /aggr0/plex0 (online, normal, active, pool0)
    RAID group /aggr0/plex0/rg0 (normal, block checksums)

      RAID Disk	Device  	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
      ---------	------  	------------- ---- ---- ---- ----- --------------    --------------
      dparity 	0b.01.12	0b    1   12  SA:A   0   SAS 15000 560000/1146880000 560879/1148681096 
      parity  	0a.01.13	0a    1   13  SA:B   0   SAS 15000 560000/1146880000 560879/1148681096 
      data    	0b.01.14	0b    1   14  SA:A   0   SAS 15000 560000/1146880000 560879/1148681096 


Pool1 spare disks (empty)

Pool0 spare disks

RAID Disk	Device  	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
---------	------  	------------- ---- ---- ---- ----- --------------    --------------
Spare disks for block checksum
spare   	0a.01.5 	0a    1   5   SA:B   0   SAS 15000 560000/1146880000 560879/1148681096 

Partner disks

RAID Disk	Device  	HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
---------	------  	------------- ---- ---- ---- ----- --------------    --------------
partner 	0a.01.23	0a    1   23  SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.22	0b    1   22  SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.0 	0b    1   0   SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.6 	0b    1   6   SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.9 	0a    1   9   SA:B   0   SAS 15000 0/0               560208/1147307688 
partner 	0a.01.1 	0a    1   1   SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.7 	0a    1   7   SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.3 	0a    1   3   SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.18	0b    1   18  SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.21	0a    1   21  SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.2 	0b    1   2   SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.17	0a    1   17  SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.16	0b    1   16  SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.11	0a    1   11  SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.4 	0b    1   4   SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.19	0a    1   19  SA:B   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.10	0b    1   10  SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.8 	0b    1   8   SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0b.01.20	0b    1   20  SA:A   0   SAS 15000 0/0               560879/1148681096 
partner 	0a.01.15	0a    1   15  SA:B   0   SAS 15000 0/0               560879/1148681096 
netapp3210B> disk show -v
  DISK       OWNER                  POOL   SERIAL NUMBER           HOME                     CHKSUM
------------ -------------          -----  -------------           -------------            ------
0b.01.18     netapp3210A(1573857221)    Pool0  JZV95J1J              netapp3210A(1573857221)  Block
0a.01.15     netapp3210A(1573857221)    Pool0  CZY8DPUN              netapp3210A(1573857221)  Block
0b.01.20     netapp3210A(1573857221)    Pool0  JZV91WYJ              netapp3210A(1573857221)  Block
0b.01.16     netapp3210A(1573857221)    Pool0  JZV19P7J              netapp3210A(1573857221)  Block
0a.01.11     netapp3210A(1573857221)    Pool0  JZV9467J              netapp3210A(1573857221)  Block
0b.01.8      netapp3210A(1573857221)    Pool0  JZV8XGNJ              netapp3210A(1573857221)  Block
0a.01.3      netapp3210A(1573857221)    Pool0  JZV91LYJ              netapp3210A(1573857221)  Block
0a.01.13     netapp3210B(1573852909)    Pool0  JZV9KYJJ              netapp3210B(1573852909)  Block
0a.01.5      netapp3210B(1573852909)    Pool0  J9YYZDLM              netapp3210B(1573852909)  Block
0b.01.2      netapp3210A(1573857221)    Pool0  JZV9136J              netapp3210A(1573857221)  Block
0b.01.10     netapp3210A(1573857221)    Pool0  JZV7SAYJ              netapp3210A(1573857221)  Block
0a.01.19     netapp3210A(1573857221)    Pool0  JZVA2U2J              netapp3210A(1573857221)  Block
0b.01.4      netapp3210A(1573857221)    Pool0  JZV8SN4J              netapp3210A(1573857221)  Block
0a.01.1      netapp3210A(1573857221)    Pool0  JZV74KHJ              netapp3210A(1573857221)  Block
0a.01.21     netapp3210A(1573857221)    Pool0  JZV7ESAJ              netapp3210A(1573857221)  Block
0b.01.22     netapp3210A(1573857221)    Pool0  JZV97BSJ              netapp3210A(1573857221)  Block
0a.01.17     netapp3210A(1573857221)    Pool0  JZV90LGJ              netapp3210A(1573857221)  Block
0b.01.14     netapp3210B(1573852909)    Pool0  JZV9J0KJ              netapp3210B(1573852909)  Block
0b.01.12     netapp3210B(1573852909)    Pool0  JZV9KZSJ              netapp3210B(1573852909)  Block
0a.01.7      netapp3210A(1573857221)    Pool0  JZV8MW4J              netapp3210A(1573857221)  Block
0b.01.6      netapp3210A(1573857221)    Pool0  JZV95EUJ              netapp3210A(1573857221)  Block
0b.01.0      netapp3210A(1573857221)    Pool0  JZV7GLUJ              netapp3210A(1573857221)  Block
0a.01.9      netapp3210A(1573857221)    Pool0  6SLAWVLK0000N636075Q  netapp3210A(1573857221)  Block
0a.01.23     netapp3210A(1573857221)    Pool0  JZVA2MUJ              netapp3210A(1573857221)  Block

显示新更换的硬盘已经成为spare disk,即完成故障硬盘更换。 

7.如果在换盘之后,硬盘出现bad label

RAID Disk       Device  HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)
---------       ------  ------------- ---- ---- ---- ----- --------------    --------------
bad label       0b.44   0b    2   12  FC:A   -  FCAL 15000 272000/557056000  280104/573653840 

执行如下命令: 

priv set advanced  #进入高级维护模式

disk unfail -s 0b.44  #处理bad label错误

8.如果换盘之后出现 Not zeroed,执行如下命令

disk zero spares

这时没有零化的热备盘会开始零化,这可能需要一段时间,可通过vol status -s监控

你可能感兴趣的:(Linux,服务器,运维)