虚拟机RAC的ASM磁盘组坏块导致重建DB

虚拟机RAC的ASM磁盘组坏块导致重建DB

2011.11.23虚拟机RAC的ASM磁盘组坏块导致重建DB
刚刚在公司的一台PC机器上用vmware workstation8搭建了一套10gr2的rac环境，用的是裸设备+ASM搭建，在安装成功后，不小心被直接重启了下主机，结果再次启动虚拟机的时候提示到有磁盘损坏，也没有在意。但是在启动RAC的时候出现了问题，一开始的现象是如下几个个资源没办法随着其他资源一起启动：
ora.node1.LISTENER_NODE1.lsnr
ora.node2.LISTENER_NODE2.lsnr
ora.RAC.RAC1.inst
ora.RAC.RAC2.inst
ora.RAC.db
看具体的启动过程：
[Oracle@node1 bin]$ crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora....C1.inst application    OFFLINE   OFFLINE              
ora....C2.inst application    OFFLINE   OFFLINE              
ora.RAC.db     application    OFFLINE   OFFLINE              
ora....SM1.asm application    OFFLINE   OFFLINE              
ora....E1.lsnr application    OFFLINE   OFFLINE              
ora.node1.gsd  application    OFFLINE   OFFLINE              
ora.node1.ons  application    OFFLINE   OFFLINE              
ora.node1.vip  application    OFFLINE   OFFLINE              
ora....SM2.asm application    OFFLINE   OFFLINE              
ora....E2.lsnr application    OFFLINE   OFFLINE              
ora.node2.gsd  application    OFFLINE   OFFLINE              
ora.node2.ons  application    OFFLINE   OFFLINE              
ora.node2.vip  application    OFFLINE   OFFLINE              
[oracle@node1 bin]$ crs_start -all
Attempting to start `ora.node1.vip` on member `node1`
Attempting to start `ora.node2.vip` on member `node2`
Start of `ora.node1.vip` on member `node1` succeeded.
Start of `ora.node2.vip` on member `node2` succeeded.
Attempting to start `ora.node1.ASM1.asm` on member `node1`
Attempting to start `ora.node2.ASM2.asm` on member `node2`
Start of `ora.node2.ASM2.asm` on member `node2` succeeded.
Attempting to start `ora.RAC.RAC2.inst` on member `node2`
Start of `ora.RAC.RAC2.inst` on member `node2` failed.
node1 : CRS-1018: Resource ora.node2.vip (application) is already running on node2

node1 : CRS-1018: Resource ora.node2.vip (application) is already running on node2

Start of `ora.node1.ASM1.asm` on member `node1` succeeded.
Attempting to start `ora.RAC.RAC1.inst` on member `node1`
Start of `ora.RAC.RAC1.inst` on member `node1` failed.
node2 : CRS-1018: Resource ora.node1.vip (application) is already running on node1

node2 : CRS-1018: Resource ora.node1.vip (application) is already running on node1

CRS-1002: Resource 'ora.node1.ons' is already running on member 'node1'

CRS-1002: Resource 'ora.node2.ons' is already running on member 'node2'

Attempting to start `ora.node1.gsd` on member `node1`
Attempting to start `ora.RAC.db` on member `node1`
Attempting to start `ora.node2.gsd` on member `node2`
Start of `ora.node1.gsd` on member `node1` succeeded.
Start of `ora.node2.gsd` on member `node2` succeeded.
Start of `ora.RAC.db` on member `node1` failed.
Attempting to start `ora.RAC.db` on member `node2`
Start of `ora.RAC.db` on member `node2` failed.
CRS-1006: No more members to consider

CRS-0215: Could not start resource 'ora.RAC.RAC1.inst'.

CRS-0215: Could not start resource 'ora.RAC.RAC2.inst'.

CRS-0215: Could not start resource 'ora.RAC.db'.

CRS-0223: Resource 'ora.node1.LISTENER_NODE1.lsnr' has placement error.

CRS-0223: Resource 'ora.node1.ons' has placement error.

CRS-0223: Resource 'ora.node2.LISTENER_NODE2.lsnr' has placement error.

CRS-0223: Resource 'ora.node2.ons' has placement error.

[oracle@node1 bin]$ crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora....C1.inst application    ONLINE    OFFLINE              
ora....C2.inst application    ONLINE    OFFLINE              
ora.RAC.db     application    ONLINE    OFFLINE              
ora....SM1.asm application    ONLINE    ONLINE    node1      
ora....E1.lsnr application    OFFLINE   OFFLINE              
ora.node1.gsd  application    ONLINE    ONLINE    node1      
ora.node1.ons  application    ONLINE    ONLINE    node1      
ora.node1.vip  application    ONLINE    ONLINE    node1      
ora....SM2.asm application    ONLINE    ONLINE    node2      
ora....E2.lsnr application    OFFLINE   OFFLINE              
ora.node2.gsd  application    ONLINE    ONLINE    node2      
ora.node2.ons  application    ONLINE    ONLINE    node2      
ora.node2.vip  application    ONLINE    ONLINE    node2      
尝试先把lsnr起来：
[oracle@node1 bin]$ crs_start ora.node1.LISTENER_NODE1.lsnr
Attempting to start `ora.node1.LISTENER_NODE1.lsnr` on member `node1`
Start of `ora.node1.LISTENER_NODE1.lsnr` on member `node1` succeeded.
[oracle@node1 bin]$ crs_start ora.node2.LISTENER_NODE2.lsnr
Attempting to start `ora.node2.LISTENER_NODE2.lsnr` on member `node2`
Start of `ora.node2.LISTENER_NODE2.lsnr` on member `node2` succeeded.
接着启动两个inst，接着出现问题了，inst无法拉起来：
[oracle@node1 bin]$ crs_start ora.RAC.RAC1.inst
Attempting to start `ora.RAC.RAC1.inst` on member `node1`
Start of `ora.RAC.RAC1.inst` on member `node1` failed.
node2 : CRS-1018: Resource ora.node1.vip (application) is already running on node1