ASM – My Playground

Recently i installed ASM on my laptop (Windows XP version 2002 SP3) and have a single instance 10.2.0.4 database on it.So thought of playing with ASM a little.Before starting with the game , a small background on ASM, CSS is must , i suppose.

ASM — From asm_10gr2_best_practices

ASM is a management tool specifically built to simplify the job of the DBA.It provides filesystem and volume manager capabilities built into the Oracle database kernel. With this capability, ASM simplifies storage management tasks, such as creating/laying out databases and diskspace management. Since ASM allows disk management to be done using familiar create/alter/drop SQL statements, DBAs do not need to learn a new skill set or make crucial decisions on provisioning.


CSS (Cluster Synchronization Services)
— From asm_10gr2_best_practices

ASM was designed to work with single instance as well as with RAC 10g clusters. ASM, even in singleinstance, requires that Cluster Synchronization Services (CSS) is installed and started before ASM becomes available. In a single instance, CSS maintains synchronization between the ASM and database instances.
Since CSS provides cluster management and node monitor management, it inherently monitors ASM and its shared storage components (disks and diskgroups). Upon startup, ASM will register itself and all diskgroups it has mounted, with CSS. This allows CSS across all RAC nodes to keep diskgroup metadata in-sync. Any new diskgroups that are created are also dynamically registered and broadcasted to other nodes in the cluster.
As with the database, internode communication is used to synchronize activities in ASM instances. CSS is used to heartbeat the health of the ASM instances. ASM internode messages are initiated by structural changes that require synchronization; e.g. adding a disk. Thus, ASM uses the same integrated lock management infrastructure that is used by the database for efficient synchronization.

Time to play –

11:31:03 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           1           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1150 DATA1_0000 \\.\ORCLDISKDATA0
           1           1 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1100 DATA1_0001 \\.\ORCLDISKDATA1
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2

Drop disk "DATA1_0001"

11:31:25 SYS at +ASM >alter diskgroup DATA1 drop disk 'DATA1_0001' rebalance power 2;

11:31:54 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           1           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1817 DATA1_0000 \\.\ORCLDISKDATA0
           1           1 CACHED  MEMBER       ONLINE  DROPPING UNKNOWN       2045        433 DATA1_0001 \\.\ORCLDISKDATA1
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2

11:32:21 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2         23        923        225           4


11:32:46 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           1           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1817 DATA1_0000 \\.\ORCLDISKDATA0
           1           1 CACHED  MEMBER       ONLINE  DROPPING UNKNOWN       2045        433 DATA1_0001 \\.\ORCLDISKDATA1
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2

The view v$asm_disk shows state as "DROPPING" for the DATA1_0001 disk. v$asm_operation shows that the rebalance is in progress.

What happens if “CSS Service aborts” due to some reasons.From another windows stopped the CSS services

11:34:50 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;
select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk
*
ERROR at line 1:
ORA-03113: end-of-file on communication channel

What does alert log shows ???

FROM ASM ALERT LOG-
SQL> alter diskgroup DATA1 drop disk 'DATA1_0001' rebalance power 2 

Sun Oct 24 11:31:53 2010
NOTE: PST update: grp = 1
NOTE: requesting all-instance membership refresh for group=1
Sun Oct 24 11:31:53 2010
NOTE: membership refresh pending for group 1/0xbf802823 (DATA1)
SUCCESS: refreshed membership for 1/0xbf802823 (DATA1)
Sun Oct 24 11:31:57 2010
NOTE: starting rebalance of group 1/0xbf802823 (DATA1) at power 2
Starting background process ARB0
Starting background process ARB1
ARB1 started with pid=15, OS id=504
Sun Oct 24 11:31:59 2010
NOTE: assigning ARB1 to group 1/0xbf802823 (DATA1)
ARB0 started with pid=13, OS id=3656
NOTE: assigning ARB0 to group 1/0xbf802823 (DATA1)
Sun Oct 24 11:34:46 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_gmon_2612.trc:
ORA-29746: Cluster Synchronization Service is being shut down.
ORA-29702: error occurred in Cluster Group Service operation

Sun Oct 24 11:34:46 2010
ERROR: ORA-449 thrown in ARB1 for group number 1
Sun Oct 24 11:34:46 2010
GMON: terminating instance due to error 29746
Sun Oct 24 11:34:46 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_arb1_504.trc:
ORA-00449: background process 'LGWR' unexpectedly terminated with error 29746
ORA-29746: Cluster Synchronization Service is being shut down.
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:46 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_lgwr_2588.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:46 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_psp0_2496.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:46 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_o000_2564.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:47 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_pmon_2492.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:47 2010
ERROR: ORA-449 thrown in ARB0 for group number 1
Sun Oct 24 11:34:47 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_rbal_2608.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:47 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_smon_2596.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:48 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_mman_2500.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:48 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_ckpt_2592.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:48 2010
Errors in file d:\oracle\product\10.2.0\admin\+asm\bdump\+asm_dbw0_2584.trc:
ORA-29746: Cluster Synchronization Service is being shut down.

Sun Oct 24 11:34:54 2010
Instance terminated by GMON, pid = 2612

GMON is Disk Group Monitor process which was introduced in 10gr2, monitors the ASM diskgroup.

Started the CSS service and then ASM instance in nomount mode after which manually fired command to bring all the diskgroup in mount state..

11:39:56 SYS at +ASM >alter diskgroup all mount;

Diskgroup altered.

ASM alert log shows —

SQL> alter diskgroup all mount 

Sun Oct 24 11:40:07 2010
NOTE: cache registered group DATA1 number=1 incarn=0x0f72b70b
NOTE: cache registered group DATA2 number=2 incarn=0x0fa2b70c
Sun Oct 24 11:40:08 2010
NOTE: Hbeat: instance first (grp 1)
Sun Oct 24 11:40:08 2010
NOTE: Hbeat: instance first (grp 2)
Sun Oct 24 11:40:12 2010
NOTE: start heartbeating (grp 1)
NOTE: cache opening disk 0 of grp 1: DATA1_0000 path:\\.\ORCLDISKDATA0
Sun Oct 24 11:40:12 2010
NOTE: F1X0 found on disk 0 fcn 0.15128
NOTE: cache opening disk 1 of grp 1: DATA1_0001 path:\\.\ORCLDISKDATA1
NOTE: cache mounting (first) group 1/0x0F72B70B (DATA1)
NOTE: starting recovery of thread=1 ckpt=15.2047 group=1
NOTE: advancing ckpt for thread=1 ckpt=15.2155
NOTE: cache recovered group 1 to fcn 0.16003
Sun Oct 24 11:40:13 2010
NOTE: opening chunk 1 at fcn 0.16003 ABA 
NOTE: seq=16 blk=2156 
Sun Oct 24 11:40:13 2010
NOTE: cache mounting group 1/0x0F72B70B (DATA1) succeeded
SUCCESS: diskgroup DATA1 was mounted
Sun Oct 24 11:40:13 2010
NOTE: start heartbeating (grp 2)
NOTE: cache opening disk 0 of grp 2: DATA2_0000 path:\\.\ORCLDISKDATA2
Sun Oct 24 11:40:13 2010
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache mounting (first) group 2/0x0FA2B70C (DATA2)
NOTE: starting recovery of thread=1 ckpt=15.125 group=2
NOTE: advancing ckpt for thread=1 ckpt=15.125
NOTE: cache recovered group 2 to fcn 0.1081
Sun Oct 24 11:40:13 2010
NOTE: opening chunk 1 at fcn 0.1081 ABA 
NOTE: seq=16 blk=126 
Sun Oct 24 11:40:13 2010
NOTE: cache mounting group 2/0x0FA2B70C (DATA2) succeeded
SUCCESS: diskgroup DATA2 was mounted
Sun Oct 24 11:40:15 2010
NOTE: recovering COD for group 1/0xf72b70b (DATA1)
SUCCESS: completed COD recovery for group 1/0xf72b70b (DATA1)
NOTE: recovering COD for group 2/0xfa2b70c (DATA2)
SUCCESS: completed COD recovery for group 2/0xfa2b70c (DATA2)
Sun Oct 24 11:40:15 2010
NOTE: starting rebalance of group 1/0xf72b70b (DATA1) at power 2
Starting background process ARB0
Starting background process ARB1
ARB0 started with pid=12, OS id=3972
Sun Oct 24 11:40:15 2010
NOTE: assigning ARB0 to group 1/0xf72b70b (DATA1)
ARB1 started with pid=13, OS id=3284
Sun Oct 24 11:40:16 2010
NOTE: assigning ARB1 to group 1/0xf72b70b (DATA1)

The above shows that rebalance operation started automatically.Finally after the rebalance operation is over, the state becomes “NORMAL” and the header_status shows “FORMER”

11:40:24 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2         19        496        380           1

11:41:20 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;
GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           0           0 CLOSED  FORMER       ONLINE  NORMAL   UNKNOWN       2045          0            \\.\ORCLDISKDATA1
           1           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045        207 DATA1_0000 \\.\ORCLDISKDATA0
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2


Is the case same, when we shutdown the asm instance with “immediate” and “abort” options?

NOTE – After bringing CSS up, only ASM instance was started not the database instance.

First try with “shu immediate” mode.Performed the below steps :-

1. dropped the ASM disk “DATA0_0001” (had added it back)
2. did “shu immediate”
3. startup nomount
4. alter diskgroup all mount

11:59:15 SYS at +ASM >alter diskgroup all mount;

Diskgroup altered.

12:00:03 SYS at +ASM >select * from v$asm_operation;

no rows selected

12:00:08 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           1           0 CACHED  MEMBER       ONLINE  DROPPING UNKNOWN       2045       1209 DATA1_0000 \\.\ORCLDISKDATA0
           1           1 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1041 DATA1_0001 \\.\ORCLDISKDATA1
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2

Automatic rebalance didn’t start.

ASM alert log —

SQL> alter diskgroup all mount 

Sun Oct 24 11:59:21 2010
NOTE: cache registered group DATA1 number=1 incarn=0x3954ad52
NOTE: cache registered group DATA2 number=2 incarn=0x3964ad53
Sun Oct 24 11:59:21 2010
NOTE: Hbeat: instance first (grp 1)
Sun Oct 24 11:59:21 2010
NOTE: Hbeat: instance first (grp 2)
Sun Oct 24 11:59:26 2010
NOTE: start heartbeating (grp 1)
NOTE: cache opening disk 0 of grp 1: DATA1_0000 path:\\.\ORCLDISKDATA0
NOTE: cache opening disk 1 of grp 1: DATA1_0001 path:\\.\ORCLDISKDATA1
Sun Oct 24 11:59:26 2010
NOTE: F1X0 found on disk 1 fcn 0.17557
NOTE: cache mounting (first) group 1/0x3954AD52 (DATA1)
NOTE: cache recovered group 1 to fcn 0.17639
Sun Oct 24 11:59:26 2010
NOTE: opening chunk 1 at fcn 0.17639 ABA 
NOTE: seq=18 blk=3382 
Sun Oct 24 11:59:26 2010
NOTE: cache mounting group 1/0x3954AD52 (DATA1) succeeded
SUCCESS: diskgroup DATA1 was mounted
Sun Oct 24 11:59:26 2010
NOTE: start heartbeating (grp 2)
NOTE: cache opening disk 0 of grp 2: DATA2_0000 path:\\.\ORCLDISKDATA2
Sun Oct 24 11:59:26 2010
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache mounting (first) group 2/0x3964AD53 (DATA2)
NOTE: cache recovered group 2 to fcn 0.1089
Sun Oct 24 11:59:26 2010
NOTE: opening chunk 1 at fcn 0.1089 ABA 
NOTE: seq=18 blk=130 
Sun Oct 24 11:59:26 2010
NOTE: cache mounting group 2/0x3964AD53 (DATA2) succeeded
SUCCESS: diskgroup DATA2 was mounted
Sun Oct 24 11:59:28 2010
NOTE: recovering COD for group 1/0x3954ad52 (DATA1)
SUCCESS: completed COD recovery for group 1/0x3954ad52 (DATA1)
NOTE: recovering COD for group 2/0x3964ad53 (DATA2)
SUCCESS: completed COD recovery for group 2/0x3964ad53 (DATA2)

Manually started the rebalance

12:00:27 SYS at +ASM >alter diskgroup DATA1 rebalance power 2;

Diskgroup altered.

ALERT LOG SHOWS
===============

SQL> alter diskgroup DATA1 rebalance power 2 

Sun Oct 24 12:00:42 2010
NOTE: PST update: grp = 1
NOTE: requesting all-instance membership refresh for group=1
Sun Oct 24 12:00:42 2010
NOTE: membership refresh pending for group 1/0x3954ad52 (DATA1)
SUCCESS: refreshed membership for 1/0x3954ad52 (DATA1)
Sun Oct 24 12:00:46 2010
NOTE: starting rebalance of group 1/0x3954ad52 (DATA1) at power 2
Starting background process ARB0
Starting background process ARB1
ARB1 started with pid=13, OS id=2508
Sun Oct 24 12:00:46 2010
NOTE: assigning ARB1 to group 1/0x3954ad52 (DATA1)
ARB0 started with pid=12, OS id=3644
NOTE: assigning ARB0 to group 1/0x3954ad52 (DATA1)

Checking the asm operation

12:02:44 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2        487        850        320           1

Elapsed: 00:00:00.20
12:02:49 SYS at +ASM >
12:02:50 SYS at +ASM >
12:02:51 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           1           0 CACHED  MEMBER       ONLINE  DROPPING UNKNOWN       2045       1817 DATA1_0000 \\.\ORCLDISKDATA0
           1           1 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045        433 DATA1_0001 \\.\ORCLDISKDATA1
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2
12:03:04 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL REAP          2          1        714        860        334           0

12:03:10 SYS at +ASM >
12:03:15 SYS at +ASM >select * from v$asm_operation;

no rows selected

ASM ALERT LOG
=============

Sun Oct 24 12:03:03 2010
NOTE: stopping process ARB1
Sun Oct 24 12:03:16 2010
NOTE: stopping process ARB0
Sun Oct 24 12:03:16 2010
SUCCESS: rebalance completed for group 1/0x3954ad52 (DATA1) 
Sun Oct 24 12:03:16 2010
SUCCESS: rebalance completed for group 1/0x3954ad52 (DATA1) 
NOTE: PST update: grp = 1
SUCCESS: grp 1 disk DATA1_0000 emptied
WARNING: offlining disk 0.4042546594 (DATA1_0000) with mask 0x1
NOTE: PST update: grp = 1, dsk = 0, mode = 0x6
Sun Oct 24 12:03:17 2010
NOTE: group DATA1: relocated PST to: disk 0001 (PST copy 0)
NOTE: cache closing disk 0 of grp 1: DATA1_0000
Sun Oct 24 12:03:17 2010
NOTE: PST update: grp = 1
NOTE: erasing header on grp 1 disk DATA1_0000
NOTE: cache closing disk 0 of grp 1: DATA1_0000

Time to try with “shu abort” mode.Performed the below steps :-

1. dropped the ASM disk “DATA0_0001” (had added it back)
2. did “shu abort”
3. startup nomount
4. alter diskgroup all mount

13:47:37 SYS at +ASM >alter diskgroup DATA1 drop disk DATA1_0001 rebalance power 2;

Diskgroup altered.

Elapsed: 00:00:01.48
13:48:08 SYS at +ASM >
13:48:08 SYS at +ASM >
13:48:08 SYS at +ASM >
13:48:08 SYS at +ASM >
13:48:09 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           1           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1101 DATA1_0000 \\.\ORCLDISKDATA0
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2
           1           1 CACHED  MEMBER       ONLINE  DROPPING UNKNOWN       2045       1149 DATA1_0001 \\.\ORCLDISKDATA1

Elapsed: 00:00:00.67
13:48:18 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2         24        923        469           1

Elapsed: 00:00:00.40
13:48:20 SYS at +ASM >
13:48:20 SYS at +ASM >
13:48:20 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2         24        923        469           1

Elapsed: 00:00:00.31
13:48:32 SYS at +ASM >
13:48:32 SYS at +ASM >
13:48:32 SYS at +ASM >shu abort
ASM instance shutdown

After the startup, the rebalance starts automatically, in this case too.

13:50:42 SYS at +ASM >alter diskgroup all mount
13:50:47   2  ;

Diskgroup altered.

Elapsed: 00:00:06.25
13:50:55 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2          0        573          0           0
13:51:23 SYS at +ASM >select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- ---- ---------- ---------- ---------- ---------- ---------- -----------
           1 REBAL RUN           2          2        114        594        379           1

Elapsed: 00:00:00.45
13:51:32 SYS at +ASM >select * from v$asm_operation;

no rows selected

Elapsed: 00:00:00.04
13:57:46 SYS at +ASM >select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,REDUNDANCY,TOTAL_MB,FREE_MB,NAME,PATH from v$asm_disk;

GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    REDUNDA   TOTAL_MB    FREE_MB NAME    PATH
------------ ----------- ------- ------------ ------- -------- ------- ---------- ---------- ---------- --------------------
           0           0 CLOSED  FORMER       ONLINE  NORMAL   UNKNOWN       2045          0            \\.\ORCLDISKDATA1
           1           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045        207 DATA1_0000 \\.\ORCLDISKDATA0
           2           0 CACHED  MEMBER       ONLINE  NORMAL   UNKNOWN       2045       1767 DATA2_0000 \\.\ORCLDISKDATA2

ALERT LOG SHOWS
===============
SQL> alter diskgroup all mount
 

Sun Oct 24 13:50:50 2010
NOTE: cache registered group DATA1 number=1 incarn=0x844ebb5b
NOTE: cache registered group DATA2 number=2 incarn=0x847ebb5c
Sun Oct 24 13:50:50 2010
NOTE: Hbeat: instance first (grp 1)
Sun Oct 24 13:50:50 2010
NOTE: Hbeat: instance first (grp 2)
Sun Oct 24 13:50:54 2010
NOTE: start heartbeating (grp 1)
NOTE: cache opening disk 0 of grp 1: DATA1_0000 path:\\.\ORCLDISKDATA0
Sun Oct 24 13:50:54 2010
NOTE: F1X0 found on disk 0 fcn 0.22377
NOTE: cache opening disk 1 of grp 1: DATA1_0001 path:\\.\ORCLDISKDATA1
NOTE: cache mounting (first) group 1/0x844EBB5B (DATA1)
NOTE: starting recovery of thread=1 ckpt=19.7134 group=1
NOTE: advancing ckpt for thread=1 ckpt=19.7262
NOTE: cache recovered group 1 to fcn 0.22514
Sun Oct 24 13:50:54 2010
NOTE: opening chunk 1 at fcn 0.22514 ABA 
NOTE: seq=20 blk=7263 
Sun Oct 24 13:50:54 2010
NOTE: cache mounting group 1/0x844EBB5B (DATA1) succeeded
SUCCESS: diskgroup DATA1 was mounted
Sun Oct 24 13:50:55 2010
NOTE: start heartbeating (grp 2)
NOTE: cache opening disk 0 of grp 2: DATA2_0000 path:\\.\ORCLDISKDATA2
Sun Oct 24 13:50:55 2010
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache mounting (first) group 2/0x847EBB5C (DATA2)
NOTE: starting recovery of thread=1 ckpt=19.133 group=2
NOTE: advancing ckpt for thread=1 ckpt=19.133
NOTE: cache recovered group 2 to fcn 0.1097
Sun Oct 24 13:50:55 2010
NOTE: opening chunk 1 at fcn 0.1097 ABA 
NOTE: seq=20 blk=134 
Sun Oct 24 13:50:55 2010
NOTE: cache mounting group 2/0x847EBB5C (DATA2) succeeded
SUCCESS: diskgroup DATA2 was mounted
Sun Oct 24 13:50:56 2010
NOTE: recovering COD for group 1/0x844ebb5b (DATA1)
SUCCESS: completed COD recovery for group 1/0x844ebb5b (DATA1)
NOTE: recovering COD for group 2/0x847ebb5c (DATA2)
SUCCESS: completed COD recovery for group 2/0x847ebb5c (DATA2)
Sun Oct 24 13:50:56 2010
NOTE: starting rebalance of group 1/0x844ebb5b (DATA1) at power 2
Starting background process ARB0
Starting background process ARB1
ARB1 started with pid=13, OS id=3164
Sun Oct 24 13:50:56 2010
NOTE: assigning ARB1 to group 1/0x844ebb5b (DATA1)
ARB0 started with pid=12, OS id=3668
NOTE: assigning ARB0 to group 1/0x844ebb5b (DATA1)
Sun Oct 24 13:52:41 2010
NOTE: stopping process ARB1
Sun Oct 24 13:52:52 2010
NOTE: stopping process ARB0
Sun Oct 24 13:52:53 2010
SUCCESS: rebalance completed for group 1/0x844ebb5b (DATA1) 
Sun Oct 24 13:52:53 2010
SUCCESS: rebalance completed for group 1/0x844ebb5b (DATA1) 
NOTE: PST update: grp = 1
SUCCESS: grp 1 disk DATA1_0001 emptied
WARNING: offlining disk 1.4043197356 (DATA1_0001) with mask 0x1
NOTE: PST update: grp = 1, dsk = 1, mode = 0x6
NOTE: cache closing disk 1 of grp 1: DATA1_0001
NOTE: PST update: grp = 1
NOTE: erasing header on grp 1 disk DATA1_0001
NOTE: cache closing disk 1 of grp 1: DATA1_0001

Few more things to check with database instance also up and running.Will post soon!!!!!!!!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s