WARNING: IO Failed. au:23 diskname WARNING: cache failed to read ERROR: cache failed to read NOTE: cache initiating offline of disk 3 group 1

如果自己搞不定可以找诗檀软件专业ORACLE数据库修复团队成员帮您恢复!

诗檀软件专业数据库修复团队

服务热线 : 13764045638    QQ号:47079569    邮箱:[email protected]

 

注意当操作系统和存储之间出现IO错误时可能导致ORACLE ASM自动存储管理无法读取关键的ASM metadata,在下面的例子中 由于

ORA-27091: unable to queue I/O
ORA-27072: File I/O error
IBM AIX RISC System/6000 Error: 5: I/O error

IBM AIX 小机出现无法读取/dev/rhdiskdata4 裸设备上的数据块,导致ASM实例无法读取关键性的ASM FILE 1 文件指针信息,此时将无法读取其他asm源数据,虽然可能ASM diskgroup可以mount,但却无法读取任何diskgroup 中的文件,启动数据库也会报错。

Dirty Detach Reconfiguration complete
Fri Jun 24 15:37:39 BEIST 2016
freeing rdom 1
Fri Jun 24 15:37:39 BEIST 2016
WARNING: dirty detached from domain 1
Fri Jun 24 15:37:39 BEIST 2016
SUCCESS: diskgroup DATA was dismounted
Fri Jun 24 15:37:39 BEIST 2016
Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b000_16121950.trc:
ORA-15001: diskgroup "DATA" does not exist or is not mounted
Fri Jun 24 15:37:39 BEIST 2016
WARNING: PST-initiated MANDATORY DISMOUNT of group DATA not performed - group not mounted
Fri Jun 24 15:37:39 BEIST 2016
Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b001_17891466.trc:
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
Fri Jun 24 15:38:13 BEIST 2016
SQL> alter diskgroup data mount 
Fri Jun 24 15:38:13 BEIST 2016
NOTE: cache registered group DATA number=1 incarn=0x3b18e4ab
Fri Jun 24 15:38:13 BEIST 2016
NOTE: Hbeat: instance first (grp 1)
Fri Jun 24 15:38:18 BEIST 2016
NOTE: start heartbeating (grp 1)
NOTE: cache opening disk 0 of grp 1: DATA_0000 path:/dev/rhdiskdata1
Fri Jun 24 15:38:18 BEIST 2016
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache opening disk 1 of grp 1: DATA_0001 path:/dev/rhdiskdata2
NOTE: cache opening disk 2 of grp 1: DATA_0002 path:/dev/rhdiskdata3
NOTE: cache opening disk 3 of grp 1: DATA_0003 path:/dev/rhdiskdata4
NOTE: cache mounting (first) group 1/0x3B18E4AB (DATA)
* allocate domain 1, invalid = TRUE 
Fri Jun 24 15:38:18 BEIST 2016
NOTE: attached to recovery domain 1
Fri Jun 24 15:38:18 BEIST 2016
NOTE: starting recovery of thread=1 ckpt=136.4125 group=1
NOTE: advancing ckpt for thread=1 ckpt=136.4125
NOTE: cache recovered group 1 to fcn 0.20885584
Fri Jun 24 15:38:18 BEIST 2016
NOTE: LGWR attempting to mount thread 1 for disk group 1
NOTE: LGWR mounted thread 1 for disk group 1
NOTE: opening chunk 1 at fcn 0.20885584 ABA 
NOTE: seq=137 blk=4126 
Fri Jun 24 15:38:18 BEIST 2016
NOTE: cache mounting group 1/0x3B18E4AB (DATA) succeeded
SUCCESS: diskgroup DATA was mounted
Fri Jun 24 15:38:21 BEIST 2016
NOTE: recovering COD for group 1/0x3b18e4ab (DATA)
SUCCESS: completed COD recovery for group 1/0x3b18e4ab (DATA)
Fri Jun 24 15:38:28 BEIST 2016
Errors in file /u01/oracle/admin/+ASM/udump/+asm1_ora_15532158.trc:
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
IBM AIX RISC System/6000 Error: 5: I/O error
Additional information: 7
Additional information: 47104
Additional information: -1
Fri Jun 24 15:38:28 BEIST 2016
WARNING: IO Failed.  au:23 diskname:/dev/rhdiskdata4
	 rq:110433db0 buffer:110612000 au_offset(bytes):0 iosz:65536 operation:0
	 status:2
WARNING: cache failed to read gn 1 fn 1 blk 256 count 16 from disk 3
ERROR: cache failed to read fn=1  blk=256 from disk(s): 3
ORA-15080: synchronous I/O operation to a disk failed
NOTE: cache initiating offline of disk 3  group 1
WARNING: process 15532158 initiating offline of disk 3.3587706990 (DATA_0003) with mask 0x3 in group 1
WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 will be taken offline
NOTE: PST update: grp = 1, dsk = 3, mode = 0x6
Fri Jun 24 15:38:28 BEIST 2016
ERROR: too many offline disks in PST (grp 1)
Fri Jun 24 15:38:28 BEIST 2016
WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 was taken offline
Fri Jun 24 15:38:28 BEIST 2016
ERROR: PST-initiated MANDATORY DISMOUNT of group DATA
Fri Jun 24 15:38:28 BEIST 2016
NOTE: halting all I/Os to diskgroup DATA
NOTE: active pin found: 0x700000015faec28
NOTE: active pin found: 0x700000015faeee8
NOTE: active pin found: 0x700000015faf1a8
NOTE: active pin found: 0x700000015faf468
NOTE: active pin found: 0x700000015faecd8
NOTE: active pin found: 0x700000015faef98
NOTE: active pin found: 0x700000015faf258
NOTE: active pin found: 0x700000015faf518
NOTE: active pin found: 0x700000015faed88
NOTE: active pin found: 0x700000015faf048
NOTE: active pin found: 0x700000015faf308
NOTE: active pin found: 0x700000015faf5c8
NOTE: active pin found: 0x700000015faee38
NOTE: active pin found: 0x700000015faf0f8
NOTE: active pin found: 0x700000015faf3b8
NOTE: active pin found: 0x700000015faeb78
Fri Jun 24 15:38:28 BEIST 2016
NOTE: cache dismounting group 1/0x3B18E4AB (DATA) 
Fri Jun 24 15:38:30 BEIST 2016
Dirty detach reconfiguration started (old inc 9, new inc 9)
List of nodes:
 0
 Global Resource Directory partially frozen for dirty detach 
* dirty detach - domain 1 invalid = TRUE 
 276 GCS resources traversed, 0 cancelled
 6104 GCS resources on freelist, 6124 on array, 6124 allocated
Dirty Detach Reconfiguration complete
Fri Jun 24 15:38:30 BEIST 2016
freeing rdom 1
Fri Jun 24 15:38:30 BEIST 2016
WARNING: dirty detached from domain 1
Fri Jun 24 15:38:30 BEIST 2016
SUCCESS: diskgroup DATA was dismounted
Fri Jun 24 15:38:30 BEIST 2016
Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b000_16121950.trc:
ORA-15001: diskgroup "DATA" does not exist or is not mounted
Fri Jun 24 15:38:30 BEIST 2016
WARNING: PST-initiated MANDATORY DISMOUNT of group DATA not performed - group not mounted
Fri Jun 24 15:38:30 BEIST 2016
Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b001_17891466.trc:
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
Fri Jun 24 15:38:34 BEIST 2016
SQL> alter diskgroup data mount 
Fri Jun 24 15:38:34 BEIST 2016
NOTE: cache registered group DATA number=1 incarn=0xbef8e4b0
Fri Jun 24 15:38:34 BEIST 2016
NOTE: Hbeat: instance first (grp 1)
Fri Jun 24 15:38:39 BEIST 2016
NOTE: start heartbeating (grp 1)
NOTE: cache opening disk 0 of grp 1: DATA_0000 path:/dev/rhdiskdata1
Fri Jun 24 15:38:39 BEIST 2016
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache opening disk 1 of grp 1: DATA_0001 path:/dev/rhdiskdata2
NOTE: cache opening disk 2 of grp 1: DATA_0002 path:/dev/rhdiskdata3
NOTE: cache opening disk 3 of grp 1: DATA_0003 path:/dev/rhdiskdata4
NOTE: cache mounting (first) group 1/0xBEF8E4B0 (DATA)
* allocate domain 1, invalid = TRUE 
Fri Jun 24 15:38:39 BEIST 2016
NOTE: attached to recovery domain 1
Fri Jun 24 15:38:39 BEIST 2016
NOTE: starting recovery of thread=1 ckpt=137.4127 group=1
NOTE: advancing ckpt for thread=1 ckpt=137.4127
NOTE: cache recovered group 1 to fcn 0.20885588
Fri Jun 24 15:38:39 BEIST 2016
NOTE: LGWR attempting to mount thread 1 for disk group 1
NOTE: LGWR mounted thread 1 for disk group 1
NOTE: opening chunk 1 at fcn 0.20885588 ABA 
NOTE: seq=138 blk=4128 
Fri Jun 24 15:38:39 BEIST 2016
NOTE: cache mounting group 1/0xBEF8E4B0 (DATA) succeeded
SUCCESS: diskgroup DATA was mounted
Fri Jun 24 15:38:42 BEIST 2016
NOTE: recovering COD for group 1/0xbef8e4b0 (DATA)
SUCCESS: completed COD recovery for group 1/0xbef8e4b0 (DATA)
Fri Jun 24 16:02:23 BEIST 2016
alter database mount
Fri Jun 24 16:02:23 BEIST 2016
ORA-15000 signalled during: alter database mount...
Fri Jun 24 16:02:43 BEIST 2016
Errors in file /u01/oracle/admin/+ASM/udump/+asm1_ora_21495942.trc:
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
IBM AIX RISC System/6000 Error: 5: I/O error
Additional information: 7
Additional information: 47112
Additional information: -1
Fri Jun 24 16:02:43 BEIST 2016
WARNING: IO Failed.  au:23 diskname:/dev/rhdiskdata4
	 rq:110433b60 buffer:70000001046c000 au_offset(bytes):4096 iosz:4096 operation:0
	 status:2
WARNING: cache failed to read gn 1 fn 1 blk 257 count 1 from disk 3
ERROR: cache failed to read fn=1  blk=257 from disk(s): 3
ORA-15080: synchronous I/O operation to a disk failed
NOTE: cache initiating offline of disk 3  group 1
WARNING: process 21495942 initiating offline of disk 3.3587706994 (DATA_0003) with mask 0x3 in group 1
WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 will be taken offline
NOTE: PST update: grp = 1, dsk = 3, mode = 0x6
Fri Jun 24 16:02:43 BEIST 2016
ERROR: too many offline disks in PST (grp 1)
Fri Jun 24 16:02:43 BEIST 2016
WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 was taken offline
Fri Jun 24 16:02:43 BEIST 2016
ERROR: PST-initiated MANDATORY DISMOUNT of group DATA
Fri Jun 24 16:02:43 BEIST 2016
NOTE: halting all I/Os to diskgroup DATA
NOTE: active pin found: 0x700000015faeb78
NOTE: active pin found: 0x700000015faec28
Fri Jun 24 16:02:43 BEIST 2016
NOTE: cache dismounting group 1/0xBEF8E4B0 (DATA) 
Fri Jun 24 16:02:45 BEIST 2016
Dirty detach reconfiguration started (old inc 9, new inc 9)
List of nodes:
 0

 

 

 

启动数据库时报错:
ORA-00210: cannot open the specified control file
ORA-00202: control file: ‘+DATA/hisdb/control02.ctl’
ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl
ORA-15001: diskgroup “DATA” does not exist or is not mounted
ORA-15001: diskgroup “DATA” does not exist or is not mounted
ORA-205 signalled during: alter database mount…

Fri Jun 24 15:31:13 BEIST 2016
SUCCESS: diskgroup DATA was dismounted
SUCCESS: diskgroup DATA was dismounted
Fri Jun 24 15:31:15 BEIST 2016
ORA-00210: cannot open the specified control file
ORA-00202: control file: '+DATA/hisdb/control02.ctl'
ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl
ORA-15130: diskgroup "DATA" is being dismounted
ORA-15066: offlining disk "DATA_0003" may result in a data loss
Fri Jun 24 15:31:15 BEIST 2016
ORA-205 signalled during: alter database mount...
Fri Jun 24 15:34:25 BEIST 2016
NOTE: ASMB process exiting due to lack of ASM file activity for 195 seconds
Fri Jun 24 15:34:25 BEIST 2016
Stopping background process RBAL
Fri Jun 24 16:02:38 BEIST 2016
alter database mount
Fri Jun 24 16:02:38 BEIST 2016
This instance was first to mount
Fri Jun 24 16:02:38 BEIST 2016
Starting background process ASMB
ASMB started with pid=27, OS id=23134340
Starting background process RBAL
RBAL started with pid=28, OS id=10223654
Fri Jun 24 16:02:43 BEIST 2016
SUCCESS: diskgroup DATA was mounted
Fri Jun 24 16:02:43 BEIST 2016
SUCCESS: diskgroup DATA was dismounted
SUCCESS: diskgroup DATA was dismounted
Fri Jun 24 16:02:45 BEIST 2016
ORA-00210: cannot open the specified control file
ORA-00202: control file: '+DATA/hisdb/control02.ctl'
ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl
ORA-15130: diskgroup "DATA" is being dismounted
ORA-15066: offlining disk "DATA_0003" may result in a data loss
Fri Jun 24 16:02:45 BEIST 2016
ORA-205 signalled during: alter database mount...
Fri Jun 24 16:03:06 BEIST 2016
alter database mount
This instance was first to mount
Fri Jun 24 16:03:06 BEIST 2016
ORA-00210: cannot open the specified control file
ORA-00202: control file: '+DATA/hisdb/control02.ctl'
ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-15001: diskgroup "DATA" does not exist or is not mounted
ORA-205 signalled during: alter database mount...

 

 

对于此种情况需要使用特殊恢复技巧扫描这些ORACLE ASM Diskgroup数据并做到数据恢复重组, 具体可以咨询诗檀软件ORACLE恢复团队。


Posted

in

by

Tags:

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *