Oracle启动错误处理一则

客户反映业务有问题，远程连接数据库一看，又发现一个老古董数据库，呵呵。闲话不说，看看解决过程。
主机版本为

引用

# oslevel
4.3.3.0

数据库版本为

引用

SVRMGR> select * from v$version;
BANNER                                                         
----------------------------------------------------------------
Oracle8 Enterprise Edition Release 8.0.6.0.0 - Production      
PL/SQL Release 8.0.6.0.0 - Production                          
CORE Version 4.0.6.0.0 - Production                            
TNS for IBM/AIX RISC System/6000: Version 8.0.6.0.0 - Production
NLSRTL Version 3.3.3.0.0 - Production                          
已选择5行。

用svrmgrl进入数据库，真是老古董了

引用

% svrmgrl

Oracle Server Manager Release 3.0.6.0.0 - Production

Oracle 公司，版权 (c) 1999。保留所有权利

Oracle8 Enterprise Edition Release 8.0.6.0.0 - Production
PL/SQL Release 8.0.6.0.0 - Production

SVRMGR> connect internal/oracle
连接成功。
SVRMGR> startup mount
已启动 ORACLE 实例。
系统全局区域合计有                        178472000个字节
Fixed Size                                          50240个字节
Variable Size                                    61607936个字节
Database Buffers                                116736000个字节
Redo Buffers                                        77824个字节
已装入数据库。

查看数据文件物理位置

引用

SVRMGR> select file#,name from v$datafile;
FILE#      NAME                                                                           
---------- --------------------------------------------------------------------------------
         1 /u01/oradata/oracle8/system01.dbf                                              
         2 /u01/oradata/oracle8/rbs01.dbf                                                 
         3 /u01/oradata/oracle8/temp01.dbf                                                
         4 /u01/oradata/oracle8/tools01.dbf                                               
         5 /u01/oradata/oracle8/users01.dbf                                               
         6 /u01/oradata/oracle8/usr_data01.dbf                                            
         7 /u02/oradata/oracle8/usr_data02.dbf                                            
         8 /u03/oradata/oracle8/usr_data03.dbf                                            
         9 /u01/oradata/oracle8/ind_data01.dbf                                            
        10 /u02/oradata/oracle8/ind_data02.dbf                                            
        11 /u03/oradata/oracle8/ind_data03.dbf                                            
        12 /u01/oradata/oracle8/usr_data07.dbf                                            
        13 /u02/oradata/oracle8/usr_data08.dbf                                            
        14 /u03/oradata/oracle8/usr_data09.dbf                                            
        15 /u02/oradata/oracle8/usr_data05.dbf                                            
        16 /u03/oradata/oracle8/usr_data06.dbf                                            
        17 /u02/oradata/oracle8/ind_data05.dbf                                            
        18 /u03/oradata/oracle8/ind_data06.dbf                                            
        19 /u03/oradata/oracle8/usr_data10.dbf                                            
        20 /u03/oradata/oracle8/ind_data07.dbf                                            
        21 /u03/oradata/oracle8/usr_data11.dbf                                            
        22 /u01/oradata/oracle8/usr_data10.dbf                                            
        23 /u01/oradata/oracle8/usr_data12.dbf                                            
        24 /u02/oradata/oracle8/usr_data13.dbf                                            
        25 /u01/oradata/oracle8/usr_data14.dbf                                            
        26 /u01/oradata/oracle8/usr_data15.dbf                                            
        27 /u03/oradata/oracle8/usr_data16.dbf                                            
        28 /u02/oradata/oracle8/usr_data17.dbf                                            
        29 /u03/oradata/oracle8/usr_data18.dbf                                            
        30 /u01/oradata/oracle8/usr_data19.dbf                                            
        31 /u02/oradata/oracle8/temp02.dbf                                                
        32 /u01/oradata/oracle8/usr_data21.dbf                                            
        33 /u01/oradata/oracle8/usr_data20.dbf                                            
        34 /u01/oradata/oracle8/usr_data22.dbf                                            
        35 /u04/oradata/oracle8/usr_data20.dbf                                            
        36 /u04/oradata/oracle8/usr_data23.dbf                                            
        37 /u06/oradata/oracle8/usr_data25.dbf                                            
        38 /u06/oradata/oracle8/usr_data26.dbf                                            
        39 /u06/oradata/oracle8/usr_data27.dbf                                            
已选择39行。

查看alert日志信息

引用

% tail -f *.log
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Mon Mar  8 15:55:42 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 36 - file not found
ORA-01110: data file 36: '/u04/oradata/oracle8/usr_data23.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
ORA-1157 signalled during: alter database open ...
Tue Mar  9 09:49:25 2010
alter database open
Tue Mar  9 09:49:25 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 37 - file not found
ORA-01110: data file 37: '/u06/oradata/oracle8/usr_data25.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Tue Mar  9 09:49:25 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 38 - file not found
ORA-01110: data file 38: '/u06/oradata/oracle8/usr_data26.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Tue Mar  9 09:49:25 2010
Errors in file /oracle/app/oracle/admin/oracle8/bdump/dbw0_13420_oracle8.trc:
ORA-01157: cannot identify data file 39 - file not found
ORA-01110: data file 39: '/u06/oradata/oracle8/usr_data27.dbf'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
Tue Mar  9 09:49:27 2010
ORA-1157 signalled during: alter database open...

查看vg使用情况

引用

% lsvg -o
ora2vg
oravg
rootvg


# lsvg -l oravg
oravg:
LV NAME             TYPE       LPs   PPs   PVs  LV STATE      MOUNT POINT
oralv1              jfs        416   832   4    open/syncd    /u01
oralv2              jfs        304   608   4    open/syncd    /u02
oralv3              jfs        354   708   4    open/syncd    /u03
loglv00             jfslog     1     1     1    open/syncd    N/A


% lsvg -l ora2vg
ora2vg:
LV NAME             TYPE       LPs   PPs   PVs  LV STATE      MOUNT POINT
loglv01             jfslog     1     1     1    open/syncd    N/A
lv00                jfs        153   153   1    closed/syncd  /u04
lv02                jfs        306   306   1    open/syncd    /u06

查看文件系统mount点

引用

# more /etc/filesystems
* @(#)filesystems @(#)29        1.20  src/bos/etc/filesystems/filesystems, cmdfs, bos430, 9737A_430 4/16/93 15:38:14
* IBM_PROLOG_BEGIN_TAG
* This is an automatically generated prolog.
* 
* bos430 src/bos/etc/filesystems/filesystems 1.20
* 
* Licensed Materials - Property of IBM
* 
* (C) COPYRIGHT International Business Machines Corp. 1985,1993
* All Rights Reserved
* 
* US Government Users Restricted Rights - Use, duplication or
* disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
* 
* IBM_PROLOG_END_TAG
*
* COMPONENT_NAME: CMDFS
*
* FUNCTIONS: none
*
* ORIGINS: 27
*
* (C) COPYRIGHT International Business Machines Corp. 1985, 1993
* All Rights Reserved
* Licensed Materials - Property of IBM
*
* US Government Users Restricted Rights - Use, duplication or
* disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
*
*
*
* This version of /etc/filesystems assumes that only the root file system
* is created and ready.  As new file systems are added, change the check,
* mount, free, log, vol and vfs entries for the appropriate stanza.
*

/:
        dev             = /dev/hd4
        vfs             = jfs
        log             = /dev/hd8
        mount           = automatic
        check           = false
        type            = bootfs
        vol             = root
        free            = true

/home:
        dev       = /dev/hd1
        vol       = "/home"
        mount     = true
        check     = true
        free      = false
        vfs       = jfs
        log       = /dev/hd8

/usr:
        dev             = /dev/hd2
        vfs             = jfs
        log             = /dev/hd8
        mount           = automatic
        check           = false
        type            = bootfs
        vol             = /usr
        free            = false

/var:
        dev             = /dev/hd9var
        vfs             = jfs
        log             = /dev/hd8
        mount           = automatic
        check           = false
        type            = bootfs
        vol             = /var
        free            = false

/tmp:
        dev             = /dev/hd3
        vfs             = jfs
        log             = /dev/hd8
        mount           = automatic
        check           = false
        vol             = /tmp
        free            = false

/mnt:
        dev             = /dev/cd0
        vfs             = cdrfs
        mount           = false
        options         = ro
        account         = false

/cdrom:
        dev             = /dev/cd0
        vfs             = cdrfs
        mount           = false
        options         = ro
        account         = false

/oracle:
        dev             = /dev/oralv0
        vfs             = jfs
        log             = /dev/hd8
        mount           = true
        options         = rw
        account         = false

/u03:
        dev             = /dev/oralv3
        vfs             = jfs
        log             = /dev/loglv00
        mount           = true
        options         = rw
        account         = false

/u01:
        dev             = /dev/oralv1
        vfs             = jfs
        log             = /dev/loglv00
        mount           = true
        options         = rw
        account         = false

/u02:
        dev             = /dev/oralv2
        vfs             = jfs
        log             = /dev/loglv00
        mount           = true
        options         = rw
        account         = false

/u04:
        dev             = /dev/lv00
        vfs             = jfs
        log             = /dev/loglv01
        mount           = true
        options         = rw
        account         = false

/u06:
        dev             = /dev/lv02
        vfs             = jfs
        log             = /dev/loglv01
        mount           = true
        options         = rw
        account         = false

mount文件系统报错：

引用

# mount /u04
Replaying log for /dev/lv00.
mount: 0506-324 Cannot mount /dev/lv00 on /u04: The media is not formatted or the format is not correct.
0506-342 The superblock on /dev/lv00 is dirty.  Run a full fsck to fix.

用fsck检查lv/dev/lv00

引用

# fsck -y /dev/lv00

** Checking /dev/rlv00 (/u04)
** Phase 0 - Check Log
log redo processing for /dev/rlv00                      
** Phase 1 - Check Blocks and Sizes
^[** Phase 2 - Check Pathnames
** Phase 3 - Check Connectivity
** Phase 4 - Check Reference Counts
** Phase 5 - Check Inode Map
** Phase 6 - Check Block Map
Superblock is marked dirty (FIXED)
12 files 4729984 blocks 15324032 free
***** Filesystem was modified *****

再次mount文件系统：

引用

# mount /u04
# df
Filesystem    512-blocks      Free %Used    Iused %Iused Mounted on
/dev/hd4          196608    169512   14%     1494     4% /
/dev/hd2         5570560   2978896   47%    45699     7% /usr
/dev/hd9var      1114112    918856   18%      566     1% /var
/dev/hd3          196608    160680   19%      496     3% /tmp
/dev/hd1           65536     63240    4%       25     1% /home
/dev/oralv0      4194304   2965096   30%     4562     1% /oracle
/dev/oralv3     23199744   3725784   84%       32     1% /u03
/dev/oralv1     27262976   2446056   92%       41     1% /u01
/dev/oralv2     19922944   1761400   92%       30     1% /u02
/dev/lv00       20054016  15324032   24%       21     1% /u04

打开数据库：

引用

SVRMGR> alter database open;
语句已处理。