OGG_GoldenGate日常监控（案例）

2014-03-11 Created By BaoXinjian

 一、摘要

---

对GoldenGate实例进行监控，可以公国简单高效的方式GGSCI命令进行监控，并查看返回的信息，判断GoldenGate运行情况是否正常

1. 使用GGSCI命令监控

2. 通过ggserr.log日志监控

3. 通过进入report目录文件监控

4. 日常运维监控自动化脚本

 

 二、使用GGSCI命令监控

---

1. info all

(1). 作用：查看整体的运行情况

(2). 示例

GGSCI (gavinprod.com) 5> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING                                           

EXTRACT     RUNNING     DMP2        842:45:01     00:00:09    

EXTRACT     RUNNING     EXT1        841:19:24     00:00:04    

EXTRACT     RUNNING     EXT2        529:12:40     00:00:00 

2. view params process

(1). 作用：查看进程的参数设置

(2). 示例

GGSCI (gavinprod.com) 6> view params EXT1

extract ext1

userid ggate@gavinprod, password oracle

rmthost odellprod.com, mgrport 7809

rmttrail /opt/oracle/ggate/dirdat/lt

ddl include mapped objname sender.*;

table sender.*;

3. info process

(1). 作用：查看进程的信息性，包括进程的状态、Checkpoint信息、延时等

(2). 示例

GGSCI (gavinprod.com) 7> info EXT1

EXTRACT    EXT1      Last Started 2015-01-28 05:31   Status RUNNING

Checkpoint Lag       529:05:45 (updated 00:00:02 ago)

Log Read Checkpoint  Oracle Redo Logs

                     2015-01-06 04:27:03  Seqno 24, RBA 18464196

                     SCN 0.1440415 (1440415)

4. info process detail

(1). 作用：查看更加详细的信息，包括所使用的trail文件、参数文件、报告文件、警告文件的位置

(2). 示例

GGSCI (gavinprod.com) 8> info EXT1 detail

EXTRACT    EXT1      Last Started 2015-01-28 05:31   Status RUNNING

Checkpoint Lag       431:32:57 (updated 00:00:04 ago)

Log Read Checkpoint  Oracle Redo Logs

                     2015-01-10 06:00:18  Seqno 31, RBA 40079092

                     SCN 0.1553661 (1553661)

  Target Extract Trails:

  Remote Trail Name                                Seqno        RBA     Max MB

  /opt/oracle/ggate/dirdat/lt                          1       1105        100

  Extract Source                          Begin             End             

  /opt/oracle/flash_recovery_area/GAVINPROD/archivelog/2015_01_10/o1_mf_1_31_bc2d3p27_.arc  2014-12-24 04:12  2015-01-10 06:00

  /opt/oracle/oradata/gavinprod/redo01.log  2014-12-24 00:23  2014-12-24 04:12

  Not Available                           * Initialized *   2014-12-24 00:23

Current directory    /opt/oracle/ggate

Report file          /opt/oracle/ggate/dirrpt/EXT1.rpt

Parameter file       /opt/oracle/ggate/dirprm/ext1.prm

Checkpoint file      /opt/oracle/ggate/dirchk/EXT1.cpe

Process file         /opt/oracle/ggate/dirpcs/EXT1.pce

Stdout file          /opt/oracle/ggate/dirout/EXT1.out

Error log            /opt/oracle/ggate/ggserr.log

5. info process showch

(1). 作用：查看详细的关于checkpoint的细心你想，用于查询GoldenGate进行处理过的事物记录

Extract进程的Recovery checkpoing，他标识源数据最早的未被处理事物，可以查到该事物的redo log位于哪个日志文件以及该日志文件的序列号，所有序列号比它大得日志文件都需保留

(2). 示例

GGSCI (gavinprod.com) 9> info EXT1 showch

EXTRACT    EXT1      Last Started 2015-01-28 05:31   Status RUNNING

Checkpoint Lag       00:00:00 (updated 00:00:06 ago)

Log Read Checkpoint  Oracle Redo Logs

                     2015-01-28 05:33:32  Seqno 42, RBA 2548736

                     SCN 0.1750257 (1750257)

Current Checkpoint Detail:

Read Checkpoint #1

  Oracle Redo Log

  Startup Checkpoint (starting position in the data source):

    Thread #: 1

    Sequence #: 19

    RBA: 37158416

    Timestamp: 2014-12-24 04:12:21.000000

    SCN: 0.1341390 (1341390)

    Redo File: /opt/oracle/oradata/gavinprod/redo01.log

  Recovery Checkpoint (position of oldest unprocessed transaction in the data source):

    Thread #: 1

    Sequence #: 42

    RBA: 2504208

    Timestamp: 2015-01-28 05:33:32.000000

    SCN: 0.1750256 (1750256)

    Redo File: /opt/oracle/oradata/gavinprod/redo03.log

  Current Checkpoint (position of last record read in the data source):

    Thread #: 1

    Sequence #: 42

    RBA: 2548736

    Timestamp: 2015-01-28 05:33:32.000000

    SCN: 0.1750257 (1750257)

    Redo File: /opt/oracle/oradata/gavinprod/redo03.log

Write Checkpoint #1

  GGS Log Trail

  Current Checkpoint (current write position):

    Sequence #: 1

    RBA: 1105

    Timestamp: 2015-01-28 05:33:46.462178

    Extract Trail: /opt/oracle/ggate/dirdat/lt

CSN state information:

  CRC: A4-7E-18-EE

  Latest CSN: 1749736

  Latest TXN: 7.29.894

  Latest CSN of finished TXNs: 1749736

  Completed TXNs: 7.29.894

Header:

  Version = 2

  Record Source = A

  Type = 10

  # Input Checkpoints = 1

  # Output Checkpoints = 1

File Information:

  Block Size = 2048

  Max Blocks = 100

  Record Length = 2048

  Current Offset = 0

Configuration:

  Data Source = 3

  Transaction Integrity = 1

  Task Type = 0

Status:

  Start Time = 2015-01-28 05:31:39

  Last Update Time = 2015-01-28 05:33:46

  Stop Status = A

  Last Result = 400

6. lag process

(1). 作用：查看详细的延时信息

(2). 示例

GGSCI (gavinprod.com) 10> lag EXT1

Sending GETLAG request to EXTRACT EXT1 ...

Last record lag: 23 seconds.

At EOF, no more records to process.

7. stats

(1). 作用：查看进程处理的记录数

(2). 示例

GGSCI (gavinprod.com) 13> stats EXT1, total

Sending STATS request to EXTRACT EXT1 ...

Start of Statistics at 2015-01-28 05:37:59.

DDL replication statistics (for all trails):

*** Total statistics since extract started     ***

        Operations                                      2899.00

        Mapped operations                                  0.00

        Unmapped operations                             2809.00

        Other operations                                  90.00

        Excluded operations                             2899.00

Output to /opt/oracle/ggate/dirdat/lt:

Extracting from GGATE.GGS_MARKER to GGATE.GGS_MARKER:

*** Total statistics since 2015-01-28 05:31:45 ***

        No database operations have been performed.

End of Statistics.

8. view report process

(1). 作用：查看对应的报告文件

(2). 示例

GGSCI (gavinprod.com) 11> view report EXT1 

***********************************************************************

                 Oracle GoldenGate Capture for Oracle

    Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230_FBO

   Linux, x64, 64bit (optimized), Oracle 11g on Apr 23 2012 08:42:16

Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.

                    Starting at 2015-01-28 05:31:33

***********************************************************************

Operating System Version:

Linux

Version #1 SMP Mon Nov 12 02:14:55 EST 2007, Release 2.6.18-53.el5

Node: gavinprod.com

Machine: x86_64

                         soft limit   hard limit

Address Space Size   :    unlimited    unlimited

Heap Size            :    unlimited    unlimited

File Size            :    unlimited    unlimited

CPU Time             :    unlimited    unlimited

Process id: 5097

Description: 

***********************************************************************

**            Running with the following parameters                  **

***********************************************************************

2015-01-28 05:31:33  INFO    OGG-03035  Operating system character set identified as UTF-8. Locale: en_US, LC_ALL:.

extract ext1

userid ggate@gavinprod, password ******

2015-01-28 05:31:35  INFO    OGG-03500  WARNING: NLS_LANG environment variable does not match database character set, or not set. 
Using database character set value of AL32UTF8.

rmthost odellprod.com, mgrport 7809

rmttrail /opt/oracle/ggate/dirdat/lt

 

 三、通过ggserr.log日志监控

---

1. ggserr.log可以查看到的内容

(1). GGSCI命令的历史记录

(2). GoldenGate进程的启动和停止

(3). 已执行的处理

(4). 发生的错误

(5). 信息和警告消息

2. 如何查看 - 通过ggsevt命令

GGSCI (gavinprod.com) 14> view ggsevt

2014-09-10 01:26:35  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): edit params mgr.

2014-09-10 01:27:16  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): edit params mgr.

2014-09-10 01:27:27  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): start manager.

2014-09-10 01:27:28  INFO    OGG-00983  Oracle GoldenGate Manager for Oracle, mgr.prm:  Manager started (port 7809).

2014-09-10 01:27:40  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): add extract ext1  tranlog, begin now.

2014-09-10 01:29:24  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): add exttrail2014-09-10 02:24:03

2014-09-10 02:24:03  INFO    OGG-00983  Oracle GoldenGate Manager for Oracle, mgr.prm:  Manager started (port 7809).

2014-09-10 02:24:07  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): start EXT1.

2014-09-10 02:24:07  INFO    OGG-00963  Oracle GoldenGate Manager for Oracle, mgr.prm:  Command received from GGSCI on host gavinprod.com 

2014-09-10 02:24:07  INFO    OGG-00975  Oracle GoldenGate Manager for Oracle, mgr.prm:  EXTRACT EXT1 starting.

2014-09-10 02:24:08  INFO    OGG-00992  Oracle GoldenGate Capture for Oracle, ext1.prm:  EXTRACT EXT1 starting.

2014-09-10 02:24:08  INFO    OGG-03035  Oracle GoldenGate Capture for Oracle, ext1.prm:  Operating system character set identified as UTF-8. 

2014-09-10 02:24:19  INFO    OGG-01635  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: reset to initial or altered checkpoint.

2014-09-10 02:24:19  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: BR

    anon alloc: mmap(MAP_ANON)  anon free: munmap

    file alloc: mmap(MAP_SHARED)  file free: munmap

    target directories:

    /opt/oracle/ggate/BR/EXT1.

2014-09-10 02:24:19  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: COM

    anon alloc: mmap(MAP_ANON)  anon free: munmap

    file alloc: mmap(MAP_SHARED)  file free: munmap

    target directories:

    /opt/oracle/ggate/dirtmp.

2014-09-10 02:24:20  WARNING OGG-01423  Oracle GoldenGate Capture for Oracle, ext1.prm:  No valid default archive log destination directory found

3. 如可查看 - 通过gserr.log文件

[ggate@gavinprod ggate]$ pwd

/opt/oracle/ggate

[ggate@gavinprod ggate]$ ls ggserr.log

ggserr.log

 

 四、通过进入report目录文件监控

---

1. 通过report文件

[ggate@gavinprod dirrpt]$ pwd

/opt/oracle/ggate/dirrpt

[ggate@gavinprod dirrpt]$ ls -ltr

total 260

-rw-rw-rw- 1 ggate  oinstall  1182 Sep 10 01:27 MGR3.rpt

-rw-rw-rw- 1 ggate  oinstall  1721 Sep 10 02:24 MGR2.rpt

-rw-rw-rw- 1 ggate  oinstall  1721 Sep 16 19:06 MGR1.rpt

-rw-rw-rw- 1 ggate  oinstall  4242 Sep 16 19:06 EXT19.rpt

-rw-rw-rw- 1 oracle oinstall 21926 Dec 23 23:52 EXT18.rpt

-rw-rw-rw- 1 oracle oinstall 20432 Dec 23 23:56 EXT17.rpt

2. 通过discard文件

[ggate@gavinprod dirrpt] $ pwd

/opt/oracle/ggate/dirrpt

[ggate@gavinprod dirrpt] $ ls *dsc

REP1.dsc

[ggate@gavinprod dirrpt] $ cat REP1.dsc

OCI Error ORA-00001: unique constraint (RECEIVER.GAVIN_TEST) violated (status = 1), 
SQL <INSERT INTO "RECEIVER"."GAVIN_TEST" ("ID","TEST_DATE","TEST_DESCRIPTION") VALUES (:a0,:a1,:a2)>

Operation failed at seqno 388 rba 41327974

Discarding record on action DISCARD on error 1

Problem replicating SENDER.GAVIN_TEST to RECEIVER.GAVIN_TEST

Mapping problem with insert record (target format)...

*

ID = 1

TEST_DATE = 2015-01-24 20:29:12

TEST_DESCRIPTION = GAVIN TEST OGG DISCARD

*

 

 五、日常运维监控自动化脚本

---

 GoldenGate可运行监控脚本，用以监控OGG日常状态，和当前以及需要的归档号码

 

Thanks and Regards