张麦克

mysql oracle replay_运行database replay进行升级测试

最近要做10g到11g的升级，对于性能方面的测试，一般使用RAT(Oracle Real Application Testing)技术。RAT中主要包含了两种技术，一种叫Database Replay(数据库重演)，另一种叫SQL Performance Analyzer(SQL性能分析)。先来了解一下什么是Database Replay，这

通过这幅图我们可以看到其实就是把生产环境的成百上千个用户执行的语句进行捕获。然后把这一部分负载信息拿到测试环境上进行播放。播放的过程就相当于模拟了成百上千的用户对数据库的操作。但是这个过程有些操作是不支持的。具体参照下面列出的情景。

Workload Capture Restrictions

The following types of client requests are not supported.

Direct path load of data from external files using utilities such as SQL*Loader

Non-PL/SQL based Advanced Queuing (AQ)

Flashback queries

Oracle Call Interface (OCI) based object navigations

Non SQL-based object access

Distributed transactions (any distributed transactions that are captured will be replayed as local transactions)

Oracle Streams/Advanced Replication workload is not supported prior to 11.2.

Database session migration

Database Resident Connection Pooling ( DRCP )

XA transactions

Workloads having Object Out Bind

因此要避免这类的问题，我们可以实施过滤操作，将部分操作过滤出去。

使用Database Replay首先我们需要去查看官方文档Document 560977.1?? Using Real Application Testing Functionality in Earlier Releases。这个文档列出了一些先决条件，比如我们要从10.2.0.5的生产环境捕获负载，然后拿到11.2.0.4环境上回放。这需要你在10.2.0.5和11.2.0.4上安装相应的patch。其实我做了些测试，不安装这个patch，也能够测试成功。但是据Oracle人员称会有一些影响。为了能够精准的执行测试，建议还是安装这些补丁。

Source DB Upgrade from release

Destination DB Upgrade to any release

What patch you need to apply?

Download Information

Comments

10.2.0.5.0

>=11.2.0.3.0

10.2.0.5.0 Patchset + one-off patch 9373986 and 11.2.0.3.0 + one-off patch 13947480

16086826 (16086826 includes 13947480)

17411249

(17411249 includes 16086826 and all other previous patches)

One-off patch can be downloaded or requested from MOS

One-off patch can be downloaded or requested from MOS For patch

10.2.0.5.0

>=11.2.0.4.0

10.2.0.5.0 Patchset + one-off patch 9373986and no mandatory patch required for 11.2.0.4.0

One-off patch can be downloaded or requested from MOS

One-off patch can be downloaded or requested from MOS For patch

安装完补丁之后，我们就可以做database replay的操作了，该操作主要分成四个步骤。

Workload Capture

Workload Processing

Workload Replay – including DML and SQL queries

Analysis and Reporting

我这边做的一个例子是从10.2.0.5捕获系统负载，然后拿到11.2.0.4上面去重放。按照Using Real Application Testing Functionality in Earlier Releases的要求，我们需要在10.2.0.5上面安装Bug 9373986 : WORKLOAD DATA IS NOT CAPTURED WHENEVER RESTARTING WORKLOAD CAPTURE，因为我这只是模拟测试，所以没有安装，实际上可以捕获负载成功。

一、负载捕获

第一个任务就是做捕获，可以通过命令行或者是EM来实现捕获。

1.捕获会把数据库运行的整个活动写入到指定的目录当中。这里我采用系统默认的DATA_PUMP_DIR目录。

SQL> select * from dba_directories where directory_name='DATA_PUMP_DIR';

OWNER????????????????????????? DIRECTORY_NAME???????????????? DIRECTORY_PATH

------------------------------ ------------------------------ --------------------------------------------------

SYS??????????????????????????? DATA_PUMP_DIR????????????????? /oracle/app/oracle/product/10.2.0/db_1/rdbms/log

2.为了更好的演示捕获的过程，需要创建一个表，然后写一些负载的脚本。这里我选择了一些插入和查询的SQL。

SQL> connect test/test

Connected.

create table t1 (

name varchar2(20)

)

下面开始准备两段PL/SQL的代码,模拟大批量的插入t1表和查询scott.emp下的表.

declare

v_sql varchar2(256);

BEGIN

FOR i IN 1 .. 10 LOOP

v_sql:='insert into t1 values (''Name for ' ||i||''')';

execute immediate v_sql;

commit;

END LOOP;

END;

declare

v_sql varchar2(2000);

BEGIN

FOR i IN 1 .. 10 LOOP

v_sql:='select * from scott.emp where rownum

3.设置过滤条件。这里我们可以设置不捕捉SYS用户的，不捕捉是PL/SQL program发起的。当然还有很多种可以过滤的方式，下面罗列了一下。设置完成过滤后，在我们运行捕获负载的时候，我们可以设置INCLUDE和EXCLUDE两个选项。INCLUDE的意思就是所有的Database请求都会捕获，除了定义的过滤条件外。而EXCLUDE正好相反，只会捕捉我们定义的过滤。

If INCLUDE is used, by default all user requests to the database will be captured, except for the part of the workload defined by the filters. If EXCLUDE is used, by default no user request to the database will be captured, except for the part of the workload defined by the filters. Other FILTER attributes which can be used are:-– SESSION_ID – type NUMBER

– USER – type STRING

– MODULE – type STRING

– ACTION – type STRING

– PROGRAM – type STRING

– SERVICE – type STRING

SQL> exec dbms_workload_capture.ADD_FILTER(fname =>'FILTER_SYS',fattribute => 'USER',fvalue => 'TEST');

PL/SQL procedure successfully completed.

SQL> select type, name, attribute, status, value from dba_workload_filters;

TYPE NAME ATTRIBUTE STATUS VALUE

------------------------------ ------------------------- -------------------- ------ --------------------

CAPTURE TEST_CAP_FILTER1 USER NEW test

4.开始捕捉,这里要记住很重要的一点，我们执行开始和结束，都要在这个session下运行。

SQL> BEGIN

2 DBMS_WORKLOAD_CAPTURE.start_capture (name => 'test_capture_1',

3 dir =>'DATA_PUMP_DIR',

4 default_action=>'EXCLUDE',

5 duration => NULL);

6 END;

7 /

BEGIN

ERROR at line 1:

ORA-15591: cannot start capture because parameter "PRE_11G_ENABLE_CAPTURE" is not enabled

ORA-06512: at "SYS.DBMS_WORKLOAD_CAPTURE", line 799

ORA-06512: at line 2

执行出错，这儿需要我们把参数PRE_11G_ENABLE_CAPTURE设置成ture.

SQL> alter system set PRE_11G_ENABLE_CAPTURE=true;

System altered.

SQL> BEGIN

2 DBMS_WORKLOAD_CAPTURE.start_capture (name => 'test_capture_1',

3 dir =>'DATA_PUMP_DIR',

4 default_action=>'EXCLUDE',

5 duration => NULL);

6 END;

7 /

PL/SQL procedure successfully completed.

5.新开一个会话，运行语句。这里我们运行我们前面写的PL/SQL代码，同时我们在SYS下面在执行一些事务。看看我们设置的过滤有没有生效。

SQL> connect test/test

Connected.

SQL> declare

2 v_sql varchar2(256);

3 BEGIN

4 FOR i IN 1 .. 10 LOOP

5 v_sql:='insert into t1 values (''Name for ' ||i||''')';

6 execute immediate v_sql;

7 commit;

8 END LOOP;

9 END;

10 /

PL/SQL procedure successfully completed.

SQL> declare

2 v_sql varchar2(2000);

3 BEGIN

4 FOR i IN 1 .. 10 LOOP

5 v_sql:='select * from scott.emp where rownum connect test/test

Connected.

SQL> insert into t2 select * from dba_tables;

1535 rows created.

SQL> commit;

Commit complete.

6.回到捕获的那个会话窗口，停止捕获。

SQL> exec dbms_workload_capture.finish_capture;

PL/SQL procedure successfully completed.

7.从数据库中查看我们捕获的信息。这里我们可以看到我们的捕获的事务数是10，我们只是捕获了TEST用户下的操作，而对于我们SYS下执行事务的操作是没有捕获的。

SQL> select name, directory, status, start_time, end_time, USER_CALLS,TRANSACTIONS from dba_workload_captures;

NAME DIRECTORY STATUS START_TIM END_TIME USER_CALLS TRANSACTIONS

-------------------- --------------- --------------- --------- --------- ---------- ------------

test_capture_1 DATA_PUMP_DIR COMPLETED 20-APR-14 20-APR-14 56 10

8.从操作系统目录下查看我们捕获的文件。

[oracle@ora10g log]$ ls -lrt

total 80

-rw-r--r-- 1 oracle oinstall 126 Apr 20 13:47 wcr_scapture.wmd

-rw-r--r-- 1 oracle oinstall 3190 Apr 20 13:48 wcr_56rwjh0000000.rec

-rw-r--r-- 1 oracle oinstall 785 Apr 20 13:48 wcr_56rwuh0000002.rec

-rw-r--r-- 1 oracle oinstall 4644 Apr 20 13:48 wcr_56rwrh0000001.rec

-rw-r--r-- 1 oracle oinstall 3190 Apr 20 13:48 wcr_56rx0h0000003.rec

-rw-r--r-- 1 oracle oinstall 1030 Apr 20 13:48 wcr_56rx6h0000004.rec

-rw-r--r-- 1 oracle oinstall 930 Apr 20 13:48 wcr_56rxyh0000005.rec

-rw-r--r-- 1 oracle oinstall 1044 Apr 20 13:48 wcr_56ryah0000006.rec

-rw-r--r-- 1 oracle oinstall 195 Apr 20 13:49 wcr_fcapture.wmd

-rw-r--r-- 1 oracle oinstall 11224 Apr 20 13:49 wcr_cr.text

-rw-r--r-- 1 oracle oinstall 25514 Apr 20 13:49 wcr_cr.html

[oracle@ora10g log]$ tree

|-- wcr_56rwjh0000000.rec

|-- wcr_56rwrh0000001.rec

|-- wcr_56rwuh0000002.rec

|-- wcr_56rx0h0000003.rec

|-- wcr_56rx6h0000004.rec

|-- wcr_56rxyh0000005.rec

|-- wcr_56ryah0000006.rec

|-- wcr_cr.html

|-- wcr_cr.text

|-- wcr_fcapture.wmd

`-- wcr_scapture.wmd

0 directories, 11 files

9.查看捕获的报告。默认情况下执行捕获会生成2个快照，我们还可以通过这两个快照生成AWR报告，用于和重放的AWR进行比较。

SQL> select dbms_workload_capture.report(30,'TEXT') from dual;

DBMS_WORKLOAD_CAPTURE.REPORT(30,'TEXT')

--------------------------------------------------------------------------------

Database Capture Report For ORCL

DB Name DB Id Release RAC Capture Name Status

------------ ----------- ----------- --- -------------------------- ----------

ORCL 1349524903 10.2.0.5.0 NO test_capture_1 COMPLETED

Start time: 20-Apr-14 13:47:58 (SCN = 6740487)

End time: 20-Apr-14 13:48:59 (SCN = 6740608)

Duration: 1 minute 1 second

Capture size: 13.84 KB

Directory object: DATA_PUMP_DIR

Directory path: /oracle/app/oracle/product/10.2.0/db_1/rdbms/log/

Directory shared in RAC: TRUE

Filters used: 1 INCLUSION filter

Captured Workload Statistics DB/Inst: ORCL/ Snaps: 116-117

-> 'Value' represents the corresponding statistic aggregated

across the entire captured database workload.

-> '% Total' is the percentage of 'Value' over the corresponding

system-wide aggregated total.

Statistic Name Value % Total

---------------------------------------- ------------- ---------

DB time (secs) 0.03 15.00

Average Active Sessions 0.00 N/A

User calls captured 56 19.65

User calls captured with Errors 0 N/A

Session logins 5 71.43

Transactions 10 40.00

-------------------------------------------------------------

Top Events Captured DB/Inst: ORCL/ Snaps: 116-117