Gentlemen,
Please advise me with the following scenario, which is Iu2019m facing a problem with system performance,
My system configuration is: SAP ECC 6.0
Database System: Oracle 10.2.0.2.0.
Server Configuration: Power 6
Processor Type: PowerPC_POWER6
Processor Implementation Mode: POWER 6
Processor Version: PV_6_Compat
Number Of Processors: 6
Processor Clock Speed: 3503 MHz
CPU Type: 64-bit
Kernel Type: 64-bit
LPAR Info: 2 PRODUCTION
Memory Size: 47104 MB
Good Memory Size: 47104 MB
Platform Firmware level: EL340_039
Firmware Version: IBM,EL340_039
The following Information was generated from TCode: sm51:
SAP Release Information
Application Server SAPPRD_PRD_00
SAP Kernel Information
SAP Kernel : 700_REL
Database Client Library : OCI_101
created in : AIX 2 5 005DD9CD4C00
Support Level : 0
Kernel Patch number : 202
Source ID : 0.202
DBSL Patch No. : 046
ICU Version : 3.0 Unicode Version 4.0.1
libsapu16 Version : 1.0025 Apr 8 2009 16:21:08
Supported Environment
SAP Database Version
700
Database
ORACLE 9.2.0..
ORACLE 10.1.0..
ORACLE 10.2.0..
Operating System
aix 1 5
aix 2 5
aix 3 5
aix 1 6
My active parameter in Tcode : RZ10 as follow:
Parameter Name Parameter value
login/accept_sso2_ticket 1
login/create_sso2_ticket 2
rsau/enable 1
login/failed_user_auto_unlock 0
login/fails_to_user_lock 5
gw/max_sys 2000
gw/max_overflow_size 25000000
rdisp/max_comm_entries 2000
rdisp/tm_max_no 2000
gw/max_conn 2000
rdisp/max_arq 2000
ES/SHM_SEG_COUNT 8192
ES/SHM_USER_COUNT 8192
ES/SHM_SEG_SIZE 2048
ES/TABLE SHM_SEGS
ztta/short_area 4000000
em/global_area_MB 256
zcsa/db_max_buftab 10000
sap/bufdir_entries 10000
enque/table_size 60000
rsdb/obj/large_object_size 35000
rsdb/obj/max_objects 45000
rsdb/obj/buffersize 150000
rdisp/gui_auto_logout 0
login/password_expiration_time 0
rdisp/max_wprun_time 25000
login/multi_login_users CICUSER,TALSAYED,ASALAM
login/disable_multi_gui_login 1
SAPSYSTEMNAME PRD
SAPSYSTEM 0
INSTANCE_NAME DVEBMGS00
DIR_CT_RUN $(DIR_EXE_ROOT)/run
DIR_EXECUTABLE $(DIR_INSTANCE)/exe
PHYS_MEMSIZE 8000
exe/saposcol $(DIR_CT_RUN)/saposcol
rdisp/wp_no_dia 70
rdisp/wp_no_btc 20
exe/icmbnd $(DIR_CT_RUN)/icmbnd
icm/server_port_0 PROT=HTTP,PORT=80$$
ms/server_port_0 PROT=HTTP,PORT=81$$
rdisp/wp_no_enq 1
rdisp/wp_no_vb 2
rdisp/wp_no_vb2 2
rdisp/wp_no_spo 10
abap/buffersize 9900000
zcsa/table_buffer_area 108003328
rtbb/buffer_length 60000
rsdb/cua/buffersize 24000
zcsa/presentation_buffer_area 28166144
rdisp/appc_ca_blk_no 2000
rdisp/wp_ca_blk_no 1000
rsdb/ntab/entrycount 68500
rsdb/ntab/ftabsize 100000
rsdb/ntab/irbdsize 20000
rsdb/ntab/sntabsize 3995
DIR_ROLL /usr/sap/PRD/DVEBMGS00/data
DIR_PAGING /usr/sap/PRD/DVEBMGS00/data
DIR_DATA /usr/sap/PRD/DVEBMGS00/data
DIR_REORG /usr/sap/PRD/DVEBMGS00/data
DIR_TRANS /usr/sap/trans
DIR_TEMP /tmp
DIR_SORTTMP /usr/sap/PRD/DVEBMGS00/data
zcsa/system_language E
zcsa/installed_languages AE
abap/use_paging 0
ztta/roll_first 1024
rdisp/keepalive_timeout 8000
ztta/roll_area 9000960
rdisp/ROLL_SHM 16384
rdisp/ROLL_MAXFS 32768
rdisp/PG_SHM 16384
rdisp/PG_MAXFS 200064
abap/heap_area_dia 2012217344
abap/heap_area_nondia 2012217344
abap/heap_area_total 2012217344
abap/heaplimit 40894464
abap/swap_reserve 20971520
ztta/roll_extension 2101346304
em/initial_size_MB 4092
em/blocksize_KB 4096
em/stat_log_size_MB 20
em/stat_log_timeout 0
login/no_automatic_user_sapstar 0
login/system_client 100
icm/server_port_1 PROT=SMTP,PORT=8025,TIMEOUT=180
rdisp/start_icman TRUE
icm/host_name_full SAPPRD.tmg.dom
install/codepage/appl_server 4102
ipc/shm_psize_10 500000000
ipc/shm_psize_14 0
ipc/shm_psize_18 0
ipc/shm_psize_19 0
ipc/shm_psize_30 -10
ipc/shm_psize_40 500000000
ipc/shm_psize_41 0
ipc/shm_psize_51 -10
ipc/shm_psize_52 -10
ipc/shm_psize_54 -10
ipc/shm_psize_55 -10
ipc/shm_psize_57 -10
ipc/shm_psize_58 -10
I already generated EWA report and I got the following result:
1. Performance Overview PRD
The performance of your system was analyzed with respect to average response times and total workload. We have detected some problems that may impair system performance.
To ensure adequate performance in your core business transactions, you should take corrective action as soon as possible. For further information, please SAP Support.
Rating Check
Performance Evaluation
The following table shows the average response times for various task types:
Task type Dialog Steps Avg. Resp. Time in ms Avg. CPU Time in ms Avg. Wait Time in ms Avg. Load Time in ms Avg. DB Time in ms Avg. GUI Time in ms
DIALOG 212990 1595.2 257.7 31.0 5.0 622.2 136.8
RFC 2904 11876.4 192.1 33.1 1.4 10574.2 0.0
UPDATE 86257 116.1 28.4 2.1 2.9 58.1 0.0
UPDATE2 1100 84.6 16.9 1.3 1.4 48.2 0.0
BATCH 11600 189360.5 46218.1 5.5 3.7 132313.5 0.0
SPOOL 9989 1686.8 37.1 55.6 0.3 49.2 0.0
1.1. Current Workload
The following table lists the number of current users (measured from our workload analysis) in your system.
Users Low Activity Medium Activity High Activity Total Users
Measured in System 162 119 6 287
1.2. Performance Evaluation
The measured times are compared against reference times to provide a rating.
- If the number of dialog steps in an hour is less than 1000 this hour is not considered.
- If the total number of transaction steps is less than 24000, the rating for the task is not performed and a blue line is entered in the table.
The table below shows that a performance problem is expected for the task that is rated YELLOW.
Task Steps Application Server Performance Database Server Performance
Dia 212987
Upd 86257
HTTP 0
Rating Task Time Steps Avg. Response Time (ms) Avg. CPU Time (ms) Avg. Database Time (ms)
Dia 08-09 3726 1343 137 889
Dia 09-10 19990 1003 174 620
Dia 10-11 20603 1747 112 630
Dia 11-12 27934 2437 239 612
Dia 12-13 18921 2737 235 858
Dia 13-14 21579 2163 349 549
Dia 16-17 22529 1134 230 703
Dia 17-18 12189 1709 561 991
Dia 19-20 5840 1550 414 967
Dia 20-21 4951 1294 176 454
The ratings in the table above are determined by comparisons against the reference table below.
If the dialog response times are very poor, it will cause a RED rating for the entire check.
Task Reference for Avg. Response Time (ms) Reference for Avg. DB time (ms)
Dia 1200 600
Upd 2400 1200
HTTP 1200 600
1.3. Transaction Profile Check
The following tables show the response times and the number of dialog steps for the transactions that cause the highest workload in your system. NOTE: A business transaction normally consists of more than one dialog step. As a rough estimate, the actual number of business transactions that are executed in your system is approximately one third of the total dialog steps shown. (Transaction CPIC/RFC is not taken into account.)
1.3.1. Transactions by Total Workload
The following tables list the activities with the highest contribution to the total workload.
WORKLOAD BY TRANSACTION (DIALOG/UPDATE)
Transaction Type Dialog Steps Total Resp. Time in % Avg. Resp. Time in ms Avg. CPU Time in ms Avg. DB Time in ms Avg. GUI Time in ms
Total 299247 100.0 1168.9 191.7 459.6 136.8
ZFIBB DIA 8592 11.1 4522.4 2258.5 633.4 30.1
ZFIRP DIA 6641 7.3 3858.0 1089.7 1162.6 50.0
RECN DIA 11644 6.8 2047.9 129.1 1165.8 202.6
SESSION_MANAGER DIA 8972 5.7 2226.9 80.2 244.2 458.2
ZFICCR DIA 4834 5.2 3775.9 138.4 2535.9 195.6
ZRECPD DIA 8895 4.6 1790.1 85.9 525.3 329.4
FBL3N DIA 10414 4.1 1386.7 109.3 971.8 49.1
ZFIOBC2 DIA 852 3.4 13909.2 2675.7 9302.3 1028.7
ZREOR DIA 2241 3.3 5216.1 2246.2 808.1 357.5
ZFIOB DIA 1176 3.2 9503.7 51.3 8287.0 753.4
38.1% of the "Total Resp. Time" in the above table is caused by customer transactions.
WORKLOAD BY TRANSACTION (BATCH/SPOOL)
Transaction Type Dialog Steps Total Resp. Time in % Avg. Resp. Time in ms Avg. CPU Time in ms Avg. DB Time in ms
Total 21492 100.0 102913.8 24939.7 71399.3
SBIE0001 BTC 36 98.7 60613763.4 14848709.4 42408448.0
ZFIPR SPO 448 0.2 7939.6 169.9 387.1
(BATCH) BTC 7368 0.2 478.4 7.5 22.2
ZFIADCA SPO 486 0.1 5733.7 168.6 177.9
RSAL_BATCH_TOOL_DISPATCHING BTC 96 0.1 23895.0 1964.7 21770.3
ZFIJV SPO 309 0.1 6092.5 107.7 89.5
SAPRSLOG BTC 4 0.1 318475.8 69165.0 257824.5
ZRE_GENERATE_COND_RO BTC 5 0.1 250075.0 3336.0 237287.8
ZRE_AUTO_REJECT_OFFER BTC 20 0.1 57062.0 339.0 54977.8
ZRE_TRANSFER_TOCONT_UPL BTC 346 0.0 3161.3 941.6 2327.7
0.6% of the "Total Resp. Time" in the above table is caused by customer transactions.
According to our analysis, the main system load is caused by background jobs.
The EarlyWatch Alert Service can only detect performance problems for dialog, update and RFC response times. This service does not evaluate performance problems for background jobs.
1.3.2. Transactions by DB Load
The following transaction profiles list the transactions that have the greatest share in the database load, sorted by percentage of total database access times.
DATABASE LOAD BY TRANSACTIONS (DIALOG/UPDATE)
Transaction Type Dialog Steps Total DB Time in % Avg. DB Time in ms
Total 299247 100.0 459.6
RECN DIA 11644 9.9 1165.8
ZFICCR DIA 4834 8.9 2535.9
FBL3N DIA 10414 7.4 971.8
ZFIOB DIA 1176 7.1 8287.0
ZRECCR DIA 1504 7.0 6368.3
ZFIOBC2 DIA 852 5.8 9302.3
ZFIRP DIA 6641 5.6 1162.6
ZFIBB DIA 8592 4.0 633.4
ZFIREMTCH DIA 73 3.5 66443.6
ZRECPD DIA 8895 3.4 525.3
45.3% of the "Total DB Time" in the above table is caused by customer transactions.
DATABASE LOAD BY TRANSACTIONS (BATCH/SPOOL)
Transaction Type Dialog Steps Total DB Time in % Avg. DB Time in ms
Total 21492 100.0 71399.3
SBIE0001 BTC 36 99.5 42408448.0
RSAL_BATCH_TOOL_DISPATCHING BTC 96 0.1 21770.3
ZRE_GENERATE_COND_RO BTC 5 0.1 237287.8
ZRE_AUTO_REJECT_OFFER BTC 20 0.1 54977.8
SAPRSLOG BTC 4 0.1 257824.5
ZRE_TRANSFER_TOCONT_UPL BTC 346 0.1 2327.7
RSPO1043 BTC 4 0.0 143273.5
ZFIPR SPO 448 0.0 387.1
(BATCH) BTC 7368 0.0 22.2
ZFIADCA SPO 486 0.0 177.9
0.3% of the "Total DB Time" in the above table is caused by customer transactions.
Please advice.
Regards,
Ahmed