KEWRAFC: Flush slave failed, AWR Enqueue Timeout In *_mmon_*.trc

Visit the Below Website to access unlimited exam questions for all IT vendors and Get Oracle Certifications for FREE
http://www.free-online-exams.com

Problem:    KEWRAFC: Flush slave failed, AWR Enqueue Timeout In *_mmon_*.trc

Symptoms:

In *_mmon_*.trc found many messages like *** KEWRAFC: Flush slave failed, AWR Enqueue Timeout

The issue appears when deleting from WRI$_OPTSTAT_HISTHEAD_HISTORY. 12 GB of Undo tablespace was not sufficient for this many records. 

Log files:

>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=15
System State dumped to trace file /u01/ptyt/ptytdb/10.2.0/admin/PTYT2_jebudb02/bdump/ptyt2_mmon_16780.trc
Wed Mar 24 04:02:42 2010
WARNING: inbound connection timed out (ORA-3136)
Wed Mar 24 04:02:42 2010
WARNING: inbound connection timed out (ORA-3136)
Wed Mar 24 04:02:42 2010
WARNING: inbound connection timed out (ORA-3136)
Wed Mar 24 05:33:23 2010

Ioctl ASYNC_CONFIG error, errno = 1
*** 2010-03-24 00:00:31.019
*** SERVICE NAME:(SYS$BACKGROUND) 2010-03-24 00:00:31.019
*** SESSION ID:(385.1) 2010-03-24 00:00:31.019
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:01:31.206
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:02:31.434
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:03:31.581
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:04:31.768
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:05:31.925
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:06:32.568
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:07:32.125
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:08:32.259
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:09:32.396
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:10:32.684
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout
*** 2010-03-24 00:11:32.850
*** KEWRAFC: Flush slave failed, AWR Enqueue Timeout

Solution:

1> Take backup of table SYS.SYS$SERVICE_METRICS
2> TRUNCATE TABLE SYS.SYS$SERVICE_METRICS
3> Monitor the trace files 

References:

Note 730760.1 - KEWRAFC: Flush slave failed, AWR Enqueue Timeout,Deadlock between M000 and M001 

Note 560204.1 - MMON TRACE SHOWS KEWRAFC: FLUSH SLAVE FAILED, AWR ENQUEUE TIMEOUT 

Get Oracle Certifications for all Exams
Free Online Exams.com