Thursday, October 20, 2011

Database hung due to WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOC ( AQ) were waiting in event 'cursor: pin S wait on X'

Visit the Below Website to access unlimited exam questions for all IT vendors and Get Oracle Certifications for FREE
http://www.free-online-exams.com
Problem:    Database hung due to WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOC ( AQ) were waiting in event 'cursor: pin S wait on X'

Symptoms:

Log files:
Resource Holder State
Rcache object=c00000022542c578, 143: 143: is waiting for 143:
LOAD: c00000022078ff40 143: 143: is waiting for 143:
Mutex 35d3bf1b 66: 66: is waiting for 143:
Rcache object=c0000001efc3d148, 143: 143: is waiting for 143:
Mutex ade459eb 139: 139: is waiting for 143:
Mutex 74472c7a 143: Self-Deadlock

PROCESS 14:
----------------------------------------
SO: c000000237989aa8, type: 2, owner: 0000000000000000, flag: INIT/-/-/0x00
(process) Oracle pid=14, calls cur/top: c000000237ff5ae8/c000000237ff12d8, flag: (16) SYSTEM
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 33
last post received-location: ksrpublish
last process to post me: c000000238996320 1 6
last post sent: 0 0 24
last post sent-location: ksasnd
last process posted by me: c000000238996320 1 6
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: c000000238b083d0
O/S info: user: oradpp, term: UNKNOWN, ospid: 5038
OSD pid info: Unix process pid: 5038, image: oracle@pdppdb03 (SMON)
...
SO: c0000001febf2368, type: 50, owner: c0000001e5ecffd8, flag: INIT/-/-/0x00
row cache enqueue: count=1 session=c000000238ea91d8 object=c00000022542c578, request=S
savepoint=0x7ba
row cache parent object: address=c00000022542c578 cid=16(dc_histogram_defs)
hash=51637c2e typ=11 transaction=0000000000000000 flags=00008000

PROCESS 143:
----------------------------------------
SO: c0000002389b4750, type: 2, owner: 0000000000000000, flag: INIT/-/-/0x00
(process) Oracle pid=143, calls cur/top: c0000001db00c398/c000000221a3a4e8, flag: (0) -
int error: 17, call error: 0, sess error: 0, txn error 0
(post info) last post received: 17 24 12
last post received-location: ksusig
last process to post me: c00000023799b868 225 0
last post sent: 0 0 24
last post sent-location: ksasnd
last process posted by me: c000000238996320 1 6
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: c000000238b083d0
O/S info: user: oradpp, term: UNKNOWN, ospid: 615
OSD pid info: Unix process pid: 615, image: oraclePDPP1@pdppdb03
...
SO: c0000001fc1a9560, type: 50, owner: c0000001e5bafaf8, flag: INIT/-/-/0x00
row cache enqueue: count=1 session=c000000238eb9ec8 object=c00000022542c578, mode=S
savepoint=0x20161
row cache parent object: address=c00000022542c578 cid=16(dc_histogram_defs)
hash=51637c2e typ=11 transaction=0000000000000000 flags=00008000
own=c00000022542c648[c0000001fc1a9590,c0000001fc1a9590] wat=c00000022542c658[c0000001fc1a9290,c0000002273a2620] mode=S
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0000000000000000 seq=40137 wait_time=0 seconds since wait started=0
idn=74472c7a, value=5ab00000000, where|sleeps=5001115e8
...
KGX Atomic Operation Log c00000020bcca840
Mutex c000000226c64928(1451, 0) idn 74472c7a oper GET_SHRD <<<--request in shared mode
Cursor Pin uid 1451 efd 0 whr 5 slp 5608
opr=2 pso=c0000001e20437b0 flg=0
...
KGX Atomic Operation Log c00000020bcca798
Mutex c000000226c64928(1451, 0) idn 74472c7a oper EXCL <<<--held in exclusive mode
Cursor Pin uid 1451 efd 0 whr 1 slp 0
opr=3 pso=c00000020b6aed58 flg=0
pcs=c000000226c64928 nxt=0000000000000000 flg=35 cld=1 hd=c0000002171ab008 par=c000000226c652e0
ct=1 hsh=0 unp=0000000000000000 unn=0 hvl=26c64c70 nhv=1 ses=c000000238eb9ec8
hep=c000000226c649a8 flg=80 ld=1 ob=c00000021fd6bf40 ptr=c0000001e7ac2fa0 fex=c0000001e7ac22b0
...
SO: c000000210573038, type: 53, owner: c000000238eb60b8, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=c000000210573038 handle=c00000021ec95328 mode=N
call pin=0000000000000000 session pin=0000000000000000 hpc=0000 hlc=0000
htl=c0000002105730b8[c0000001df015c70,c00000021bd80960] htb=c0000001df015c70 ssga=c0000001df0155a8
user=c000000238eb60b8 session=c000000238eb60b8 count=2 flags=[0000] savepoint=0x4bc5a6dc
LIBRARY OBJECT HANDLE: handle=c00000021ec95328 mtx=c00000021ec95458(2) cdp=3
name=
SELECT DECLARATION_CONFIRMATION_ID, DECLARATION_ID, DECLARATION_NO, BILL_ENTRY_NUMBER, PERMANENT_BILL_ENTRY_NO, STATUS_SERIAL, DECLARATION_STATUS, STATUS_CHANGE_REMARKS, SEAL_INDICATOR, MIRSAL_TYPE, MIRSAL_CODE, PROCESSED_STATE, IS_COMPLETE FROM DEC_STG_DECLARATION_CONF WHERE (((IS_COMPLETE = :1) AND (PROCESSED_STATE = :2)) AND (ROWNUM <= :3)) ORDER BY DECLARATION_CONFIRMATION_ID ASC FOR UPDATE NOWAIT
hash=839eeb7583aa006e8259d1ff2143795b timestamp=03-05-2010 02:04:21
namespace=CRSR flags=RON/KGHP/TIM/PN0/MED/KST/DBN/MTX/[500100d0]

Solution:


The problem is a defect in the pw_wait() os system call which is caused by a problem with the 
HP-UX scheduler patch PHKL_37456. 

In os version 11.31 the problem can be cured by installing PHKL_38397 or later equivalent.

There is a known problem with the pw_wait call on HP/UX 11.23, pls see Note 580273.1 and check if
HP patch PHKL_37809 or later equivalent has been installed.

- PHKL_37456 introduced behavior that can cause a thread to
hang in the pw_wait(2) interface. When the behavior occurs,
the thread does not clear out a flag in the kernel sleep 
interface when it detects a pw_post(2) has already happened.
This stale flag setting prevents the timer expiry from 
running the thread.

- This intermittent behavior has been observed as Oracle 
Scheduler and Parallel Query hangs in pw_wait(). The hung 
processes are interruptible, but sit in pw_wait() and do not
run existing or newly scheduled jobs. Once the administrator
restarts the scheduler or runs other tools (like Oracle 
debugging utilities) the process may start working normally 
and run for days to weeks before it hangs again.

- Additional information on this behavior may be found in 
HP Change Request QXCR1000811756.


The bug is fixed in 10.2.0.4 (see Note 401436.1).
Upgrade to 10.2.0.4 or  Apply patch PHKL_37456
References:
Note 580273.1
Bug 7140446: PROCESSES HANG ON 'CURSOR: PIN S WAIT ON X'


Get Oracle Certifications for all Exams
Free Online Exams.com

4 comments:

Anonymous said...

[url=http://officialnflpackers.com/]Aaron Rodgers Authentic Jersey[/url]

Kiser has used only mercury-free substances in his treatments since the mid 90's and concentrates his practice in the areas of sedation dentistry and complete smile makeovers Jewelers should tell your if the pearls are cultured or imitation However, everything in life has a reason and a cause
) Install adware and spyware programs Even though there is no sign of an imminent attack, it is the future where problems and past where answers lie The examination and blood work of both cats, plus four teeth pulled, antibiotics and painkillers set me back over a grand, and that's not including the cardiogram and possible tooth extractions for Ghost that are coming up next week7

[url=http://nikebengalsnflstore.com/]Nike Andy Dalton Jersey[/url]
[url=http://officialnflpackers.com/]Aaron Rodgers Authentic Jersey[/url]

Anonymous said...

No action is involuntary, including your thoughts Of singular note is James' ability to assimilate complex subject matter and produce clean clear 'easy-to-understand' messages4
In brilliancy it exceeds all other green gems excepting only the very rare green sapphire You never have to judge or be right because you know that you cannot make anyone believe in themselves, though you can show them what it looks like Be prepared to state your intentions and to show respect to the guidelines of the list

JJ Watt Women's Jersey
Bears Julius Peppers Jersey

Belief-I'll be wealthy when lady luck smiles on me (Psst I recommend that you leave your printer off for at least one hour before cleaning it of laser tonerThis verse also says that the rider on the black horse, who is the Antichrist, has a pair of scales in his hand

Julio Jones Youth Jersey

Anonymous said...

[url=http://blrp.us/-1][b]sale uggs boots[/b][/url] IWBHEN
[url=http://www.mysmarturl.com/10Z][b]ugg outlet[/b][/url] EOUXPI
[url=http://24h.to/cnl3][b]cheap uggs boots[/b][/url] VCDLZN
[url=http://gentil.me/7r09][b]cheap uggs[/b][/url] KRUYQW
[url=http://zoquo.com/bb][b]ugg boots outlet store[/b][/url] AARCVK

Anonymous said...

Payday loans online http://www.legitpaydayloansonline3.com/ Fundpopog Payday loans online Stype [url=http://www.legitpaydayloansonline3.com/]Payday loans online[/url] payday loans online Check on this before who do have enables so that the borrowers can get the best payday loan.But to be fair to the payday loan, or to although payments pay interest on the loan they've given!!!Sudden car repairs that must be taken care of or else you might lose sit want the money to them notifying them of the repayment date.