Issue 7401 - OpenLDAP 2.4.32 - deadlock issues
Summary: OpenLDAP 2.4.32 - deadlock issues
Status: VERIFIED FIXED
Alias: None
Product: OpenLDAP
Classification: Unclassified
Component: slapd (show other issues)
Version: 2.4.32
Hardware: All All
: --- normal
Target Milestone: ---
Assignee: OpenLDAP project
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-09-25 14:21 UTC by vb4607@att.com
Modified: 2017-04-13 15:20 UTC (History)
0 users

See Also:


Attachments
logtrace.txt (16.77 KB, text/plain)
2012-09-25 15:12 UTC, vb4607@att.com
Details
dbstat+pstack.zip (4.30 MB, application/x-zip-compressed)
2012-09-25 14:45 UTC, vb4607@att.com
Details

Note You need to log in before you can comment on or make changes to this issue.
Description vb4607@att.com 2012-09-25 14:21:08 UTC
Full_Name: Venkatesh Baglodi
Version: 2.4.32
OS: Red Hat Enterprise Linux Server release 5.5
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (144.160.226.53)


We have been facing occasional deadlock issues when using OpenLDAP in
multi-master mode (4 servers). It looks like deadlocks are occuring on
objectClass index (eq). We have been using OpenLDAP 2.4.32 with hdb backend
(BerkelyDB v5.3.21) on Red Hat Enterprise Linux Server release 5.5 (Tikanga). We
tried to upload the DB stat reports on ftp.openldap.org/incoming/, but looks
like the server is out of disk space. Some of the traces are provided below:

db_stat -CA
===========
Default locking region information:
254     Last allocated locker ID
0x7fffffff      Current maximum unused locker ID
9       Number of lock modes
2400    Initial number of locks allocated
0       Initial number of lockers allocated
2400    Initial number of lock objects allocated
0       Maximum number of locks possible
0       Maximum number of lockers possible
0       Maximum number of lock objects possible
2400    Current number of locks allocated
188     Current number of lockers allocated
2400    Current number of lock objects allocated
480     Number of lock object partitions
4099    Size of object hash table
91      Number of current locks
7765    Maximum number of locks at any one time
88      Maximum number of locks in any one bucket
248550  Maximum number of locks stolen by for an empty partition
665     Maximum number of locks stolen for any one partition
79      Number of current lockers
185     Maximum number of lockers at any one time
33      Number of current lock objects
1779    Maximum number of lock objects at any one time
4       Maximum number of lock objects in any one bucket
15      Maximum number of objects stolen by for an empty partition
2       Maximum number of objects stolen for any one partition
1175M   Total number of locks requested (1175730771)
1174M   Total number of locks released (1174938911)
0       Total number of locks upgraded
163     Total number of locks downgraded
1058324 Lock requests not available due to conflicts, for which we waited
459038  Lock requests not available due to conflicts, for which we did not wait
84153   Number of deadlocks
0       Lock timeout value
0       Number of locks that have timed out
0       Transaction timeout value
0       Number of transactions that have timed out
3MB 336KB       Region size
5804758 The number of partition locks that required waiting (0%)
50948   The maximum number of times any partition lock was waited for (0%)
701     The number of object queue operations that required waiting (0%)
1703227 The number of locker allocations that required waiting (0%)
243743  The number of region locks that required waiting (0%)
5       Maximum hash bucket length
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Lock REGINFO information:
Environment     Region type
1       Region ID
/opt/app/aft/scldldap/var/data/o=scld,dc=att,dc=com/__db.001    Region name
0x2b9be30d3000  Region address
0x2b9be30d30a0  Region allocation head
0x2b9be32d35b0  Region primary address
0       Region maximum allocation
0       Region allocated
Region allocations: 30466493 allocations, 0 failures, 30465357 frees, 10
longest
Allocations by power-of-two sizes:
  1KB   30466479
  2KB   3
  4KB   4
  8KB   3
 16KB   0
 32KB   0
 64KB   1
128KB   1
256KB   0
512KB   1
1024KB  1
REGION_SHARED   Region flags
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Lock region parameters:
2       Lock region region mutex [243743/281M 0% 27451/47948529212608] <wakeups
0/15779>
257     locker table size
4099    object table size
2099280 obj_off
2567960 locker_off
0       need_dd
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Lock conflict matrix:
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Locks grouped by lockers:
Locker   Mode      Count Status  ----------------- Object ---------------
81b47648 dd=43 locks held 0    write locks 0    pid/thread 27448/1165564224
flags 0    priority 100
81b47648 READ          1 WAIT    objectClass.bdb           page          3
81b3bf98 dd=67 locks held 0    write locks 0    pid/thread 27448/1106815296
flags 0    priority 100
81b3bf98 READ          1 WAIT    objectClass.bdb           page          3
81b84f43 dd=10 locks held 0    write locks 0    pid/thread 27448/1425738048
flags 0    priority 100
81b84f43 READ          1 WAIT    objectClass.bdb           page          3
81b3c4be dd=57 locks held 0    write locks 0    pid/thread 27448/1140386112
flags 0    priority 100
81b3c4be READ          1 WAIT    objectClass.bdb           page          3
81b84f46 dd= 9 locks held 0    write locks 0    pid/thread 27448/1434130752
flags 0    priority 100
81b84f46 READ          1 WAIT    objectClass.bdb           page          3
81b84f49 dd= 8 locks held 0    write locks 0    pid/thread 27448/1442523456
flags 0    priority 100
81b84f49 READ          1 WAIT    objectClass.bdb           page          3
81b71512 dd=38 locks held 0    write locks 0    pid/thread 27448/1190742336
flags 0    priority 100
81b71512 READ          1 WAIT    objectClass.bdb           page          3
81b71515 dd=37 locks held 0    write locks 0    pid/thread 27448/1199135040
flags 0    priority 100
81b71515 READ          1 WAIT    objectClass.bdb           page          3
81b71518 dd=36 locks held 0    write locks 0    pid/thread 27448/1207527744
flags 0    priority 100
81b71518 READ          1 WAIT    objectClass.bdb           page          3
81b84f52 dd= 7 locks held 0    write locks 0    pid/thread 27448/1450916160
flags 0    priority 100
81b84f52 READ          1 WAIT    objectClass.bdb           page          3
81b84f55 dd= 6 locks held 0    write locks 0    pid/thread 27448/1459308864
flags 0    priority 100
81b84f55 READ          1 WAIT    objectClass.bdb           page          3
81b7151d dd=35 locks held 0    write locks 0    pid/thread 27448/1215920448
flags 0    priority 100
81b7151d READ          1 WAIT    objectClass.bdb           page          3
81b84f58 dd= 5 locks held 0    write locks 0    pid/thread 27448/1467701568
flags 0    priority 100
81b84f58 READ          1 WAIT    objectClass.bdb           page          3
81b71520 dd=34 locks held 0    write locks 0    pid/thread 27448/1224313152
flags 0    priority 100
81b71520 READ          1 WAIT    objectClass.bdb           page          3
81b71521 dd=33 locks held 1    write locks 1    pid/thread 27448/1232705856
flags 0    priority 100
81b71521 WRITE         1 HELD    objectClass.bdb           page          3
81b84f5b dd= 4 locks held 0    write locks 0    pid/thread 27448/1476094272
flags 0    priority 100
81b84f5b READ          1 WAIT    objectClass.bdb           page          3
81b3c4d5 dd=56 locks held 0    write locks 0    pid/thread 27448/1148778816
flags 0    priority 100
81b3c4d5 READ          1 WAIT    objectClass.bdb           page          3
81b71524 dd=32 locks held 0    write locks 0    pid/thread 27448/1241098560
flags 0    priority 100
81b71524 READ          1 WAIT    objectClass.bdb           page          3
81b84f5e dd= 3 locks held 0    write locks 0    pid/thread 27448/1484486976
flags 0    priority 100
81b84f5e READ          1 WAIT    objectClass.bdb           page          3
81b84f5f dd= 2 locks held 0    write locks 0    pid/thread 27448/1492879680
flags 0    priority 100
81b84f5f READ          1 WAIT    objectClass.bdb           page          3
81b71529 dd=31 locks held 0    write locks 0    pid/thread 27448/1249491264
flags 0    priority 100
81b71529 READ          1 WAIT    objectClass.bdb           page          3
81b7152a dd=30 locks held 0    write locks 0    pid/thread 27448/1257883968
flags 0    priority 100
81b7152a READ          1 WAIT    objectClass.bdb           page          3
81b7152d dd=29 locks held 0    write locks 0    pid/thread 27448/1266276672
flags 0    priority 100
81b7152d READ          1 WAIT    objectClass.bdb           page          3
81b71530 dd=28 locks held 0    write locks 0    pid/thread 27448/1274669376
flags 0    priority 100
81b71530 READ          1 WAIT    objectClass.bdb           page          3
81b71533 dd=27 locks held 0    write locks 0    pid/thread 27448/1283062080
flags 0    priority 100
81b71533 READ          1 WAIT    objectClass.bdb           page          3
81b71536 dd=26 locks held 0    write locks 0    pid/thread 27448/1291454784
flags 0    priority 100
81b71536 READ          1 WAIT    objectClass.bdb           page          3
81b3c0e5 dd=66 locks held 0    write locks 0    pid/thread 27448/1115208000
flags 0    priority 100
81b3c0e5 READ          1 WAIT    objectClass.bdb           page          3
81b71539 dd=25 locks held 0    write locks 0    pid/thread 27448/1299847488
flags 0    priority 100
81b7153c dd=24 locks held 0    write locks 0    pid/thread 27448/1308240192
flags 0    priority 100
81b7153c READ          1 WAIT    objectClass.bdb           page          3
81b7153f dd=23 locks held 0    write locks 0    pid/thread 27448/1316632896
flags 0    priority 100
81b7153f READ          1 WAIT    objectClass.bdb           page          3
81b55581 dd=42 locks held 0    write locks 0    pid/thread 27448/1173956928
flags 0    priority 100
81b55581 READ          1 WAIT    objectClass.bdb           page          3
81b71542 dd=22 locks held 0    write locks 0    pid/thread 27448/1325025600
flags 0    priority 100
81b71542 READ          1 WAIT    objectClass.bdb           page          3
81b71545 dd=21 locks held 0    write locks 0    pid/thread 27448/1333418304
flags 0    priority 100
81b71545 READ          1 WAIT    objectClass.bdb           page          3
81b71548 dd=20 locks held 0    write locks 0    pid/thread 27448/1341811008
flags 0    priority 100
81b71548 READ          1 WAIT    objectClass.bdb           page          3
81b3ca00 dd=55 locks held 0    write locks 0    pid/thread 27448/1157171520
flags 0    priority 100
81b3ca00 READ          1 WAIT    objectClass.bdb           page          3
81b7154b dd=19 locks held 0    write locks 0    pid/thread 27448/1350203712
flags 0    priority 100
81b7154b READ          1 WAIT    objectClass.bdb           page          3
81b7154e dd=18 locks held 0    write locks 0    pid/thread 27448/1358596416
flags 0    priority 100
81b7154e READ          1 WAIT    objectClass.bdb           page          3
81b71551 dd=17 locks held 0    write locks 0    pid/thread 27448/1366989120
flags 0    priority 100
81b71551 READ          1 WAIT    objectClass.bdb           page          3
81b71554 dd=16 locks held 0    write locks 0    pid/thread 27448/1375381824
flags 0    priority 100
81b71554 READ          1 WAIT    objectClass.bdb           page          3
81b71559 dd=15 locks held 0    write locks 0    pid/thread 27448/1383774528
flags 0    priority 100
81b71559 READ          1 WAIT    objectClass.bdb           page          3
81c57cb3 dd= 0 locks held 2    write locks 0    pid/thread 27448/1232705856
flags 0    priority 100
81c57cb3 READ          1 HELD    0x27a480 len:   9 data: 718c00000000000000
81c57cb3 READ          1 HELD    0x283700 len:   9 data: 90bd05000000000000
81b7155a dd=14 locks held 0    write locks 0    pid/thread 27448/1392167232
flags 0    priority 100
81b7155a READ          1 WAIT    objectClass.bdb           page          3
81c57cb4 dd= 0 locks held 16   write locks 8    pid/thread 27448/1232705856
flags 0    priority 100
81c57cb4 READ          1 WAIT    objectClass.bdb           page          3
81c57cb4 WRITE         2 HELD    objectClass.bdb           page        129
81c57cb4 READ          2 HELD    objectClass.bdb           page        129
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page       1453
81c57cb4 READ          2 HELD    scRouteOffer.bdb          page       1453
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page       2462
81c57cb4 READ          2 HELD    scRouteOffer.bdb          page       2462
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page       2242
81c57cb4 READ          2 HELD    scRouteOffer.bdb          page       2242
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page         14
81c57cb4 READ          2 HELD    scRouteOffer.bdb          page         14
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page         12
81c57cb4 READ          2 HELD    scRouteOffer.bdb          page         12
81c57cb4 WRITE         2 HELD    dn2id.bdb                 page       8834
81c57cb4 WRITE         2 HELD    dn2id.bdb                 page       2281
81c57cb4 READ          1 HELD    dn2id.bdb                 page       2281
81c57cb4 READ          2 HELD    dn2id.bdb                 page       8834
81b7155d dd=13 locks held 0    write locks 0    pid/thread 27448/1400559936
flags 0    priority 100
81b7155d READ          1 WAIT    objectClass.bdb           page          3
81b71560 dd=12 locks held 0    write locks 0    pid/thread 27448/1408952640
flags 0    priority 100
81b71560 READ          1 WAIT    objectClass.bdb           page          3
81b71563 dd=11 locks held 0    write locks 0    pid/thread 27448/1417345344
flags 0    priority 100
81b71563 READ          1 WAIT    objectClass.bdb           page          3
81b557ba dd=41 locks held 0    write locks 0    pid/thread 27448/1182349632
flags 0    priority 100
81b557ba READ          1 WAIT    objectClass.bdb           page          3
81b3cd43 dd=54 locks held 0    write locks 0    pid/thread 27448/1086777664
flags 0    priority 100
81b3cd43 READ          1 WAIT    objectClass.bdb           page          3
81b3bf42 dd=73 locks held 0    write locks 0    pid/thread 27448/47802396722192
flags 0    priority 100
81b3bf43 dd=72 locks held 0    write locks 0    pid/thread 27448/47802396722192
flags 0    priority 100
81b3bf44 dd=71 locks held 0    write locks 0    pid/thread 27448/1123600704
flags 0    priority 100
81b3bf44 READ          1 WAIT    objectClass.bdb           page          3
81c564f7 dd= 1 locks held 2    write locks 0    pid/thread 27448/1299847488
flags 0    priority 100
81c564f7 READ          1 HELD    0x2c5710 len:   9 data: b3c005000000000000
81c564f7 READ          1 HELD    0x28fb78 len:   9 data: 92ce05000000000000
81c564f8 dd= 1 locks held 4    write locks 2    pid/thread 27448/1299847488
flags 0    priority 100
81c564f8 READ          1 WAIT    objectClass.bdb           page          3
81c564f8 WRITE         2 HELD    dn2id.bdb                 page       7794
81c564f8 READ          1 HELD    dn2id.bdb                 page       7794
81c564f8 WRITE         2 HELD    dn2id.bdb                 page       9612
81c564f8 READ          1 HELD    dn2id.bdb                 page       9612
81b3bf69 dd=68 locks held 0    write locks 0    pid/thread 27448/1131993408
flags 0    priority 100
81b3bf69 READ          1 WAIT    objectClass.bdb           page          3
      e3 dd=76 locks held 1    write locks 0    pid/thread 27448/47802396722192
flags 10   priority 100
      e3 READ          1 HELD    id2entry.bdb              handle        0
      e4 dd=75 locks held 1    write locks 0    pid/thread 27448/47802396722192
flags 10   priority 100
      e4 READ          1 HELD    dn2id.bdb                 handle        0
      e5 dd=74 locks held 0    write locks 0    pid/thread 27448/47802396722192
flags 0    priority 100
      e6 dd=70 locks held 1    write locks 0    pid/thread 27448/1123600704
flags 10   priority 100
      e6 READ          1 HELD    entryUUID.bdb             handle        0
      e7 dd=69 locks held 1    write locks 0    pid/thread 27448/1123600704
flags 10   priority 100
      e7 READ          1 HELD    entryCSN.bdb              handle        0
      e8 dd=65 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      e8 READ          1 HELD    scRouteOffer.bdb          handle        0
      e9 dd=64 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      e9 READ          1 HELD    objectClass.bdb           handle        0
      ea dd=63 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      ea READ          1 HELD    scHostAddress.bdb         handle        0
      eb dd=62 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      eb READ          1 HELD    scListenPort.bdb          handle        0
      ec dd=61 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      ec READ          1 HELD    scLRMDN.bdb               handle        0
      ed dd=60 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      ed READ          1 HELD    scPID.bdb                 handle        0
      ee dd=59 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      ee READ          1 HELD    scContainerInstanceName.bdb handle        0
      ef dd=58 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      ef READ          1 HELD    scPatchVersion.bdb        handle        0
      f0 dd=53 locks held 1    write locks 0    pid/thread 27448/1086777664
flags 10   priority 100
      f0 READ          1 HELD    scContainerInstanceDN.bdb handle        0
      f1 dd=52 locks held 0    write locks 0    pid/thread 27448/1115208000
flags 0    priority 100
      f2 dd=51 locks held 0    write locks 0    pid/thread 27448/1157171520
flags 0    priority 100
      f3 dd=50 locks held 0    write locks 0    pid/thread 27448/1224313152
flags 0    priority 100
      f4 dd=49 locks held 0    write locks 0    pid/thread 27448/1182349632
flags 0    priority 100
      f5 dd=48 locks held 0    write locks 0    pid/thread 27448/1131993408
flags 0    priority 100
      f6 dd=47 locks held 0    write locks 0    pid/thread 27448/1131993408
flags 0    priority 100
      f7 dd=46 locks held 1    write locks 0    pid/thread 27448/1157171520
flags 10   priority 100
      f7 READ          1 HELD    scManagedResourceName.bdb handle        0
      f8 dd=45 locks held 1    write locks 0    pid/thread 27448/1123600704
flags 10   priority 100
      f8 READ          1 HELD    scServiceDefinitionName.bdb handle        0
      f9 dd=44 locks held 1    write locks 0    pid/thread 27448/1148778816
flags 10   priority 100
      f9 READ          1 HELD    scContainerDefinitionName.bdb handle        0
      fa dd=40 locks held 1    write locks 0    pid/thread 27448/1131993408
flags 10   priority 100
      fa READ          1 HELD    scServiceVersionDefinitionName.bdb handle      
 0
      fb dd=39 locks held 1    write locks 0    pid/thread 27448/1157171520
flags 10   priority 100
      fb READ          1 HELD    scContainerVersionDefinitionName.bdb handle    
   0
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Locks grouped by object:
Locker   Mode      Count Status  ----------------- Object ---------------
      ee READ          1 HELD    scContainerInstanceName.bdb handle        0

81c564f7 READ          1 HELD    0x28fb78 len:   9 data: 92ce05000000000000

      ea READ          1 HELD    scHostAddress.bdb         handle        0

81c57cb3 READ          1 HELD    0x27a480 len:   9 data: 718c00000000000000

81c564f8 READ          1 HELD    dn2id.bdb                 page       9612
81c564f8 WRITE         2 HELD    dn2id.bdb                 page       9612

      e7 READ          1 HELD    entryCSN.bdb              handle        0

81c57cb4 READ          2 HELD    objectClass.bdb           page        129
81c57cb4 WRITE         2 HELD    objectClass.bdb           page        129

      f9 READ          1 HELD    scContainerDefinitionName.bdb handle        0

      ed READ          1 HELD    scPID.bdb                 handle        0

      e9 READ          1 HELD    objectClass.bdb           handle        0

81b71521 WRITE         1 HELD    objectClass.bdb           page          3
81c564f8 READ          1 WAIT    objectClass.bdb           page          3
81b3c4d5 READ          1 WAIT    objectClass.bdb           page          3
81b84f49 READ          1 WAIT    objectClass.bdb           page          3
81b7154b READ          1 WAIT    objectClass.bdb           page          3
81b71560 READ          1 WAIT    objectClass.bdb           page          3
81b7155d READ          1 WAIT    objectClass.bdb           page          3
81b3c4be READ          1 WAIT    objectClass.bdb           page          3
81b557ba READ          1 WAIT    objectClass.bdb           page          3
81b84f46 READ          1 WAIT    objectClass.bdb           page          3
81b7153f READ          1 WAIT    objectClass.bdb           page          3
81b71518 READ          1 WAIT    objectClass.bdb           page          3
81b71536 READ          1 WAIT    objectClass.bdb           page          3
81b71542 READ          1 WAIT    objectClass.bdb           page          3
81b71533 READ          1 WAIT    objectClass.bdb           page          3
81b71548 READ          1 WAIT    objectClass.bdb           page          3
81b3cd43 READ          1 WAIT    objectClass.bdb           page          3
81b7152d READ          1 WAIT    objectClass.bdb           page          3
81b71559 READ          1 WAIT    objectClass.bdb           page          3
81b84f52 READ          1 WAIT    objectClass.bdb           page          3
81b3c0e5 READ          1 WAIT    objectClass.bdb           page          3
81b71545 READ          1 WAIT    objectClass.bdb           page          3
81b3bf69 READ          1 WAIT    objectClass.bdb           page          3
81b84f43 READ          1 WAIT    objectClass.bdb           page          3
81b47648 READ          1 WAIT    objectClass.bdb           page          3
81b71520 READ          1 WAIT    objectClass.bdb           page          3
81b3bf98 READ          1 WAIT    objectClass.bdb           page          3
81b3ca00 READ          1 WAIT    objectClass.bdb           page          3
81b84f5e READ          1 WAIT    objectClass.bdb           page          3
81b7154e READ          1 WAIT    objectClass.bdb           page          3
81b84f5f READ          1 WAIT    objectClass.bdb           page          3
81b7151d READ          1 WAIT    objectClass.bdb           page          3
81b71530 READ          1 WAIT    objectClass.bdb           page          3
81b7152a READ          1 WAIT    objectClass.bdb           page          3
81b84f55 READ          1 WAIT    objectClass.bdb           page          3
81b7155a READ          1 WAIT    objectClass.bdb           page          3
81b71551 READ          1 WAIT    objectClass.bdb           page          3
81b7153c READ          1 WAIT    objectClass.bdb           page          3
81b71554 READ          1 WAIT    objectClass.bdb           page          3
81b55581 READ          1 WAIT    objectClass.bdb           page          3
81b71563 READ          1 WAIT    objectClass.bdb           page          3
81b84f58 READ          1 WAIT    objectClass.bdb           page          3
81b71515 READ          1 WAIT    objectClass.bdb           page          3
81b3bf44 READ          1 WAIT    objectClass.bdb           page          3
81b71529 READ          1 WAIT    objectClass.bdb           page          3
81b84f5b READ          1 WAIT    objectClass.bdb           page          3
81b71524 READ          1 WAIT    objectClass.bdb           page          3
81b71512 READ          1 WAIT    objectClass.bdb           page          3
81c57cb4 READ          1 WAIT    objectClass.bdb           page          3

      e6 READ          1 HELD    entryUUID.bdb             handle        0

81c57cb4 READ          1 HELD    dn2id.bdb                 page       2281
81c57cb4 WRITE         2 HELD    dn2id.bdb                 page       2281

      f7 READ          1 HELD    scManagedResourceName.bdb handle        0

81c57cb3 READ          1 HELD    0x283700 len:   9 data: 90bd05000000000000

      ec READ          1 HELD    scLRMDN.bdb               handle        0

      fa READ          1 HELD    scServiceVersionDefinitionName.bdb handle      
 0

81c57cb4 READ          2 HELD    scRouteOffer.bdb          page       2462
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page       2462

81c564f8 READ          1 HELD    dn2id.bdb                 page       7794
81c564f8 WRITE         2 HELD    dn2id.bdb                 page       7794

81c57cb4 READ          2 HELD    scRouteOffer.bdb          page       2242
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page       2242

      f8 READ          1 HELD    scServiceDefinitionName.bdb handle        0

      fb READ          1 HELD    scContainerVersionDefinitionName.bdb handle    
   0

81c57cb4 READ          2 HELD    dn2id.bdb                 page       8834
81c57cb4 WRITE         2 HELD    dn2id.bdb                 page       8834

81c57cb4 READ          2 HELD    scRouteOffer.bdb          page       1453
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page       1453

81c564f7 READ          1 HELD    0x2c5710 len:   9 data: b3c005000000000000

      e4 READ          1 HELD    dn2id.bdb                 handle        0

      e3 READ          1 HELD    id2entry.bdb              handle        0

      ef READ          1 HELD    scPatchVersion.bdb        handle        0

      eb READ          1 HELD    scListenPort.bdb          handle        0

      e8 READ          1 HELD    scRouteOffer.bdb          handle        0

81c57cb4 READ          2 HELD    scRouteOffer.bdb          page         12
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page         12

81c57cb4 READ          2 HELD    scRouteOffer.bdb          page         14
81c57cb4 WRITE         2 HELD    scRouteOffer.bdb          page         14

      f0 READ          1 HELD    scContainerInstanceDN.bdb handle        0

db_stat -t
==========

23078/6225330   File/offset for last checkpoint LSN
Tue Sep 25 00:41:24 2012        Checkpoint timestamp
0x81c57cb4      Last transaction ID allocated
144     Maximum number of active transactions configured
0       Initial number of transactions configured
54      Active transactions
146     Maximum active transactions
29M     Number of transactions begun (29719732)
170765  Number of transactions aborted
29M     Number of transactions committed (29548913)
0       Snapshot transactions
0       Maximum snapshot transactions
0       Number of transactions restored
3MB 336KB       Region size
243743  The number of region locks that required waiting (0%)
Active transactions:
        81b3bf42: running; xa_status xa idle; pid/thread 27448/47802396722192;
begin LSN: file/offset 0/0; priority: 0
        81b3bf43: running; xa_status xa idle; pid/thread 27448/47802396722192;
begin LSN: file/offset 0/0; priority: 0
        81b3bf44: running; xa_status xa idle; pid/thread 27448/1123600704; begin
LSN: file/offset 0/0; priority: 0
        81b3bf69: running; xa_status xa idle; pid/thread 27448/1131993408; begin
LSN: file/offset 0/0; priority: 0
        81b3bf98: running; xa_status xa idle; pid/thread 27448/1106815296; begin
LSN: file/offset 0/0; priority: 0
        81b3c0e5: running; xa_status xa idle; pid/thread 27448/1115208000; begin
LSN: file/offset 0/0; priority: 0
        81b3c4be: running; xa_status xa idle; pid/thread 27448/1140386112; begin
LSN: file/offset 0/0; priority: 0
        81b3c4d5: running; xa_status xa idle; pid/thread 27448/1148778816; begin
LSN: file/offset 0/0; priority: 0
        81b3ca00: running; xa_status xa idle; pid/thread 27448/1157171520; begin
LSN: file/offset 0/0; priority: 0
        81b3cd43: running; xa_status xa idle; pid/thread 27448/1086777664; begin
LSN: file/offset 0/0; priority: 0
        81b47648: running; xa_status xa idle; pid/thread 27448/1165564224; begin
LSN: file/offset 0/0; priority: 0
        81b55581: running; xa_status xa idle; pid/thread 27448/1173956928; begin
LSN: file/offset 0/0; priority: 0
        81b557ba: running; xa_status xa idle; pid/thread 27448/1182349632; begin
LSN: file/offset 0/0; priority: 0
        81b71512: running; xa_status xa idle; pid/thread 27448/1190742336; begin
LSN: file/offset 0/0; priority: 0
        81b71515: running; xa_status xa idle; pid/thread 27448/1199135040; begin
LSN: file/offset 0/0; priority: 0
        81b71518: running; xa_status xa idle; pid/thread 27448/1207527744; begin
LSN: file/offset 0/0; priority: 0
        81b7151d: running; xa_status xa idle; pid/thread 27448/1215920448; begin
LSN: file/offset 0/0; priority: 0
        81b71520: running; xa_status xa idle; pid/thread 27448/1224313152; begin
LSN: file/offset 0/0; priority: 0
        81b71521: running; xa_status xa idle; pid/thread 27448/1232705856; begin
LSN: file/offset 23077/7253030; priority: 0
        81b71524: running; xa_status xa idle; pid/thread 27448/1241098560; begin
LSN: file/offset 0/0; priority: 0
        81b71529: running; xa_status xa idle; pid/thread 27448/1249491264; begin
LSN: file/offset 0/0; priority: 0
        81b7152a: running; xa_status xa idle; pid/thread 27448/1257883968; begin
LSN: file/offset 0/0; priority: 0
        81b7152d: running; xa_status xa idle; pid/thread 27448/1266276672; begin
LSN: file/offset 0/0; priority: 0
        81b71530: running; xa_status xa idle; pid/thread 27448/1274669376; begin
LSN: file/offset 0/0; priority: 0
        81b71533: running; xa_status xa idle; pid/thread 27448/1283062080; begin
LSN: file/offset 0/0; priority: 0
        81b71536: running; xa_status xa idle; pid/thread 27448/1291454784; begin
LSN: file/offset 0/0; priority: 0
        81b71539: running; xa_status xa idle; pid/thread 27448/1299847488; begin
LSN: file/offset 0/0; priority: 0
        81b7153c: running; xa_status xa idle; pid/thread 27448/1308240192; begin
LSN: file/offset 0/0; priority: 0
        81b7153f: running; xa_status xa idle; pid/thread 27448/1316632896; begin
LSN: file/offset 0/0; priority: 0
        81b71542: running; xa_status xa idle; pid/thread 27448/1325025600; begin
LSN: file/offset 0/0; priority: 0
        81b71545: running; xa_status xa idle; pid/thread 27448/1333418304; begin
LSN: file/offset 0/0; priority: 0
        81b71548: running; xa_status xa idle; pid/thread 27448/1341811008; begin
LSN: file/offset 0/0; priority: 0
        81b7154b: running; xa_status xa idle; pid/thread 27448/1350203712; begin
LSN: file/offset 0/0; priority: 0
        81b7154e: running; xa_status xa idle; pid/thread 27448/1358596416; begin
LSN: file/offset 0/0; priority: 0
        81b71551: running; xa_status xa idle; pid/thread 27448/1366989120; begin
LSN: file/offset 0/0; priority: 0
        81b71554: running; xa_status xa idle; pid/thread 27448/1375381824; begin
LSN: file/offset 0/0; priority: 0
        81b71559: running; xa_status xa idle; pid/thread 27448/1383774528; begin
LSN: file/offset 0/0; priority: 0
        81b7155a: running; xa_status xa idle; pid/thread 27448/1392167232; begin
LSN: file/offset 0/0; priority: 0
        81b7155d: running; xa_status xa idle; pid/thread 27448/1400559936; begin
LSN: file/offset 0/0; priority: 0
        81b71560: running; xa_status xa idle; pid/thread 27448/1408952640; begin
LSN: file/offset 0/0; priority: 0
        81b71563: running; xa_status xa idle; pid/thread 27448/1417345344; begin
LSN: file/offset 0/0; priority: 0
        81b84f43: running; xa_status xa idle; pid/thread 27448/1425738048; begin
LSN: file/offset 0/0; priority: 0
        81b84f46: running; xa_status xa idle; pid/thread 27448/1434130752; begin
LSN: file/offset 0/0; priority: 0
        81b84f49: running; xa_status xa idle; pid/thread 27448/1442523456; begin
LSN: file/offset 0/0; priority: 0
        81b84f52: running; xa_status xa idle; pid/thread 27448/1450916160; begin
LSN: file/offset 0/0; priority: 0
        81b84f55: running; xa_status xa idle; pid/thread 27448/1459308864; begin
LSN: file/offset 0/0; priority: 0
        81b84f58: running; xa_status xa idle; pid/thread 27448/1467701568; begin
LSN: file/offset 0/0; priority: 0
        81b84f5b: running; xa_status xa idle; pid/thread 27448/1476094272; begin
LSN: file/offset 0/0; priority: 0
        81b84f5e: running; xa_status xa idle; pid/thread 27448/1484486976; begin
LSN: file/offset 0/0; priority: 0
        81b84f5f: running; xa_status xa idle; pid/thread 27448/1492879680; begin
LSN: file/offset 0/0; priority: 0
        81c564f7: running; xa_status xa idle; pid/thread 27448/1299847488; begin
LSN: file/offset 23077/7253106; priority: 0
        81c564f8: running; xa_status xa idle; pid/thread 27448/1299847488; begin
LSN: file/offset 0/0; parent: 81c564f7; priority: 0
        81c57cb3: running; xa_status xa idle; pid/thread 27448/1232705856; begin
LSN: file/offset 23078/6289581; priority: 0
        81c57cb4: running; xa_status xa idle; pid/thread 27448/1232705856; begin
LSN: file/offset 0/0; parent: 81c57cb3; priority: 0

pstack trace:
=============

Thread 50 (Thread 0x41789940 (LWP 27463)):
#0  0x00000038c7ad4358 in epoll_wait () from /lib64/libc.so.6
#1  0x000000000043a8c4 in ?? ()
#2  0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#3  0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 49 (Thread 0x41f8a940 (LWP 27464)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 48 (Thread 0x4278b940 (LWP 27465)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 47 (Thread 0x42f8c940 (LWP 27466)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 46 (Thread 0x4378d940 (LWP 27467)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 45 (Thread 0x43f8e940 (LWP 27512)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 44 (Thread 0x4478f940 (LWP 27513)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 43 (Thread 0x44f90940 (LWP 27599)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 42 (Thread 0x40c6e940 (LWP 27656)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 41 (Thread 0x45791940 (LWP 3074)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 40 (Thread 0x45f92940 (LWP 5033)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 39 (Thread 0x46793940 (LWP 5416)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 38 (Thread 0x46f94940 (LWP 10803)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 37 (Thread 0x47795940 (LWP 10804)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 36 (Thread 0x47f96940 (LWP 10805)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 35 (Thread 0x48797940 (LWP 10806)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 34 (Thread 0x48f98940 (LWP 10807)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 33 (Thread 0x49799940 (LWP 10808)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de015813 in hdb_idl_delete_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a4c6 in hdb_key_change () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de009401 in indexer () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de009882 in index_at_values () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de009a13 in hdb_index_values () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de009e98 in hdb_index_entry () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79ddffcd89 in hdb_delete () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf243 in ?? ()
#24 0x00000000004c0d78 in ?? ()
#25 0x00000000004b9c17 in ?? ()
#26 0x00000000004ba51e in ?? ()
#27 0x00000000004f4739 in ?? ()
#28 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#29 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 32 (Thread 0x49f9a940 (LWP 10814)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 31 (Thread 0x4a79b940 (LWP 10818)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 30 (Thread 0x4af9c940 (LWP 10821)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 29 (Thread 0x4b79d940 (LWP 10822)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 28 (Thread 0x4bf9e940 (LWP 10824)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 27 (Thread 0x4c79f940 (LWP 10825)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 26 (Thread 0x4cfa0940 (LWP 10826)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 25 (Thread 0x4d7a1940 (LWP 10827)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de015813 in hdb_idl_delete_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a4c6 in hdb_key_change () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de009401 in indexer () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de009882 in index_at_values () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de009a13 in hdb_index_values () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de009e98 in hdb_index_entry () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79ddffcd89 in hdb_delete () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf243 in ?? ()
#24 0x000000000046139d in fe_op_delete ()
#25 0x0000000000461046 in do_delete ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
...
...

Thread 2 (Thread 0x58fb8940 (LWP 26982)):
#0  0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#2  0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#3  0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#4  0x00002b79dc199b36 in __db_tas_mutex_lock () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#5  0x00002b79dc2909f2 in __lock_get_internal () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#6  0x00002b79dc28e167 in __lock_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#7  0x00002b79dc2d3345 in __db_lget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#8  0x00002b79dc1c6727 in __bam_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#9  0x00002b79dc1ac1b0 in __bamc_search () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#10 0x00002b79dc1a6de1 in __bamc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#11 0x00002b79dc2b57dd in __dbc_iget () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#12 0x00002b79dc2b51dd in __dbc_get () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#13 0x00002b79dc2cd579 in __dbc_get_pp () from
/opt/app/aft/scldldap/lib/libdb-5.3.so
#14 0x00002b79de0141f6 in hdb_idl_fetch_key () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#15 0x00002b79de00a1bd in hdb_key_read () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#16 0x00002b79de00ca5d in equality_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#17 0x00002b79de00b14c in hdb_filter_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#18 0x00002b79de0039a9 in search_aliases () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#19 0x00002b79de006eed in search_candidates () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#20 0x00002b79de005093 in hdb_search () from
/opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2
#21 0x00000000004ceebe in overlay_op_walk ()
#22 0x00000000004cf0c1 in ?? ()
#23 0x00000000004cf18f in ?? ()
#24 0x0000000000442670 in fe_op_search ()
#25 0x0000000000441f4f in do_search ()
#26 0x000000000043e98c in ?? ()
#27 0x000000000043ef11 in ?? ()
#28 0x00000000004f4739 in ?? ()
#29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0
#30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x2b79dce04410 (LWP 27448)):
#0  0x00000038c8207b35 in pthread_join () from /lib64/libpthread.so.0
#1  0x00000000004f5c0b in ldap_pvt_thread_join ()
#2  0x000000000043ba60 in slapd_daemon ()
#3  0x0000000000419bd3 in main ()

Thanks,

Venkatesh
Comment 1 vb4607@att.com 2012-09-25 14:45:26 UTC

    
Comment 2 vb4607@att.com 2012-09-25 15:12:14 UTC
Also, see attached for section of LDAP log file. LDAP instance became unresponsive (hanging) at 00:41:09  until it was restarted at 01:24:33.
Comment 3 Howard Chu 2012-09-25 15:19:27 UTC
vb4607@att.com wrote:
> Full_Name: Venkatesh Baglodi
> Version: 2.4.32
> OS: Red Hat Enterprise Linux Server release 5.5
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (144.160.226.53)
>
>
> We have been facing occasional deadlock issues when using OpenLDAP in
> multi-master mode (4 servers). It looks like deadlocks are occuring on
> objectClass index (eq). We have been using OpenLDAP 2.4.32 with hdb backend
> (BerkelyDB v5.3.21) on Red Hat Enterprise Linux Server release 5.5 (Tikanga). We
> tried to upload the DB stat reports on ftp.openldap.org/incoming/, but looks
> like the server is out of disk space. Some of the traces are provided below:

Your traces look much the same as ITS#7378. However, as noted in followup#4 to 
that report, there's no code path in back-bdb/hdb that can legitimately cause 
this situation. Can you switch to BDB 4.7.25 and still reproduce the problem?

-- 
   -- Howard Chu
   CTO, Symas Corp.           http://www.symas.com
   Director, Highland Sun     http://highlandsun.com/hyc/
   Chief Architect, OpenLDAP  http://www.openldap.org/project/

Comment 4 vb4607@att.com 2012-09-25 16:20:58 UTC
Thank you so much for the quick reply. We are a bit hesitant to try 4.7.25 as it is a 4 year old product. What about version 5.1 (5.1.29) as it is mentioned on your Web site (http://www.openldap.org/software/release/readme.html)?

Sincerely,

Venkatesh

-----Original Message-----
From: Howard Chu [mailto:hyc@symas.com] 
Sent: Tuesday, September 25, 2012 11:19 AM
To: BAGLODI, VENKATESH
Cc: openldap-its@openldap.org
Subject: Re: (ITS#7401) OpenLDAP 2.4.32 - deadlock issues

vb4607@att.com wrote:
> Full_Name: Venkatesh Baglodi
> Version: 2.4.32
> OS: Red Hat Enterprise Linux Server release 5.5
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (144.160.226.53)
>
>
> We have been facing occasional deadlock issues when using OpenLDAP in
> multi-master mode (4 servers). It looks like deadlocks are occuring on
> objectClass index (eq). We have been using OpenLDAP 2.4.32 with hdb backend
> (BerkelyDB v5.3.21) on Red Hat Enterprise Linux Server release 5.5 (Tikanga). We
> tried to upload the DB stat reports on ftp.openldap.org/incoming/, but looks
> like the server is out of disk space. Some of the traces are provided below:

Your traces look much the same as ITS#7378. However, as noted in followup#4 to 
that report, there's no code path in back-bdb/hdb that can legitimately cause 
this situation. Can you switch to BDB 4.7.25 and still reproduce the problem?

-- 
   -- Howard Chu
   CTO, Symas Corp.           http://www.symas.com
   Director, Highland Sun     http://highlandsun.com/hyc/
   Chief Architect, OpenLDAP  http://www.openldap.org/project/

Comment 5 Quanah Gibson-Mount 2012-09-25 17:11:37 UTC
--On Tuesday, September 25, 2012 4:22 PM +0000 vb4607@att.com wrote:

> Thank you so much for the quick reply. We are a bit hesitant to try
> 4.7.25 as it is a 4 year old product. What about version 5.1 (5.1.29) as
> it is mentioned on your Web site
> (http://www.openldap.org/software/release/readme.html)?


I've been using BDB 4.7.25 (+all patches) for several years, and it has 
been quite stable.  No deadlocks.  This version is used on all Zimbra 
deployments across the world, with plenty of customers having millions of 
entry DBs.

--Quanah

--

Quanah Gibson-Mount
Sr. Member of Technical Staff
Zimbra, Inc
A Division of VMware, Inc.
--------------------
Zimbra ::  the leader in open source messaging and collaboration

Comment 6 vb4607@att.com 2012-09-27 21:26:48 UTC
Thanks, Quanah. We will try this version and see how it performs.

Venkatesh

-----Original Message-----
From: Quanah Gibson-Mount [mailto:quanah@zimbra.com] 
Sent: Tuesday, September 25, 2012 1:12 PM
To: BAGLODI, VENKATESH; openldap-its@openldap.org
Subject: RE: (ITS#7401) OpenLDAP 2.4.32 - deadlock issues

--On Tuesday, September 25, 2012 4:22 PM +0000 vb4607@att.com wrote:

> Thank you so much for the quick reply. We are a bit hesitant to try
> 4.7.25 as it is a 4 year old product. What about version 5.1 (5.1.29) as
> it is mentioned on your Web site
> (http://www.openldap.org/software/release/readme.html)?


I've been using BDB 4.7.25 (+all patches) for several years, and it has 
been quite stable.  No deadlocks.  This version is used on all Zimbra 
deployments across the world, with plenty of customers having millions of 
entry DBs.

--Quanah

--

Quanah Gibson-Mount
Sr. Member of Technical Staff
Zimbra, Inc
A Division of VMware, Inc.
--------------------
Zimbra ::  the leader in open source messaging and collaboration

Comment 7 Quanah Gibson-Mount 2017-04-13 15:20:05 UTC
Hello Venkatesh,

There's been no follow up since 2012, so I will be closing this ITS.  I 
assume the issue was resolved by downgrading BDB. If you still encounter 
this issue with the current OpenLDAP release, feel free to follow up and I 
will reopen the ITS.

Regards,
Quanah

--

Quanah Gibson-Mount
Product Architect
Symas Corporation
Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
<http://www.symas.com>


Comment 8 Quanah Gibson-Mount 2017-04-13 15:20:12 UTC
changed state Open to Closed
moved from Incoming to Software Bugs