Issue 6040 - SEGV - hdb_cache_lru_purge / bdb_cache_delete_internal / ldap_pvt_thread_mutex_lock
Summary: SEGV - hdb_cache_lru_purge / bdb_cache_delete_internal / ldap_pvt_thread_mute...
Status: VERIFIED FIXED
Alias: None
Product: OpenLDAP
Classification: Unclassified
Component: slapd (show other issues)
Version: 2.4.15
Hardware: All All
: --- normal
Target Milestone: ---
Assignee: OpenLDAP project
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-03-27 09:52 UTC by oskar@deckle.co.za
Modified: 2014-08-01 21:04 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this issue.
Description oskar@deckle.co.za 2009-03-27 09:52:19 UTC
Full_Name: Oskar Pearson
Version: 2.4.15
OS: Ubuntu hardy
URL: ftp://ftp.openldap.org/incoming/slapd-configs-qualica-1.tar.gz
Submission from: (NULL) (94.194.140.71)


This is the same machine as ITS #6033. Details included here for easy
reference:
Openldap 2.4.15 (with no patches) was self-compiled with no patches
(CFLAGS="-ggdb3 -O0" ./configure), linked against standard OS libraries (ubuntu
hardy) for BDB etc. BDB is 4.6.21-6ubuntu1. Kernel is 2.6.24-19-server, libc is
libc6-i686/2.7-10ubuntu3.

I do not have a debug log of this crash as it occurred on a live server, which
is too busy for that level of logging. I also do not have a replaceable
example.
I have core dumps and can print out whatever is necessary there - I appreciate
your time and help.

If I've missed some important info, please let me know and I'll rectify asap.

System overview:

We have a master server which replicates to > 100 machines for Samba
purposes
across ADSL lines with a VPN. These lines are quite busy, so replication writes
may be slow across the network, which may have implications for locks.

Config files are included at the url below.

I've realised through looking at the code and config files that I should
probably increase the dncachesize parameter, as the number of DNs in the db is >
2000. This would help reduce the possibility of the bug occurring, but I think
the bug will still exist.

gdb --core=/root/core.26366 servers/slapd/slapd
...
(gdb) bt
#0  0xb7dd3540 in pthread_mutex_lock () from /lib/tls/i686/cmov/libpthread.so.0
#1  0x0817beef in ldap_pvt_thread_mutex_lock (mutex=0x34) at thr_posix.c:296
#2  0x08144215 in bdb_cache_delete_internal (cache=0x82b6df4, e=0x84017d8,
decr=0) at cache.c:1335
#3  0x081430e5 in hdb_cache_lru_purge (bdb=0x82b6db8) at cache.c:749
#4  0x081438ba in hdb_cache_find_id (op=0x86c01d0, tid=0x86d0a30, id=1792,
eip=0x9f6f1e68, flag=2, lock=0x9f6f1e00) at cache.c:1016
#5  0x08115c29 in hdb_search (op=0x86c01d0, rs=0x9f6f3100) at search.c:705
#6  0x080f179a in overlay_op_walk (op=0x86c01d0, rs=0x9f6f3100, which=op_search,
oi=0x82d2b88, on=0x0) at backover.c:669
#7  0x080f19a2 in over_op_func (op=0x86c01d0, rs=0x9f6f3100, which=op_search) at
backover.c:721
#8  0x080f1a46 in over_op_search (op=0x86c01d0, rs=0x9f6f3100) at
backover.c:743
#9  0x080724ed in fe_op_search (op=0x86c01d0, rs=0x9f6f3100) at search.c:366
#10 0x08071e60 in do_search (op=0x86c01d0, rs=0x9f6f3100) at search.c:217
#11 0x0806eb44 in connection_operation (ctx=0x9f6f31f0, arg_v=0x86c01d0) at
connection.c:1133
#12 0x0806f01e in connection_read_thread (ctx=0x9f6f31f0, argv=0x46) at
connection.c:1259
#13 0x0817ad1f in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:663
#14 0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#15 0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6
(gdb) frame 2
#2  0x08144215 in bdb_cache_delete_internal (cache=0x82b6df4, e=0x84017d8,
decr=0) at cache.c:1335
1335            bdb_cache_entryinfo_lock( e->bei_parent );
(gdb) p e->bei_parent
$1 = (struct bdb_entry_info *) 0x0
(gdb) up
#3  0x081430e5 in hdb_cache_lru_purge (bdb=0x82b6db8) at cache.c:749
749                                     bdb_cache_delete_internal(
&bdb->bi_cache, elru, 0 );
(gdb) p *elru
$2 = {bei_parent = 0x0, bei_id = 17, bei_lockpad = 0, bei_state = 0, bei_finders
= 0, bei_nrdn = {bv_len = 24, bv_val = 0x0}, bei_rdn = {bv_len = 24, 
    bv_val = 0x0}, bei_modrdns = 0, bei_ckids = 0, bei_dkids = 0, bei_e = 0x0,
bei_kids = 0x0, bei_kids_mutex = {__data = {__lock = 1, __count = 0, 
      __owner = 28050, __kind = 0, __nusers = 1, {__spins = 0, __list = {__next
= 0x0}}}, 
    __size = "\001\000\000\000\000\000\000\000\222m\000\000\000\000\000\000\001\000\000\000\000\000\000",
__align = 1}, bei_lrunext = 0x83b5e70, 
  bei_lruprev = 0x867b980}
(gdb) p bdb->bi_cache.c_leaves
$3 = 3737
(gdb) p eimax
$4 = 2000
(gdb) p bdb->bi_cache
$5 = {c_eifree = 0x8665b00, c_idtree = 0x9b322498, c_lruhead = 0x84017d8,
c_lrutail = 0x867b980, c_dntree = {bei_parent = 0x0, bei_id = 0, bei_lockpad =
0, 
    bei_state = 128, bei_finders = 0, bei_nrdn = {bv_len = 0, bv_val = 0x0},
bei_rdn = {bv_len = 0, bv_val = 0x0}, bei_modrdns = 0, bei_ckids = 1, 
    bei_dkids = 2, bei_e = 0x8320704, bei_kids = 0x8320248, bei_kids_mutex =
{__data = {__lock = 0, __count = 0, __owner = 0, __kind = 0, __nusers = 0, {
          __spins = 0, __list = {__next = 0x0}}}, __size = '\0' <repeats 23
times>, __align = 0}, bei_lrunext = 0x0, bei_lruprev = 0x0}, c_maxsize = 1000, 
  c_cursize = 117171, c_minfree = 1, c_eimax = 2000, c_eiused = 3740, c_leaves =
3737, c_purging = 1, c_txn = 0x8320188, c_rwlock = {__data = {__lock = 0, 
      __nr_readers = 0, __readers_wakeup = 8985, __writer_wakeup = 9500,
__nr_readers_queued = 0, __nr_writers_queued = 0, __flags = 0 '\0', 
      __shared = 0 '\0', __pad1 = 0 '\0', __pad2 = 0 '\0', __writer = 0}, 
    __size = "\000\000\000\000\000\000\000\000\031#\000\000\034%", '\0' <repeats
17 times>, __align = 0}, c_lru_mutex = {__data = {__lock = 1, __count = 0, 
      __owner = 28050, __kind = 0, __nusers = 1, {__spins = 0, __list = {__next
= 0x0}}}, 
    __size = "\001\000\000\000\000\000\000\000\222m\000\000\000\000\000\000\001\000\000\000\000\000\000",
__align = 1}, c_count_mutex = {__data = {
      __lock = 0, __count = 0, __owner = 0, __kind = 0, __nusers = 0, {__spins =
0, __list = {__next = 0x0}}}, __size = '\0' <repeats 23 times>, 
    __align = 0}, c_eifree_mutex = {__data = {__lock = 0, __count = 0, __owner =
0, __kind = 0, __nusers = 0, {__spins = 0, __list = {__next = 0x0}}}, 
    __size = '\0' <repeats 23 times>, __align = 0}}


If there's anything else you'd like me to print out, please let me know.

thread apply all bt follows:
Thread 10 (process 26366):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd2775 in pthread_join () from /lib/tls/i686/cmov/libpthread.so.0
#2  0x0817be19 in ldap_pvt_thread_join (thread=2730888080, thread_return=0x0) at
thr_posix.c:197
#3  0x0806bca3 in slapd_daemon () at daemon.c:2740
#4  0x0804e8c7 in main (argc=1, argv=0xbfc63124) at main.c:948

Thread 9 (process 26372):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7ba1676 in epoll_wait () from /lib/tls/i686/cmov/libc.so.6
#2  0x0806ae3a in slapd_daemon_task (ptr=0x0) at daemon.c:2366
#3  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#4  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 8 (process 26374):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 7 (process 27916):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 6 (process 28043):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6
Thread 5 (process 28044):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 4 (process 28045):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 3 (process 28046):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 2 (process 28048):
#0  0xb7f18410 in __kernel_vsyscall ()
#1  0xb7dd5aa5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/tls/i686/cmov/libpthread.so.0
#2  0x0817beae in ldap_pvt_thread_cond_wait (cond=0x829cb0c, mutex=0x829caf4) at
thr_posix.c:277
#3  0x0817acac in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:654
#4  0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#5  0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Thread 1 (process 28050):
#0  0xb7dd3540 in pthread_mutex_lock () from /lib/tls/i686/cmov/libpthread.so.0
#1  0x0817beef in ldap_pvt_thread_mutex_lock (mutex=0x34) at thr_posix.c:296
#2  0x08144215 in bdb_cache_delete_internal (cache=0x82b6df4, e=0x84017d8,
decr=0) at cache.c:1335
#3  0x081430e5 in hdb_cache_lru_purge (bdb=0x82b6db8) at cache.c:749
#4  0x081438ba in hdb_cache_find_id (op=0x86c01d0, tid=0x86d0a30, id=1792,
eip=0x9f6f1e68, flag=2, lock=0x9f6f1e00) at cache.c:1016
#5  0x08115c29 in hdb_search (op=0x86c01d0, rs=0x9f6f3100) at search.c:705
#6  0x080f179a in overlay_op_walk (op=0x86c01d0, rs=0x9f6f3100, which=op_search,
oi=0x82d2b88, on=0x0) at backover.c:669
#7  0x080f19a2 in over_op_func (op=0x86c01d0, rs=0x9f6f3100, which=op_search) at
backover.c:721
#8  0x080f1a46 in over_op_search (op=0x86c01d0, rs=0x9f6f3100) at
backover.c:743
#9  0x080724ed in fe_op_search (op=0x86c01d0, rs=0x9f6f3100) at search.c:366
#10 0x08071e60 in do_search (op=0x86c01d0, rs=0x9f6f3100) at search.c:217
#11 0x0806eb44 in connection_operation (ctx=0x9f6f31f0, arg_v=0x86c01d0) at
connection.c:1133
#12 0x0806f01e in connection_read_thread (ctx=0x9f6f31f0, argv=0x46) at
connection.c:1259
#13 0x0817ad1f in ldap_int_thread_pool_wrapper (xpool=0x829caf0) at tpool.c:663
#14 0xb7dd14fb in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
#15 0xb7ba0e5e in clone () from /lib/tls/i686/cmov/libc.so.6

Comment 1 Howard Chu 2009-03-27 10:11:18 UTC
Please use RE24 instead of 2.4.15 and followup with your results.
Comment 2 Howard Chu 2009-03-27 10:14:06 UTC
changed state Open to Feedback
Comment 3 oskar@deckle.co.za 2009-04-28 14:25:12 UTC
Hi

We're still unfortunately stuck on 2.4.15 pending various  
changecontrols on our side.

I have a work-around, however for 2.4.15 - in case anyone ever reads  
this ticket and has further problems.

By dramatically increasing the cachesize and idlcachesize entries in  
the relevant hdb database section, the cache is walked less often, and  
cleaned out less often. This reduces the number of times the problem  
could occur, which seems to have reduced the incidence from around 4*  
a day down to zero times in the last 20 days.

We are using cachesize of 20000 and idlsize of 60000. This increases  
memory size, but gives us stability.

Thanks,

Oskar



On 27 Mar 2009, at 09:52, openldap-its@OpenLDAP.org wrote:

>
> *** THIS IS AN AUTOMATICALLY GENERATED REPLY ***
>
> Thanks for your report to the OpenLDAP Issue Tracking System.  Your
> report has been assigned the tracking number ITS#6040.
>
> One of our support engineers will look at your report in due course.
> Note that this may take some time because our support engineers
> are volunteers.  They only work on OpenLDAP when they have spare
> time.
>
> If you need to provide additional information in regards to your
> issue report, you may do so by replying to this message.  Note that
> any mail sent to openldap-its@openldap.org with (ITS#6040)
> in the subject will automatically be attached to the issue report.
>
> 	mailto:openldap-its@openldap.org?subject=(ITS#6040)
>
> You may follow the progress of this report by loading the following
> URL in a web browser:
>    http://www.OpenLDAP.org/its/index.cgi?findid=6040
>
> Please remember to retain your issue tracking number (ITS#6040)
> on any further messages you send to us regarding this report.  If
> you don't then you'll just waste our time and yours because we
> won't be able to properly track the report.
>
> Please note that the Issue Tracking System is not intended to
> be used to seek help in the proper use of OpenLDAP Software.
> Such requests will be closed.
>
> OpenLDAP Software is user supported.
> 	http://www.OpenLDAP.org/support/
>
> --------------
> Copyright 1998-2007 The OpenLDAP Foundation, All Rights Reserved.

Comment 4 Quanah Gibson-Mount 2009-04-28 22:59:55 UTC
--On Friday, March 27, 2009 9:52 AM +0000 oskar@deckle.co.za wrote:

A different backtrace from another user of 2.4.16:

GNU gdb Red Hat Linux (6.5-25.el5rh)
Copyright (C) 2006 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain 
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
(gdb) handle SIG33 pass nostop noprint
Signal        Stop	Print	Pass to program	Description
SIG33         No	No	Yes		Real-time event 33
(gdb) set pagination 0
(gdb) attach 4154
Attaching to process 4154
Reading symbols from /opt/openldap2/libexec/slapd...done.
Using host libthread_db library "/lib64/libthread_db.so.1".
Reading symbols from /usr/lib64/libltdl.so.3...done.
Loaded symbols for /usr/lib64/libltdl.so.3
Reading symbols from /opt/db4/lib/libdb-4.7.so...done.
Loaded symbols for /opt/db4/lib/libdb-4.7.so
Reading symbols from /lib64/libpthread.so.0...done.
[Thread debugging using libthread_db enabled]
[New Thread 46912501776800 (LWP 4154)]
[New Thread 1090525504 (LWP 4175)]
[New Thread 1082132800 (LWP 4174)]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libresolv.so.2...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libc.so.6...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libdl.so.2...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/ld-linux-x86-64.so.2...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
0x0000003c024075a5 in pthread_join () from /lib64/libpthread.so.0
(gdb) continue
Continuing.
[New Thread 1098918208 (LWP 4203)]
[New Thread 1107310912 (LWP 4204)]
[New Thread 1115703616 (LWP 4205)]
[New Thread 1124096320 (LWP 4206)]
[New Thread 1132489024 (LWP 4207)]
[New Thread 1140881728 (LWP 4208)]
[New Thread 1149274432 (LWP 4209)]
[New Thread 1157667136 (LWP 4210)]
[New Thread 1166059840 (LWP 4211)]
[New Thread 1174452544 (LWP 4298)]
[New Thread 1182845248 (LWP 4299)]
[New Thread 1191237952 (LWP 4300)]
[New Thread 1199630656 (LWP 4301)]
[New Thread 1208023360 (LWP 4302)]
[New Thread 1216416064 (LWP 4303)]
[New Thread 1224808768 (LWP 4304)]
[New Thread 1233201472 (LWP 4305)]
[New Thread 1241594176 (LWP 4306)]
[New Thread 1249986880 (LWP 4307)]

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 1090525504 (LWP 4175)]
0x0000003c024082e9 in pthread_mutex_lock () from /lib64/libpthread.so.0
(gdb) backtrace full
#0  0x0000003c024082e9 in pthread_mutex_lock () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00000000005c2b01 in ldap_pvt_thread_mutex_lock (mutex=0x58) at 
thr_posix.c:296
No locals.
#2  0x0000000000523d44 in bdb_cache_delete_internal (cache=0x12efd330, 
e=0x2aac4fb3c8d0, decr=0) at cache.c:1372
	rc = 0
	decr_leaf = 0
#3  0x0000000000522a32 in hdb_cache_lru_purge (bdb=0x12efd2d0) at 
cache.c:776
	lock = {off = 0, ndx = 324, gen = 1689, mode = DB_LOCK_WRITE}
	lockp = (DB_LOCK *) 0x40e7f780
	elru = (EntryInfo *) 0x2aac4fb3c8d0
	elnext = (EntryInfo *) 0x2aac4f1fe610
	count = 1
	islocked = 1
	eimax = 100000
	efree = 10011
	eifree = 50000
	eicount = 0
	ecount = 1
	iter = 0
#4  0x0000000000523323 in hdb_cache_find_id (op=0x12ee1630, tid=0x12ee3510, 
id=243315, eip=0x40e7fa40, flag=0, lock=0x40e7fa10) at cache.c:1053
	purge = 1
	bdb = (struct bdb_info *) 0x12efd2d0
	ep = (Entry *) 0x0
	rc = 0
	load = 1
	ei = {bei_parent = 0x0, bei_id = 243315, bei_lockpad = 0, bei_state = 0, 
bei_finders = 0, bei_nrdn = {bv_len = 0, bv_val = 0x0}, bei_rdn = {bv_len = 
0, bv_val = 0x0}, bei_modrdns = 0, bei_ckids = 0, bei_dkids = 0, bei_e = 
0x0, bei_kids = 0x0, bei_kids_mutex = {__data = {__lock = 0, __count = 0, 
__owner = 0, __nusers = 0, __kind = 0, __spins = 0, __list = {__prev = 0x0, 
__next = 0x0}}, __size = '\0' <repeats 39 times>, __align = 0}, bei_lrunext 
= 0x0, bei_lruprev = 0x0}
#5  0x00000000004e5105 in hdb_search (op=0x12ee1630, rs=0x41000c80) at 
search.c:705
	scopeok = 0
	bdb = (struct bdb_info *) 0x12efd2d0
	id = 243315
	cursor = 1
	lastid = 18446744073709551615
	candidates = {1, 243315, 5000071, 0 <repeats 130531 times>, 24, 
1090513600, 1090513392, 0, 0, 0, 2050, 0 <repeats 21 times>, 1090513632, 
6244688, 0, 90194313217, 0, 8804682956800, 1090517792, 6242840, 4294967296, 
317906296, 17179869184, 317600016, 0 <repeats 19 times>, 4795068, 0, 0, 
316910368, 1090517216, 0, 1090517216, 316910368, 0, 1090513968, 6006094, 
316910368, 4794969, 1090517216, 316910400, 0, 0, 1090514032, 4795242, 0, 
316910048, 316910048, 1090517216, 1090525504, 316910368, 1090517376, 
4783514, 1090525504, 1090517392, 317448576, 1090522272, 327778448, 
1090517472, 317448576, 4794969, 1090517392, 317448608, 0, 56, 1090514208, 
4795242, 1090514208, 317448144, 317448144, 1090517392, 1090525504, 
317448576, 1090517552, 4783514, 0, 0, 0, 1090517640, 1090517664, 327777992, 
0 <repeats 15 times>, 4795068, 0, 0, 316910368, 1090517776, 0, 1090517776, 
316910368, 0, 1090514528, 6006094, 316910368, 4794969, 1090517776, 
316910400, 0, 0, 1090514592, 4795242, 0, 316910048, 316910048, 1090517776, 
1090525504, 316910368, 1090517936, 4783514, 0, 0, 0, 1090522096, 327778736, 
327778720, 0 <repeats 22 times>, 1, 1090516592, 6284189, 6284190, 16, 
257723479467, 0, 0, 1090516528, 0, 1090515280, 0, 0, 0, 1090516960, 
6284180, 1090516608, 0, 0, 0, 0, 18446744073709551615, 94489280512, 
6284181, 0, 1090516280, 12884901888, 11, 0, 0, 0, 0, 0, 0, 32, 0, 0, 
1929379840, 0, 0...}
	scopes = {0 <repeats 65536 times>}
	e = (Entry *) 0x0
	base = {e_id = 74, e_name = {bv_len = 0, bv_val = 0x0}, e_nname = {bv_len 
= 25, bv_val = 0x2aacaf1795a0 "ou=o1,ou=people,o=oxylane"}, e_attrs = 0x0, 
e_ocflags = 0, e_bv = {bv_len = 0, bv_val = 0x0}, e_private = 0x12ee3ed0}
	e_root = (Entry *) 0x130f6b38
	matched = (Entry *) 0x0
	ei = (EntryInfo *) 0x2aac4d6fe6d0
	attrs = (AttributeName *) 0x138981a0
	realbase = {bv_len = 25, bv_val = 0x2aacaf1795a0 
"ou=o1,ou=people,o=oxylane"}
	mask = 5119
	stoptime = 1240904022
	manageDSAit = 0
	tentries = 1
	nentries = 1
	idflag = 0
	lock = {off = 203872, ndx = 95, gen = 2711, mode = DB_LOCK_READ}
	opinfo = (struct bdb_op_info *) 0x0
	ltid = (DB_TXN *) 0x12ee3510
	oex = (OpExtra *) 0x0
#6  0x000000000043ecfa in fe_op_search (op=0x12ee1630, rs=0x41000c80) at 
search.c:366
	bd = (BackendDB *) 0x89cce0
#7  0x000000000043e634 in do_search (op=0x12ee1630, rs=0x41000c80) at 
search.c:217
	base = {bv_len = 25, bv_val = 0x2aacaf178668 "ou=o1,ou=people,o=oxylane"}
	siz = 1
	off = 0
	i = 1
#8  0x000000000043b78a in connection_operation (ctx=0x41000dd0, 
arg_v=0x12ee1630) at connection.c:1097
	rc = 80
	op = (Operation *) 0x12ee1630
	rs = {sr_type = REP_RESULT, sr_tag = 0, sr_msgid = 0, sr_err = 0, 
sr_matched = 0x0, sr_text = 0x0, sr_ref = 0x0, sr_ctrls = 0x0, sr_un = 
{sru_sasl = {r_sasldata = 0x0}, sru_extended = {r_rspoid = 0x0, r_rspdata = 
0x0}, sru_search = {r_entry = 0x0, r_attr_flags = 0, r_operational_attrs = 
0x0, r_attrs = 0x0, r_nentries = 0, r_v2ref = 0x0}}, sr_flags = 0}
	tag = 99
	opidx = SLAP_OP_SEARCH
	conn = (Connection *) 0x12f2c7b8
	memctx = (void *) 0x12ee1b60
	memctx_null = (void *) 0x0
	memsiz = 1048576
	__PRETTY_FUNCTION__ = "connection_operation"
#9  0x000000000043bca5 in connection_read_thread (ctx=0x41000dd0, argv=0xd) 
at connection.c:1223
	rc = 0
	cri = {op = 0x12ee1630, func = 0, arg = 0x0, ctx = 0x41000dd0, nullop = 0}
	s = 13
#10 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
	pool = (struct ldap_int_thread_pool_s *) 0x12e3da20
	task = (ldap_int_thread_task_t *) 0x2aaca82a46f0
	work_list = (ldap_int_tpool_plist_t *) 0x12e3dab8
	ctx = {ltu_id = 1090525504, ltu_key = {{ltk_key = 0x43b311, ltk_data = 
0x12ee1a50, ltk_free = 0x43b174 <conn_counter_destroy>}, {ltk_key = 
0x4a653a, ltk_data = 0x12ee1b60, ltk_free = 0x4a6334 
<slap_sl_mem_destroy>}, {ltk_key = 0x4553b8, ltk_data = 0x0, ltk_free = 
0x455314 <slap_op_q_destroy>}, {ltk_key = 0x130d9a60, ltk_data = 
0x12ee3510, ltk_free = 0x524225 <bdb_reader_free>}, {ltk_key = 0x4e62a6, 
ltk_data = 0x13a97d60, ltk_free = 0x4e6286 <search_stack_free>}, {ltk_key = 
0x0, ltk_data = 0x0, ltk_free = 0} <repeats 27 times>}}
	kctx = (ldap_int_thread_userctx_t *) 0x0
	i = 32
	keyslot = 986
	hash = 2575130586
	__PRETTY_FUNCTION__ = "ldap_int_thread_pool_wrapper"
#11 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#12 0x0000003c018ce3bd in clone () from /lib64/libc.so.6
No symbol table info available.
(gdb) info registers
rax            0x0	0
rbx            0x58	88
rcx            0x28	40
rdx            0x0	0
rsi            0x2aac4fb3c8d0	46919559923920
rdi            0x58	88
rbp            0x104f	0x104f
rsp            0x40e7f6d0	0x40e7f6d0
r8             0x2aac37ebc138	46919160938808
r9             0x1	1
r10            0x0	0
r11            0x1	1
r12            0x0	0
r13            0x41001940	1090525504
r14            0x41002000	1090527232
r15            0x1000	4096
rip            0x3c024082e9	0x3c024082e9 <pthread_mutex_lock+25>
eflags         0x10202	[ IF RF ]
cs             0x33	51
ss             0x2b	43
ds             0x0	0
es             0x0	0
fs             0x63	99
gs             0x0	0
(gdb)  thread apply all backtrace

Thread 22 (Thread 1249986880 (LWP 4307)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 21 (Thread 1241594176 (LWP 4306)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 20 (Thread 1233201472 (LWP 4305)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 19 (Thread 1224808768 (LWP 4304)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 18 (Thread 1216416064 (LWP 4303)):
#0  0x0000003c018da178 in __lll_mutex_lock_wait () from /lib64/libc.so.6
#1  0x0000003c01873c07 in _L_lock_14089 () from /lib64/libc.so.6
#2  0x0000003c01872a61 in free () from /lib64/libc.so.6
#3  0x00000000005f29fb in ber_memfree_x (p=0x20e77cf0, ctx=0x0) at 
memory.c:152
#4  0x00000000005f0dc2 in ber_free (ber=0x20e77cf0, freebuf=1) at io.c:214
#5  0x0000000000455416 in slap_op_free (op=0x172c4ac0, ctx=0x4880fdd0) at 
operation.c:83
#6  0x000000000043ba28 in connection_operation (ctx=0x4880fdd0, 
arg_v=0x172c4ac0) at connection.c:1144
#7  0x000000000043bca5 in connection_read_thread (ctx=0x4880fdd0, 
argv=0x21) at connection.c:1223
#8  0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#9  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#10 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 17 (Thread 1208023360 (LWP 4302)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 16 (Thread 1199630656 (LWP 4301)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 15 (Thread 1191237952 (LWP 4300)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 14 (Thread 1182845248 (LWP 4299)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 13 (Thread 1174452544 (LWP 4298)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 12 (Thread 1166059840 (LWP 4211)):
#0  0x0000003c018b5c57 in sched_yield () from /lib64/libc.so.6
#1  0x00002aaaaadd2f98 in __os_yield () from /opt/db4/lib/libdb-4.7.so
#2  0x00002aaaaace13f6 in __db_tas_mutex_lock () from 
/opt/db4/lib/libdb-4.7.so
#3  0x00002aaaaadc0928 in __memp_alloc () from /opt/db4/lib/libdb-4.7.so
#4  0x00002aaaaadc2153 in __memp_fget () from /opt/db4/lib/libdb-4.7.so
#5  0x00002aaaaacf5511 in __bam_search () from /opt/db4/lib/libdb-4.7.so
#6  0x00002aaaaace4f57 in __bamc_init () from /opt/db4/lib/libdb-4.7.so
#7  0x00002aaaaace6e2c in __bamc_init () from /opt/db4/lib/libdb-4.7.so
#8  0x00002aaaaad7d8ea in __dbc_get () from /opt/db4/lib/libdb-4.7.so
#9  0x00002aaaaad89474 in __dbc_get_pp () from /opt/db4/lib/libdb-4.7.so
#10 0x00000000005326cc in hdb_idl_fetch_key (be=0x12efd140, db=0x1ebccc70, 
txn=0x161c30b0, key=0x45688290, ids=0x173c6720, saved_cursor=0x0, 
get_flag=0) at idl.c:604
#11 0x0000000000536635 in hdb_key_read (be=0x12efd140, db=0x1ebccc70, 
txn=0x161c30b0, k=0x172c6bc8, ids=0x173c6720, saved_cursor=0x0, get_flag=0) 
at key.c:50
#12 0x000000000052e5ad in equality_candidates (op=0x161c2b00, 
rtxn=0x161c30b0, ava=0x172c6a60, ids=0x176c6720, tmp=0x173c6720) at 
filterindex.c:788
#13 0x000000000052ce70 in hdb_filter_candidates (op=0x161c2b00, 
rtxn=0x161c30b0, f=0x172c6aa0, ids=0x176c6720, tmp=0x173c6720, 
stack=0x177c6720) at filterindex.c:154
#14 0x000000000052d9f2 in list_candidates (op=0x161c2b00, rtxn=0x161c30b0, 
flist=0x172c6a40, ftype=160, ids=0x175c6720, tmp=0x173c6720, 
save=0x176c6720) at filterindex.c:581
#15 0x000000000052d2e4 in hdb_filter_candidates (op=0x161c2b00, 
rtxn=0x161c30b0, f=0x172c6ac0, ids=0x175c6720, tmp=0x173c6720, 
stack=0x176c6720) at filterindex.c:198
#16 0x000000000052d9f2 in list_candidates (op=0x161c2b00, rtxn=0x161c30b0, 
flist=0x45688870, ftype=161, ids=0x174c6720, tmp=0x173c6720, 
save=0x175c6720) at filterindex.c:581
#17 0x000000000052d38c in hdb_filter_candidates (op=0x161c2b00, 
rtxn=0x161c30b0, f=0x45688850, ids=0x174c6720, tmp=0x173c6720, 
stack=0x175c6720) at filterindex.c:204
#18 0x000000000052d9f2 in list_candidates (op=0x161c2b00, rtxn=0x161c30b0, 
flist=0x45688830, ftype=160, ids=0x45708aa0, tmp=0x173c6720, 
save=0x174c6720) at filterindex.c:581
#19 0x000000000052d2e4 in hdb_filter_candidates (op=0x161c2b00, 
rtxn=0x161c30b0, f=0x45688890, ids=0x45708aa0, tmp=0x173c6720, 
stack=0x174c6720) at filterindex.c:198
#20 0x00000000004e67f7 in search_candidates (op=0x161c2b00, rs=0x45809c80, 
e=0x45688a50, txn=0x161c30b0, ids=0x45708aa0, scopes=0x45688aa0) at 
search.c:1204
#21 0x00000000004e4b47 in hdb_search (op=0x161c2b00, rs=0x45809c80) at 
search.c:585
#22 0x000000000043ecfa in fe_op_search (op=0x161c2b00, rs=0x45809c80) at 
search.c:366
#23 0x000000000043e634 in do_search (op=0x161c2b00, rs=0x45809c80) at 
search.c:217
#24 0x000000000043b78a in connection_operation (ctx=0x45809dd0, 
arg_v=0x161c2b00) at connection.c:1097
#25 0x000000000043bca5 in connection_read_thread (ctx=0x45809dd0, 
argv=0x19) at connection.c:1223
#26 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#27 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#28 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 11 (Thread 1157667136 (LWP 4210)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00002aaaaace186d in __db_pthread_mutex_lock () from 
/opt/db4/lib/libdb-4.7.so
#2  0x00002aaaaace140b in __db_tas_mutex_lock () from 
/opt/db4/lib/libdb-4.7.so
#3  0x00002aaaaad5f341 in __lock_get_internal () from 
/opt/db4/lib/libdb-4.7.so
#4  0x00002aaaaad5f921 in __lock_get_pp () from /opt/db4/lib/libdb-4.7.so
#5  0x0000000000521970 in bdb_cache_entry_db_lock (bdb=0x12efd2d0, 
txn=0x161c3480, ei=0x12ee3ed0, rw=0, tryOnly=0, lock=0x44e87a10) at 
cache.c:221
#6  0x0000000000522ef5 in hdb_cache_find_id (op=0x161c2620, tid=0x161c3480, 
id=74, eip=0x44e878c0, flag=0, lock=0x44e87a10) at cache.c:951
#7  0x0000000000529aad in hdb_dn2entry (op=0x161c2620, tid=0x161c3480, 
dn=0x161c2658, e=0x44e87a40, matched=1, lock=0x44e87a10) at dn2entry.c:67
#8  0x00000000004e3f73 in hdb_search (op=0x161c2620, rs=0x45008c80) at 
search.c:373
#9  0x000000000043ecfa in fe_op_search (op=0x161c2620, rs=0x45008c80) at 
search.c:366
#10 0x000000000043e634 in do_search (op=0x161c2620, rs=0x45008c80) at 
search.c:217
#11 0x000000000043b78a in connection_operation (ctx=0x45008dd0, 
arg_v=0x161c2620) at connection.c:1097
#12 0x000000000043bca5 in connection_read_thread (ctx=0x45008dd0, 
argv=0x22) at connection.c:1223
#13 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#14 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#15 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 10 (Thread 1149274432 (LWP 4209)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 9 (Thread 1140881728 (LWP 4208)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 8 (Thread 1132489024 (LWP 4207)):
#0  0x00002aaaaad5d361 in __lock_locker_is_parent () from 
/opt/db4/lib/libdb-4.7.so
#1  0x00002aaaaad5e544 in __lock_get_internal () from 
/opt/db4/lib/libdb-4.7.so
#2  0x00002aaaaad5f692 in __lock_get () from /opt/db4/lib/libdb-4.7.so
#3  0x00002aaaaad8b7f4 in __db_lget () from /opt/db4/lib/libdb-4.7.so
#4  0x00002aaaaacf4eaf in __bam_get_root () from /opt/db4/lib/libdb-4.7.so
#5  0x00002aaaaacf5222 in __bam_search () from /opt/db4/lib/libdb-4.7.so
#6  0x00002aaaaace4f57 in __bamc_init () from /opt/db4/lib/libdb-4.7.so
#7  0x00002aaaaace6e2c in __bamc_init () from /opt/db4/lib/libdb-4.7.so
#8  0x00002aaaaad7d8ea in __dbc_get () from /opt/db4/lib/libdb-4.7.so
#9  0x00002aaaaad89474 in __dbc_get_pp () from /opt/db4/lib/libdb-4.7.so
#10 0x00000000005326cc in hdb_idl_fetch_key (be=0x12efd140, db=0x1ebccc70, 
txn=0x2aac460024d0, key=0x43684290, ids=0x2aac46102e40, saved_cursor=0x0, 
get_flag=0) at idl.c:604
#11 0x0000000000536635 in hdb_key_read (be=0x12efd140, db=0x1ebccc70, 
txn=0x2aac460024d0, k=0x2aac460032e8, ids=0x2aac46102e40, saved_cursor=0x0, 
get_flag=0) at key.c:50
#12 0x000000000052e5ad in equality_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, ava=0x2aac46003180, ids=0x2aac46402e40, 
tmp=0x2aac46102e40) at filterindex.c:788
#13 0x000000000052ce70 in hdb_filter_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, f=0x2aac460031c0, ids=0x2aac46402e40, 
tmp=0x2aac46102e40, stack=0x2aac46502e40) at filterindex.c:154
#14 0x000000000052d9f2 in list_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, flist=0x2aac46003160, ftype=160, ids=0x2aac46302e40, 
tmp=0x2aac46102e40, save=0x2aac46402e40) at filterindex.c:581
#15 0x000000000052d2e4 in hdb_filter_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, f=0x2aac460031e0, ids=0x2aac46302e40, 
tmp=0x2aac46102e40, stack=0x2aac46402e40) at filterindex.c:198
#16 0x000000000052d9f2 in list_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, flist=0x43684870, ftype=161, ids=0x2aac46202e40, 
tmp=0x2aac46102e40, save=0x2aac46302e40) at filterindex.c:581
#17 0x000000000052d38c in hdb_filter_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, f=0x43684850, ids=0x2aac46202e40, tmp=0x2aac46102e40, 
stack=0x2aac46302e40) at filterindex.c:204
#18 0x000000000052d9f2 in list_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, flist=0x43684830, ftype=160, ids=0x43704aa0, 
tmp=0x2aac46102e40, save=0x2aac46202e40) at filterindex.c:581
#19 0x000000000052d2e4 in hdb_filter_candidates (op=0x2aac46000c30, 
rtxn=0x2aac460024d0, f=0x43684890, ids=0x43704aa0, tmp=0x2aac46102e40, 
stack=0x2aac46202e40) at filterindex.c:198
#20 0x00000000004e67f7 in search_candidates (op=0x2aac46000c30, 
rs=0x43805c80, e=0x43684a50, txn=0x2aac460024d0, ids=0x43704aa0, 
scopes=0x43684aa0) at search.c:1204
#21 0x00000000004e4b47 in hdb_search (op=0x2aac46000c30, rs=0x43805c80) at 
search.c:585
#22 0x000000000043ecfa in fe_op_search (op=0x2aac46000c30, rs=0x43805c80) 
at search.c:366
#23 0x000000000043e634 in do_search (op=0x2aac46000c30, rs=0x43805c80) at 
search.c:217
#24 0x000000000043b78a in connection_operation (ctx=0x43805dd0, 
arg_v=0x2aac46000c30) at connection.c:1097
#25 0x000000000043bca5 in connection_read_thread (ctx=0x43805dd0, 
argv=0x15) at connection.c:1223
#26 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#27 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#28 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 7 (Thread 1124096320 (LWP 4206)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 6 (Thread 1115703616 (LWP 4205)):
#0  0x0000003c0240d798 in pread64 () from /lib64/libpthread.so.0
#1  0x00002aaaaadd24ee in __os_io () from /opt/db4/lib/libdb-4.7.so
#2  0x00002aaaaadc11c5 in __memp_pgread () from /opt/db4/lib/libdb-4.7.so
#3  0x00002aaaaadc2b7f in __memp_fget () from /opt/db4/lib/libdb-4.7.so
#4  0x00002aaaaacf5511 in __bam_search () from /opt/db4/lib/libdb-4.7.so
#5  0x00002aaaaace4f57 in __bamc_init () from /opt/db4/lib/libdb-4.7.so
#6  0x00002aaaaace6e2c in __bamc_init () from /opt/db4/lib/libdb-4.7.so
#7  0x00002aaaaad7d8ea in __dbc_get () from /opt/db4/lib/libdb-4.7.so
#8  0x00002aaaaad89474 in __dbc_get_pp () from /opt/db4/lib/libdb-4.7.so
#9  0x000000000053032e in hdb_id2entry (be=0x12efd140, tid=0x2aac45000900, 
id=4194444, e=0x426828b0) at id2entry.c:125
#10 0x0000000000522f69 in hdb_cache_find_id (op=0x12ee4960, 
tid=0x2aac45000900, id=4194444, eip=0x42682a40, flag=0, lock=0x42682a10) at 
cache.c:958
#11 0x00000000004e5105 in hdb_search (op=0x12ee4960, rs=0x42803c80) at 
search.c:705
#12 0x000000000043ecfa in fe_op_search (op=0x12ee4960, rs=0x42803c80) at 
search.c:366
#13 0x000000000043e634 in do_search (op=0x12ee4960, rs=0x42803c80) at 
search.c:217
#14 0x000000000043b78a in connection_operation (ctx=0x42803dd0, 
arg_v=0x12ee4960) at connection.c:1097
#15 0x000000000043bca5 in connection_read_thread (ctx=0x42803dd0, 
argv=0x11) at connection.c:1223
#16 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#17 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#18 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 5 (Thread 1107310912 (LWP 4204)):
#0  0x0000003c0240a496 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib64/libpthread.so.0
#1  0x00000000005c2ab7 in ldap_pvt_thread_cond_wait (cond=0x12e3da50, 
mutex=0x12e3da28) at thr_posix.c:277
#2  0x00000000005c155d in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:654
#3  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#4  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 4 (Thread 1098918208 (LWP 4203)):
#0  0x0000003c0186f798 in _int_malloc () from /lib64/libc.so.6
#1  0x0000003c01870c9d in malloc () from /lib64/libc.so.6
#2  0x00000000005f2b13 in ber_memalloc_x (s=2940, ctx=0x0) at memory.c:226
#3  0x000000000045f486 in ch_malloc (size=2940) at ch_malloc.c:54
#4  0x0000000000530402 in hdb_id2entry (be=0x12efd140, tid=0x12ea8150, 
id=4937379, e=0x416808b0) at id2entry.c:143
#5  0x0000000000522f69 in hdb_cache_find_id (op=0x12ee2530, tid=0x12ea8150, 
id=4937379, eip=0x41680a40, flag=0, lock=0x41680a10) at cache.c:958
#6  0x00000000004e5105 in hdb_search (op=0x12ee2530, rs=0x41801c80) at 
search.c:705
#7  0x000000000043ecfa in fe_op_search (op=0x12ee2530, rs=0x41801c80) at 
search.c:366
#8  0x000000000043e634 in do_search (op=0x12ee2530, rs=0x41801c80) at 
search.c:217
#9  0x000000000043b78a in connection_operation (ctx=0x41801dd0, 
arg_v=0x12ee2530) at connection.c:1097
#10 0x000000000043bca5 in connection_read_thread (ctx=0x41801dd0, 
argv=0x24) at connection.c:1223
#11 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#12 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#13 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 3 (Thread 1082132800 (LWP 4174)):
#0  0x0000003c018ce7a8 in epoll_wait () from /lib64/libc.so.6
#1  0x0000000000437e8c in slapd_daemon_task (ptr=0x0) at daemon.c:2291
#2  0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#3  0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 2 (Thread 1090525504 (LWP 4175)):
#0  0x0000003c024082e9 in pthread_mutex_lock () from /lib64/libpthread.so.0
#1  0x00000000005c2b01 in ldap_pvt_thread_mutex_lock (mutex=0x58) at 
thr_posix.c:296
#2  0x0000000000523d44 in bdb_cache_delete_internal (cache=0x12efd330, 
e=0x2aac4fb3c8d0, decr=0) at cache.c:1372
#3  0x0000000000522a32 in hdb_cache_lru_purge (bdb=0x12efd2d0) at 
cache.c:776
#4  0x0000000000523323 in hdb_cache_find_id (op=0x12ee1630, tid=0x12ee3510, 
id=243315, eip=0x40e7fa40, flag=0, lock=0x40e7fa10) at cache.c:1053
#5  0x00000000004e5105 in hdb_search (op=0x12ee1630, rs=0x41000c80) at 
search.c:705
#6  0x000000000043ecfa in fe_op_search (op=0x12ee1630, rs=0x41000c80) at 
search.c:366
#7  0x000000000043e634 in do_search (op=0x12ee1630, rs=0x41000c80) at 
search.c:217
#8  0x000000000043b78a in connection_operation (ctx=0x41000dd0, 
arg_v=0x12ee1630) at connection.c:1097
#9  0x000000000043bca5 in connection_read_thread (ctx=0x41000dd0, argv=0xd) 
at connection.c:1223
#10 0x00000000005c15dc in ldap_int_thread_pool_wrapper (xpool=0x12e3da20) 
at tpool.c:663
#11 0x0000003c024062e7 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003c018ce3bd in clone () from /lib64/libc.so.6

Thread 1 (Thread 46912501776800 (LWP 4154)):
#0  0x0000003c024075a5 in pthread_join () from /lib64/libpthread.so.0
#1  0x00000000005c2a0f in ldap_pvt_thread_join (thread=1082132800, 
thread_return=0x0) at thr_posix.c:197
#2  0x0000000000438c33 in slapd_daemon () at daemon.c:2665
#3  0x000000000041bcb2 in main (argc=5, argv=0x7fff8a4f4f48) at main.c:948
#0  0x0000003c024082e9 in pthread_mutex_lock () from /lib64/libpthread.so.0
(gdb) quit
The program is running.  Quit anyway (and detach it)? (y or n) Detaching 
from program: /opt/openldap2/libexec/slapd, process 4154


--Quanah



--

Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra ::  the leader in open source messaging and collaboration

Comment 5 Howard Chu 2009-05-13 02:32:47 UTC
changed notes
Comment 6 Howard Chu 2009-05-13 02:32:48 UTC
changed state Feedback to Test
moved from Incoming to Software Bugs
Comment 7 Quanah Gibson-Mount 2009-09-18 21:42:37 UTC
changed notes
changed state Test to Closed
Comment 8 OpenLDAP project 2014-08-01 21:04:21 UTC
fixed in HEAD by #6095
fixed in RE24