[Date Prev][Date Next] [Chronological] [Thread] [Top]

(ITS#4439) slapd stops responding



Full_Name: David Hunter
Version: 2.3.20
OS: linux 2.6.9-22 (RHEL4 AS)
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (129.107.38.98)


Slapd periodically stops responding (once or twice a day). The slapd process
seems to be running, but it's not possible to bind. Here's the gdb output during
one of these down times.

Using host libthread_db library "/lib/tls/libthread_db.so.1".
[Thread debugging using libthread_db enabled]
[New Thread -1208043840 (LWP 7217)]
[New Thread 794692528 (LWP 1031)]
[New Thread 849251248 (LWP 1030)]
[New Thread 862899120 (LWP 1029)]
[New Thread 876546992 (LWP 1028)]
[New Thread 887036848 (LWP 1027)]
[New Thread 897526704 (LWP 1026)]
[New Thread 908016560 (LWP 1025)]
[New Thread 918506416 (LWP 1024)]
[New Thread 930048944 (LWP 1023)]
[New Thread 941591472 (LWP 1022)]
[New Thread 953134000 (LWP 1021)]
[New Thread 965729200 (LWP 1020)]
[New Thread 976219056 (LWP 1019)]
[New Thread 986708912 (LWP 1018)]
[New Thread 1014983600 (LWP 22354)]
[New Thread 1043311536 (LWP 22353)]
[New Thread 109398960 (LWP 22352)]
[New Thread 98909104 (LWP 22351)]
[New Thread 88419248 (LWP 7289)]
[New Thread 125770672 (LWP 26980)]
[New Thread 65829808 (LWP 13187)]
[New Thread 55339952 (LWP 7264)]
[New Thread 36944816 (LWP 7223)]
[New Thread 76413872 (LWP 7222)]
[New Thread 26454960 (LWP 7221)]
0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2

Thread 26 (Thread 26454960 (LWP 7221)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0022140b in __write_nocancel () from /lib/tls/libpthread.so.0
#2  0x08064a33 in slapd_clr_read (s=48, wake=1) at daemon.c:570
#3  0x08068da3 in connection_closing (c=0x588de508,
    why=0x8110690 "connection lost") at connection.c:957
#4  0x0806a10f in connection_read (s=48) at connection.c:1539
#5  0x080669e9 in slapd_daemon_task (ptr=0x0) at daemon.c:2135
#6  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#7  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 25 (Thread 76413872 (LWP 7222)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 24 (Thread 36944816 (LWP 7223)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0022140b in __write_nocancel () from /lib/tls/libpthread.so.0
#2  0x08067638 in slap_wake_listener () at daemon.c:2350
#3  0x080e18ef in hdb_cache_lru_add (bdb=0x84983e0, ei=) at cache.c:667
#4  0x080e201d in hdb_cache_find_id (op=0x4e83c658, tid=0x0, id=89885,
    eip=0x2279e28, islocked=0, locker=159, lock=0x2279ee0) at cache.c:892
#5  0x080c799a in hdb_search (op=0x4e83c658, rs=0x233b220) at search.c:695
#6  0x080b2e25 in overlay_op_walk (op=0x4e83c658, rs=0x233b220,
    which=op_search, oi=0x845cd50, on=0x845cfe8) at backover.c:499
#7  0x080b2f0e in over_op_func (op=0x4e83c658, rs=0x233b220, which=op_search)
    at backover.c:551
#8  0x0806b5b2 in fe_op_search (op=0x4e83c658, rs=0x233b220) at search.c:355
#9  0x0806aeb1 in do_search (op=0x4e83c658, rs=0x233b220) at search.c:217
#10 0x08069a61 in connection_operation (ctx=0x233b2b0, arg_v=0x4e83c658)
    at connection.c:1307
#11 0x007435ca in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:480
#12 0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#13 0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 23 (Thread 55339952 (LWP 7264)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 22 (Thread 65829808 (LWP 13187)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 21 (Thread 125770672 (LWP 26980)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 20 (Thread 88419248 (LWP 7289)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 19 (Thread 98909104 (LWP 22351)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 18 (Thread 109398960 (LWP 22352)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 17 (Thread 1043311536 (LWP 22353)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 16 (Thread 1014983600 (LWP 22354)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 15 (Thread 986708912 (LWP 1018)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 14 (Thread 976219056 (LWP 1019)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 13 (Thread 965729200 (LWP 1020)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 12 (Thread 953134000 (LWP 1021)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 11 (Thread 941591472 (LWP 1022)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 10 (Thread 930048944 (LWP 1023)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 9 (Thread 918506416 (LWP 1024)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 8 (Thread 908016560 (LWP 1025)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 7 (Thread 897526704 (LWP 1026)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 6 (Thread 887036848 (LWP 1027)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 5 (Thread 876546992 (LWP 1028)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 4 (Thread 862899120 (LWP 1029)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 3 (Thread 849251248 (LWP 1030)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 2 (Thread 794692528 (LWP 1031)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021eb16 in pthread_cond_wait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#2  0x007440f6 in ldap_pvt_thread_cond_wait (cond=0x84435a4, mutex=0x844358c)
    at thr_posix.c:298
#3  0x00743650 in ldap_int_thread_pool_wrapper (xpool=0x8443588) at tpool.c:492
#4  0x0021c371 in start_thread () from /lib/tls/libpthread.so.0
#5  0x00baf9be in clone () from /lib/tls/libc.so.6

Thread 1 (Thread -1208043840 (LWP 7217)):
#0  0x00acf7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0021d0fd in pthread_join () from /lib/tls/libpthread.so.0
#2  0x0074400e in ldap_pvt_thread_join (thread=26454960, thread_return=0x0)
    at thr_posix.c:193
#3  0x08067585 in slapd_daemon () at daemon.c:2239
#4  0x0805913b in main (argc=5, argv=0xbfea3814) at main.c:854

David Hunter