Full_Name: John Morrissey Version: 2.3.41 OS: Linux URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (66.133.190.110) (continuing the openldap-software thread starting at http://marc.info/?l=openldap-software&m=120654684131594&w=2) An assertion failure causes slapd to crash every few days in our environment. The assertion seems to be in servers/slapd/connection.s:680: assert( c->c_writewaiter == 0); Program received signal SIGABRT, Aborted. [Switching to Thread -1917846608 (LWP 13701)] 0xb7c02947 in raise () from /lib/tls/libc.so.6 Thread 11 (Thread -1958761552 (LWP 13860)): #0 0xb7d13c01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f8106a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x8db12ee8, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0xa1, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x89aff008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x4c, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2336205744 i = 549 keyslot = 549 hash = 549 #3 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 10 (Thread -1954567248 (LWP 13859)): #0 0xb7d13c01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f8106a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x830d410, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0xa2, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x892fe008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x4d, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2340400048 i = 613 keyslot = 613 hash = 613 #3 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 9 (Thread -1949320272 (LWP 13858)): #0 0xb7d13c01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x90389d60, mutex=0x90389ca8) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0x08083dcc in send_ldap_ber (conn=0x90389c98, ber=0x8bcface4) at /var/jwm/o2/openldap/servers/slapd/result.c:198 err = 11 sd = 31 bytes = 118 #3 0x080871db in slap_send_search_entry (op=0x8bcfb0c0, rs=0x8bcfaef0) at /var/jwm/o2/openldap/servers/slapd/result.c:1137 berbuf = {buffer = "\002\000\001\000\000\000\000\000ˇˇˇˇ\000\000\000\000\000\000\000\000$�\177\213\232�\177\213R�\177\213\000\000\000\000n�\177\213∏�0\b@≠�\213(∞\177\213\001\000\000\0008≠�\213���\213\005��\213ˇˇˇˇ\000\000\000\000ˇˇˇˇ\a\000\000\000\020\000\000\000V\211Q\206\000\000\001\000\000\000\000\000ˇˇˇˇ", '\0' <repeats 12 times>, "\201∞\177\2138�\177\213\000\000\000\000\000\000\000\000∏�0\b���∑\030\000\000\000∏�0\b\000\000\000\000\001\000\000\000\f∞\177\213\232c�∑\016\000\000\000\222\021�∑\220��\213���\213�≠�\213���∑\f∞\177\213�≠�\213\f\000\000\000\037\035"..., ialign = 65538, lalign = 65538, falign = 9.18382988e-41, dalign = 3.2380074297143616e-319, palign = 0x10002 <Address 0x10002 out of bounds>} ber = (BerElement *) 0x8bcface4 a = (Attribute *) 0x0 i = -1949323552 j = 0 rc = 118 bytes = 1030648675 edn = 0x8651892f "reqStart=20080331134601.000004Z,cn=log" userattrs = 1 acl_state = {as_recorded = 0, as_vd_acl = 0x0, as_vi_acl = 0x0, as_vd_acl_mask = 0, as_vd_acl_matches = {{rm_so = 0, rm_eo = 0} <repeats 100 times>}, as_vd_acl_count = 0, as_vd_access = 0x0, as_vd_access_count = 0, as_result = 0, as_vd_ad = 0x0} attrsonly = 0 ad_entry = (AttributeDescription *) 0x816cd90 e_flags = (char **) 0x0 #4 0xb7a098e8 in syncprov_sendresp (op=0x8bcfb0c0, opc=0x8bcfaf6c, so=0x825f118, e=0x8bcfaf98, mode=3) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:798 on = (slap_overinst *) 0x81bec18 rs = {sr_type = REP_SEARCH, sr_tag = 0, sr_msgid = 0, sr_err = 0, sr_matched = 0x0, sr_text = 0x0, sr_ref = 0x0, sr_ctrls = 0x8bcfaee8, sr_un = {sru_sasl = {r_sasldata = 0x8bcfaeb8}, sru_extended = {r_rspoid = 0x8bcfaeb8 "", r_rspdata = 0x21}, sru_search = {r_entry = 0x8bcfaeb8, r_attr_flags = 33, r_operational_attrs = 0x0, r_attrs = 0x0, r_nentries = 0, r_v2ref = 0x0}}, sr_flags = 0} ctrls = {0x8b7fb024, 0x0} cookie = {bv_len = 12, bv_val = 0x8b7fb00c "csn=,rid=001"} e_uuid = {e_id = 0, e_name = {bv_len = 38, bv_val = 0x86518908 "reqStart=20080331134601.000004Z,cn=log"}, e_nname = {bv_len = 38, bv_val = 0x8651892f "reqStart=20080331134601.000004Z,cn=log"}, e_attrs = 0x0, e_ocflags = 0, e_bv = {bv_len = 0, bv_val = 0x0}, e_private = 0x0} a_uuid = {a_desc = 0x8169d00, a_vals = 0x0, a_nvals = 0x8bcfaf84, a_next = 0x0, a_flags = 0} __PRETTY_FUNCTION__ = "syncprov_sendresp" #5 0xb7a09b5b in syncprov_qplay (op=0x8bcfb0c0, on=0x81bec18, so=0x825f118) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:853 sr = (syncres *) 0x865188e0 e = (Entry *) 0x0 opc = {son = 0x81bec18, smatches = 0x7, sdn = {bv_len = 38, bv_val = 0x86518908 "reqStart=20080331134601.000004Z,cn=log"}, sndn = {bv_len = 38, bv_val = 0x8651892f "reqStart=20080331134601.000004Z,cn=log"}, suuid = {bv_len = 16, bv_val = 0x86518956 "\214(g�\223t\020,\206∑o_�K_◊0"}, sctxcsn = {bv_len = 0, bv_val = 0x86518967 ""}, sreference = 0} rc = 0 #6 0xb7a09d20 in syncprov_qtask (ctx=0x8bcfb2b4, arg=0x8db02d38) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:898 rtask = (struct re_s *) 0x8db02d38 so = (syncops *) 0x825f118 on = (slap_overinst *) 0x81bec18 opbuf = {buffer = "\220��\213c\000\000\000�\\\003H\000\000\000\000���\213\006\000\000\000\221�%\b\006\000\000\000\230�%\b\002\000\000\000\000\000\000\000ˇˇˇˇˇˇˇˇ\024�\033\b\000\000\000\000\224�%\b��%\b.\000\000\000\237�%\b", '\0' <repeats 12 times>, "\001", '\0' <repeats 39 times>, "���\213\200", '\0' <repeats 11 times>, "\025\000\000\000{�%\b\025\000\000\000{�%\b", '\0' <repeats 48 times>, "\001\000\000\000\005\000\000\000\230\2348\220\002\000\000\000\003\000\000\000\000\000\000\000�≤�\213∏�0\b�⁄\025\bconn=5 op=1", '\0' <repeats 172 times>, ialign = -1949322864, lalign = -1949322864, falign = -8.00006661e-32, dalign = 2.1123648563677196e-312, palign = 0x8bcfb190 "\001"} op = (Operation *) 0x8bcfb0c0 be = {bd_info = 0x81beb18, be_ctrls = "\000\001\001\001\000\000\001\000\001\000\001\001\001\000\001", '\0' <repeats 17 times>, "\001", be_flags = 256, be_restrictops = 0, be_requires = 0, be_ssf_set = {sss_ssf = 0, sss_transport = 0, sss_tls = 0, sss_sasl = 0, sss_update_ssf = 0, sss_update_transport = 0, sss_update_tls = 0, sss_update_sasl = 0, sss_simple_bind = 0}, be_suffix = 0x81be8e0, be_nsuffix = 0x81be8f8, be_schemadn = {bv_len = 0, bv_val = 0x0}, be_schemandn = {bv_len = 0, bv_val = 0x0}, be_rootdn = {bv_len = 14, bv_val = 0x81be798 "cn=root,cn=log"}, be_rootndn = {bv_len = 14, bv_val = 0x81be980 "cn=root,cn=log"}, be_rootpw = {bv_len = 0, bv_val = 0x0}, be_max_deref_depth = 15, be_def_limit = {lms_t_soft = 3600, lms_t_hard = 0, lms_s_soft = 500, lms_s_hard = 0, lms_s_unchecked = -1, lms_s_pr = 0, lms_s_pr_hide = 0, lms_s_pr_total = 0}, be_limits = 0x81be970, be_acl = 0x81ae418, be_dfltaccess = ACL_READ, be_replica = 0x0, be_replogfile = 0x0, be_update_ndn = {bv_len = 0, bv_val = 0x0}, be_update_refs = 0x0, be_pending_csn_list = 0x8237f48, be_pcl_mutex = {__m_reserved = 0, __m_count = 0, __m_owner = 0x0, __m_kind = 0, __m_lock = {__status = 0, __spinlock = 0}}, be_pcl_mutexp = 0x81be5f8, be_syncinfo = 0x0, be_pb = 0x0, be_cf_ocs = 0xb7a44ce0, be_private = 0x81be630, be_next = {stqe_next = 0x81bee50}} rc = -1208475305 #7 0xb7f80fd9 in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:478 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x830a060 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x830a0b8, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0xa3, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x8238260, ltk_data = 0x4b, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x88afd008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2345647024 i = 709 keyslot = 709 hash = 709 #8 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #9 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 8 (Thread -1945125968 (LWP 13857)): #0 0xb7d13c01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x9038a320, mutex=0x9038a268) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0x08083dcc in send_ldap_ber (conn=0x9038a258, ber=0x8c0face4) at /var/jwm/o2/openldap/servers/slapd/result.c:198 err = 11 sd = 35 bytes = 118 #3 0x080871db in slap_send_search_entry (op=0x8c0fb0c0, rs=0x8c0faef0) at /var/jwm/o2/openldap/servers/slapd/result.c:1137 berbuf = {buffer = "\002\000\001\000\000\000\000\000ˇˇˇˇ\000\000\000\000\000\000\000\000$\221�\212\232\221�\212R��\212\000\000\000\000n\221�\212Pm)\b@≠\017\214(\200�\212\001\000\000\0008≠\017\214��\017\214\005�\017\214ˇˇˇˇ\000\000\000\000ˇˇˇˇ\a\000\000\000\020\000\000\000N�\035\210\000\000\001\000\000\000\000\000ˇˇˇˇ", '\0' <repeats 12 times>, "\201\200�\2128\220�\212\000\000\000\000\000\000\000\000Pm)\b���∑\030\000\000\000Pm)\bHRQ\f\000\000\000\000\f\200�\212�F�∑\b�\017\214r\222�∑\220�\017\214��\017\214�≠\017\214���∑\f\200�\212�≠\017\214\f\000\000\000\000\000"..., ialign = 65538, lalign = 65538, falign = 9.18382988e-41, dalign = 3.2380074297143616e-319, palign = 0x10002 <Address 0x10002 out of bounds>} ber = (BerElement *) 0x8c0face4 a = (Attribute *) 0x0 i = -1945129248 j = 0 rc = 118 bytes = 1030648675 edn = 0x881dc227 "reqStart=20080331134601.000004Z,cn=log" userattrs = 1 acl_state = {as_recorded = 0, as_vd_acl = 0x0, as_vi_acl = 0x0, as_vd_acl_mask = 0, as_vd_acl_matches = {{rm_so = 0, rm_eo = 0} <repeats 100 times>}, as_vd_acl_count = 0, as_vd_access = 0x0, as_vd_access_count = 0, as_result = 0, as_vd_ad = 0x0} attrsonly = 0 ad_entry = (AttributeDescription *) 0x816cd90 e_flags = (char **) 0x0 #4 0xb7a098e8 in syncprov_sendresp (op=0x8c0fb0c0, opc=0x8c0faf6c, so=0x8262030, e=0x8c0faf98, mode=3) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:798 on = (slap_overinst *) 0x81bec18 rs = {sr_type = REP_SEARCH, sr_tag = 0, sr_msgid = 0, sr_err = 0, sr_matched = 0x0, sr_text = 0x0, sr_ref = 0x0, sr_ctrls = 0x8c0faee8, sr_un = {sru_sasl = {r_sasldata = 0x8c0faeb8}, sru_extended = {r_rspoid = 0x8c0faeb8 "", r_rspdata = 0x21}, sru_search = {r_entry = 0x8c0faeb8, r_attr_flags = 33, r_operational_attrs = 0x0, r_attrs = 0x0, r_nentries = 0, r_v2ref = 0x0}}, sr_flags = 0} ctrls = {0x8acf8024, 0x0} cookie = {bv_len = 12, bv_val = 0x8acf800c "csn=,rid=001"} e_uuid = {e_id = 0, e_name = {bv_len = 38, bv_val = 0x881dc200 "reqStart=20080331134601.000004Z,cn=log"}, e_nname = {bv_len = 38, bv_val = 0x881dc227 "reqStart=20080331134601.000004Z,cn=log"}, e_attrs = 0x0, e_ocflags = 0, e_bv = {bv_len = 0, bv_val = 0x0}, e_private = 0x0} a_uuid = {a_desc = 0x8169d00, a_vals = 0x0, a_nvals = 0x8c0faf84, a_next = 0x0, a_flags = 0} __PRETTY_FUNCTION__ = "syncprov_sendresp" #5 0xb7a09b5b in syncprov_qplay (op=0x8c0fb0c0, on=0x81bec18, so=0x8262030) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:853 sr = (syncres *) 0x881dc1d8 e = (Entry *) 0x0 opc = {son = 0x81bec18, smatches = 0x7, sdn = {bv_len = 38, bv_val = 0x881dc200 "reqStart=20080331134601.000004Z,cn=log"}, sndn = {bv_len = 38, bv_val = 0x881dc227 "reqStart=20080331134601.000004Z,cn=log"}, suuid = {bv_len = 16, bv_val = 0x881dc24e "\214(g�\223t\020,\206∑o_�K_◊0"}, sctxcsn = {bv_len = 0, bv_val = 0x881dc25f ""}, sreference = 0} rc = 0 #6 0xb7a09d20 in syncprov_qtask (ctx=0x8c0fb2b4, arg=0x8db02300) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:898 rtask = (struct re_s *) 0x8db02300 so = (syncops *) 0x8262030 on = (slap_overinst *) 0x81bec18 opbuf = {buffer = "\220�\017\214c\000\000\000�\\\003H\000\000\000\000��\017\214\006\000\000\000�\"&\b\006\000\000\000∞\"&\b\002\000\000\000\000\000\000\000ˇˇˇˇˇˇˇˇ\024�\033\b\000\000\000\000�!&\b�˝%\b.\000\000\000∑\"&\b", '\0' <repeats 12 times>, "\001", '\0' <repeats 39 times>, "��\017\214\200", '\0' <repeats 11 times>, "\025\000\000\000\223\"&\b\025\000\000\000\223\"&\b", '\0' <repeats 48 times>, "\001\000\000\000\t\000\000\000X�8\220\002\000\000\000\003\000\000\000\000\000\000\000�≤\017\214Pm)\b�⁄\025\bconn=9 op=1", '\0' <repeats 172 times>, ialign = -1945128560, lalign = -1945128560, falign = -1.10697526e-31, dalign = 2.1123855789828658e-312, palign = 0x8c0fb190 "\001"} op = (Operation *) 0x8c0fb0c0 be = {bd_info = 0x81beb18, be_ctrls = "\000\001\001\001\000\000\001\000\001\000\001\001\001\000\001", '\0' <repeats 17 times>, "\001", be_flags = 256, be_restrictops = 0, be_requires = 0, be_ssf_set = {sss_ssf = 0, sss_transport = 0, sss_tls = 0, sss_sasl = 0, sss_update_ssf = 0, sss_update_transport = 0, sss_update_tls = 0, sss_update_sasl = 0, sss_simple_bind = 0}, be_suffix = 0x81be8e0, be_nsuffix = 0x81be8f8, be_schemadn = {bv_len = 0, bv_val = 0x0}, be_schemandn = {bv_len = 0, bv_val = 0x0}, be_rootdn = {bv_len = 14, bv_val = 0x81be798 "cn=root,cn=log"}, be_rootndn = {bv_len = 14, bv_val = 0x81be980 "cn=root,cn=log"}, be_rootpw = {bv_len = 0, bv_val = 0x0}, be_max_deref_depth = 15, be_def_limit = {lms_t_soft = 3600, lms_t_hard = 0, lms_s_soft = 500, lms_s_hard = 0, lms_s_unchecked = -1, lms_s_pr = 0, lms_s_pr_hide = 0, lms_s_pr_total = 0}, be_limits = 0x81be970, be_acl = 0x81ae418, be_dfltaccess = ACL_READ, be_replica = 0x0, be_replogfile = 0x0, be_update_ndn = {bv_len = 0, bv_val = 0x0}, be_update_refs = 0x0, be_pending_csn_list = 0x8237f48, be_pcl_mutex = {__m_reserved = 0, __m_count = 0, __m_owner = 0x0, __m_kind = 0, __m_lock = {__status = 0, __spinlock = 0}}, be_pcl_mutexp = 0x81be5f8, be_syncinfo = 0x0, be_pb = 0x0, be_cf_ocs = 0xb7a44ce0, be_private = 0x81be630, be_next = {stqe_next = 0x81bee50}} rc = -1208475305 #7 0xb7f80fd9 in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:478 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x8310ec8 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x8296d50, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0xa0, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x8a4f7008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x4a, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2349841328 i = 518 keyslot = 518 hash = 518 #8 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #9 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 7 (Thread -1922040912 (LWP 13704)): #0 0xb7d13c01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f8106a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x8261fe0, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8238260, ltk_data = 0x48, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x8240a18, ltk_data = 0x57, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x8c9fe008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2372926384 i = 679 keyslot = 679 hash = 679 #3 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 6 (Thread -1917846608 (LWP 13701)): #0 0xb7c02947 in raise () from /lib/tls/libc.so.6 No symbol table info available. #1 0xb7c040c9 in abort () from /lib/tls/libc.so.6 No symbol table info available. #2 0xb7bfc05f in __assert_fail () from /lib/tls/libc.so.6 No symbol table info available. #3 0x08071d03 in connection_destroy (c=0x90389f78) at /var/jwm/o2/openldap/servers/slapd/connection.c:680 sd = -2049090272 connid = 2377118104 close_reason = 0xb7c40022 "e\203=\f" sb = (Sockbuf *) 0x8a300010 __PRETTY_FUNCTION__ = "connection_destroy" #4 0x080726ab in connection_close (c=0x90389f78) at /var/jwm/o2/openldap/servers/slapd/connection.c:900 sd = -1 __PRETTY_FUNCTION__ = "connection_close" #5 0x080740bd in connection_resched (conn=0x90389f78) at /var/jwm/o2/openldap/servers/slapd/connection.c:1722 sd = 33 op = (Operation *) 0xb7fb8478 __PRETTY_FUNCTION__ = "connection_resched" #6 0x08073009 in connection_operation (ctx=0x8daff2b4, arg_v=0x8a30deb8) at /var/jwm/o2/openldap/servers/slapd/connection.c:1179 rc = 0 op = (Operation *) 0x8a30deb8 rs = {sr_type = REP_RESULT, sr_tag = 0, sr_msgid = 0, sr_err = 0, sr_matched = 0x0, sr_text = 0x0, sr_ref = 0x0, sr_ctrls = 0x0, sr_un = {sru_sasl = {r_sasldata = 0x0}, sru_extended = {r_rspoid = 0x0, r_rspdata = 0x0}, sru_search = {r_entry = 0x0, r_attr_flags = 0, r_operational_attrs = 0x0, r_attrs = 0x0, r_nentries = 0, r_v2ref = 0x0}}, sr_flags = 0} tag = 66 opidx = SLAP_OP_UNBIND conn = (Connection *) 0x90389f78 memctx = (void *) 0x824eef0 memctx_null = (void *) 0x0 memsiz = 1048576 __PRETTY_FUNCTION__ = "connection_operation" #7 0xb7f80fd9 in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:478 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x8242fe0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x824eef0, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0x58, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x8c0fc008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x49, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2377120688 i = 743 keyslot = 743 hash = 743 #8 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #9 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 5 (Thread -1538593872 (LWP 13662)): #0 0xb7d16189 in __lll_mutex_lock_wait () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7d12f6d in _L_mutex_lock_29 () from /lib/tls/libpthread.so.0 No symbol table info available. #2 0xa44ac278 in ?? () No symbol table info available. #3 0x00000021 in ?? () No symbol table info available. #4 0xa44ac298 in ?? () No symbol table info available. #5 0xb7d1639a in __write_nocancel () from /lib/tls/libpthread.so.0 No symbol table info available. #6 0xb7fb8478 in ?? () from /usr/lib/libldap_r-2.3.so.0 No symbol table info available. #7 0x00000021 in ?? () No symbol table info available. #8 0x00000084 in ?? () No symbol table info available. #9 0xa44ac298 in ?? () No symbol table info available. #10 0xb7f82111 in ldap_pvt_thread_mutex_lock (mutex=0x9038a028) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:333 No locals. #11 0xb7f82111 in ldap_pvt_thread_mutex_lock (mutex=0x9038a028) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:333 No locals. #12 0x08072431 in connection_closing (c=0x90389f78, why=0x8116ac0 "connection lost") at /var/jwm/o2/openldap/servers/slapd/connection.c:851 sd = 33 __PRETTY_FUNCTION__ = "connection_closing" #13 0x08073928 in connection_read (s=33) at /var/jwm/o2/openldap/servers/slapd/connection.c:1457 rc = -2 c = (Connection *) 0x90389f78 __PRETTY_FUNCTION__ = "connection_read" #14 0x0807014a in slapd_daemon_task (ptr=0x0) at /var/jwm/o2/openldap/servers/slapd/daemon.c:2468 rc = 1 fd = 33 ns = 1 at = 0 nfds = 9 revents = (struct epoll_event *) 0xb7b60008 tvp = (struct timeval *) 0xa44ae3a4 cat = {tv_sec = 1208266580, tv_usec = 0} i = 0 nwriters = 3 now = 1208266286 tv = {tv_sec = 294, tv_usec = 0} tdelta = 1 rtask = (struct re_s *) 0x81bea68 l = 4 last_idle_check = 0 idle = {tv_sec = 0, tv_usec = 0} ebadf = 0 #15 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #16 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 4 (Thread -1875350608 (LWP 13663)): #0 0xb7d13c01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f8106a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x824b618, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8238260, ltk_data = 0x2c, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x8ee85008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8240a18, ltk_data = 0x50, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2419616688 i = 483 keyslot = 483 hash = 483 #3 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 3 (Thread -1879544912 (LWP 13664)): #0 bdb_delete (op=0x8ff85f54, rs=0x8ff85f18) at /var/jwm/o2/openldap/servers/slapd/back-bdb/delete.c:27 bdb = (struct bdb_info *) 0x81be630 matched = (Entry *) 0x8ff85f54 pdn = {bv_len = 6, bv_val = 0x865fd8f0 "cn=log"} e = (Entry *) 0x821d9880 p = (Entry *) 0x0 ei = (EntryInfo *) 0x8a309750 eip = (EntryInfo *) 0x8000 manageDSAit = 0 children = (AttributeDescription *) 0x816cf20 entry = (AttributeDescription *) 0x816cd90 ltid = (DB_TXN *) 0x44 lt2 = (DB_TXN *) 0x809a1f58 opinfo = {boi_bdb = 0x8ff85f54, boi_txn = 0x8ed8cc0c, boi_err = 1, boi_locker = 135247857, boi_acl_cache = 0, boi_locks = 0x0} eid = 213912 locker = 136047640 lock = {off = 0, ndx = 2415419220, gen = 2415418584, mode = 3080766465} plock = {off = 2396572940, ndx = 0, gen = 2415418456, mode = 3080782120} num_retries = 136047896 rc = -1898394628 preread_ctrl = (LDAPControl **) 0x8ed8cc0c ctrls = {0x0, 0x821d9a68, 0x0, 0x0, 0x8ff85d28, 0xb7f820cb} num_ctrls = 1 parent_is_glue = 68 parent_is_leaf = -2053373400 #1 0x080ded7e in overlay_op_walk (op=0x8ff85f54, rs=0x8ff85f18, which=op_delete, oi=0x81beb18, on=0x0) at /var/jwm/o2/openldap/servers/slapd/backover.c:650 func = (BI_op_bind **) 0xb7a44e0c rc = 32768 #2 0x080def35 in over_op_func (op=0x8ff85f54, rs=0x8ff85f18, which=op_delete) at /var/jwm/o2/openldap/servers/slapd/backover.c:702 oi = (slap_overinfo *) 0x81beb18 on = (slap_overinst *) 0x81bec18 be = (BackendDB *) 0x81be528 db = {bd_info = 0xb7a44de0, be_ctrls = "\000\001\001\001\000\000\001\000\001\000\001\001\001\000\001", '\0' <repeats 17 times>, "\001", be_flags = 256, be_restrictops = 0, be_requires = 0, be_ssf_set = {sss_ssf = 0, sss_transport = 0, sss_tls = 0, sss_sasl = 0, sss_update_ssf = 0, sss_update_transport = 0, sss_update_tls = 0, sss_update_sasl = 0, sss_simple_bind = 0}, be_suffix = 0x81be8e0, be_nsuffix = 0x81be8f8, be_schemadn = {bv_len = 0, bv_val = 0x0}, be_schemandn = {bv_len = 0, bv_val = 0x0}, be_rootdn = {bv_len = 14, bv_val = 0x81be798 "cn=root,cn=log"}, be_rootndn = {bv_len = 14, bv_val = 0x81be980 "cn=root,cn=log"}, be_rootpw = {bv_len = 0, bv_val = 0x0}, be_max_deref_depth = 15, be_def_limit = {lms_t_soft = 3600, lms_t_hard = 0, lms_s_soft = 500, lms_s_hard = 0, lms_s_unchecked = -1, lms_s_pr = 0, lms_s_pr_hide = 0, lms_s_pr_total = 0}, be_limits = 0x81be970, be_acl = 0x81ae418, be_dfltaccess = ACL_READ, be_replica = 0x0, be_replogfile = 0x0, be_update_ndn = {bv_len = 0, bv_val = 0x0}, be_update_refs = 0x0, be_pending_csn_list = 0x8237f48, be_pcl_mutex = {__m_reserved = 0, __m_count = 0, __m_owner = 0x0, __m_kind = 0, __m_lock = {__status = 0, __spinlock = 0}}, be_pcl_mutexp = 0x81be5f8, be_syncinfo = 0x0, be_pb = 0x0, be_cf_ocs = 0xb7a44ce0, be_private = 0x81be630, be_next = {stqe_next = 0x81bee50}} cb = {sc_next = 0xb7a19e20, sc_response = 0x80de204 <over_back_response>, sc_cleanup = 0, sc_private = 0x81beb18} rc = 32768 __PRETTY_FUNCTION__ = "over_op_func" #3 0x080df063 in over_op_delete (op=0x8ff85f54, rs=0x8ff85f18) at /var/jwm/o2/openldap/servers/slapd/backover.c:754 No locals. #4 0xb7a13496 in accesslog_purge (ctx=0x8ff862b4, arg=0x81bfb60) at /var/jwm/o2/openldap/servers/slapd/overlays/accesslog.c:589 i = 80 rtask = (struct re_s *) 0x81bfb60 li = (struct log_info *) 0x81c03e0 conn = {c_struct_state = 0, c_conn_state = 0, c_conn_idx = 0, c_close_reason = 0x0, c_mutex = {__m_reserved = 0, __m_count = 0, __m_owner = 0x0, __m_kind = 0, __m_lock = {__status = 0, __spinlock = 0}}, c_sb = 0x0, c_starttime = 0, c_activitytime = 0, c_connid = 4294967295, c_peer_domain = {bv_len = 0, bv_val = 0x8111618 ""}, c_peer_name = {bv_len = 0, bv_val = 0x8111618 ""}, c_listener = 0x81174e0, c_sasl_bind_in_progress = 0, c_sasl_bind_mech = {bv_len = 0, bv_val = 0x0}, c_sasl_dn = {bv_len = 0, bv_val = 0x0}, c_sasl_authz_dn = {bv_len = 0, bv_val = 0x0}, c_authz_backend = 0x0, c_authz_cookie = 0x0, c_authz = {sai_method = 0, sai_mech = {bv_len = 0, bv_val = 0x0}, sai_dn = {bv_len = 0, bv_val = 0x0}, sai_ndn = {bv_len = 0, bv_val = 0x0}, sai_ssf = 0, sai_transport_ssf = 0, sai_tls_ssf = 0, sai_sasl_ssf = 0}, c_protocol = 0, c_ops = {stqh_first = 0x0, stqh_last = 0x0}, c_pending_ops = {stqh_first = 0x0, stqh_last = 0x0}, c_write_mutex = {__m_reserved = 0, __m_count = 0, __m_owner = 0x0, __m_kind = 0, __m_lock = {__status = 0, __spinlock = 0}}, c_write_cv = {__c_lock = {__status = 0, __spinlock = 0}, __c_waiting = 0x0, __padding = '\0' <repeats 27 times>, __align = 0}, c_currentber = 0x0, c_writewaiter = 0, c_is_tls = 0, c_needs_tls_accept = 0, c_sasl_layers = 0, c_sasl_done = 0, c_sasl_authctx = 0x0, c_sasl_sockctx = 0x0, c_sasl_extra = 0x0, c_sasl_bindop = 0x0, c_pagedresults_state = {ps_be = 0x0, ps_size = 0, ps_cookie = 0, ps_count = 0}, c_n_ops_received = 0, c_n_ops_executing = 0, c_n_ops_pending = 0, c_n_ops_completed = 0, c_n_get = 0, c_n_read = 0, c_n_write = 0, c_pb = 0x0, c_extensions = 0x0, c_clientfunc = 0, c_clientarg = 0x0, c_send_ldap_result = 0x8084ab6 <slap_send_ldap_result>, c_send_search_entry = 0x8085754 <slap_send_search_entry>, c_send_search_reference = 0x80875cd <slap_send_search_reference>, c_send_ldap_extended = 0, c_send_ldap_intermediate = 0} opbuf = {buffer = "$`�\217J\000\000\000(�\004H\000\000\000\000(]�\217&\000\000\000�b�\205&\000\000\000X�\000\202\001\000\000\000\000\000\000\000ˇˇˇˇˇˇˇˇ\000\000\000\000\001\000\000\000 �\025\b�^�\217\033\000\000\000\f@�\216", '\0' <repeats 52 times>, "\200`�\217", '\0' <repeats 12 times>, "\016\000\000\000\230�\033\b\016\000\000\000\200�\033\b", '\0' <repeats 24 times>, "���\216\000\000\000\000 \000\000\000\202^�\217", '\0' <repeats 12 times>, "ˇˇˇˇ\000a�\217", '\0' <repeats 12 times>, "�b�\217\000\003%\b�⁄\025\bconn=-1 op=0", '\0' <repeats 171 times>, ialign = -1879547868, lalign = -1879547868, falign = -2.44917201e-29, dalign = 1.5822106429110247e-312, palign = 0x8ff86024 ""} op = (Operation *) 0x8ff85f54 rs = {sr_type = REP_RESULT, sr_tag = 107, sr_msgid = 0, sr_err = 0, sr_matched = 0x0, sr_text = 0x0, sr_ref = 0x0, sr_ctrls = 0x0, sr_un = {sru_sasl = {r_sasldata = 0x0}, sru_extended = {r_rspoid = 0x0, r_rspdata = 0x0}, sru_search = {r_entry = 0x0, r_attr_flags = 0, r_operational_attrs = 0x0, r_attrs = 0x815d820, r_nentries = 0, r_v2ref = 0x0}}, sr_flags = 0} cb = {sc_next = 0x0, sc_response = 0xb7a12f75 <log_old_lookup>, sc_cleanup = 0, sc_private = 0x8ff85ed8} f = {f_choice = 166, f_un = {f_un_result = -1879548176, f_un_dn = 0x8ff85ef0, f_un_desc = 0x8ff85ef0, f_un_ava = 0x8ff85ef0, f_un_ssa = 0x8ff85ef0, f_un_mra = 0x8ff85ef0, f_un_complex = 0x8ff85ef0}, f_next = 0x0} ava = {aa_desc = 0x81a8cc8, aa_value = {bv_len = 15, bv_val = 0x8ff85ec2 "20080401133120Z"}} pd = {slots = 11100, used = 11024, dn = 0x80770630, ndn = 0x807ab2e8, csn = {bv_len = 32, bv_val = 0x8ff85e82 "20080331133120Z#000000#00#00000008x\204˚∑�^�\217\220\027�∑∞k�\217∞k�\217"}} timebuf = "20080401133120Z\000�∑\020\0000\212" csnbuf = "20080331133120Z#000000#00#00000008x\204˚∑�^�\217\220\027�∑∞k�\217∞k�\217\000\000\000\000\000\000\000\000�b" old = 1207056680 #5 0xb7f80fd9 in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:478 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x825eef8 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x8250300, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0x46, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x8dc81008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x43, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2415422384 i = 674 keyslot = 674 hash = 674 #6 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #7 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 2 (Thread -1883739216 (LWP 13665)): #0 0xb7d16189 in __lll_mutex_lock_wait () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7d18192 in _L_mutex_cond_lock_29 () from /lib/tls/libpthread.so.0 No symbol table info available. #2 0x0000002c in ?? () No symbol table info available. #3 0x00000076 in ?? () No symbol table info available. #4 0x0000005c in ?? () No symbol table info available. #5 0xb7d12e17 in pthread_mutex_lock () from /lib/tls/libpthread.so.0 No symbol table info available. #6 0xb7d13c8b in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #7 0xb7f820a0 in ldap_pvt_thread_cond_wait (cond=0x9038a040, mutex=0x90389f88) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #8 0x08083dcc in send_ldap_ber (conn=0x90389f78, ber=0x8fb85ce4) at /var/jwm/o2/openldap/servers/slapd/result.c:198 err = 11 sd = 33 bytes = 118 #9 0x080871db in slap_send_search_entry (op=0x8fb860c0, rs=0x8fb85ef0) at /var/jwm/o2/openldap/servers/slapd/result.c:1137 berbuf = {buffer = "\002\000\001\000\000\000\000\000ˇˇˇˇ\000\000\000\000\000\000\000\000$A�\216\232A�\216RQ�\216\000\000\000\000nA�\216�7%\b@]∏\217(0�\216\001\000\000\0008]∏\217�^∏\217\005^∏\217ˇˇˇˇ\000\000\000\000ˇˇˇˇ\a\000\000\000\020\000\000\000\026�8\206\000\000\001\000\000\000\000\000ˇˇˇˇ", '\0' <repeats 12 times>, "\2010�\2168@�\216\000\000\000\000\000\000\000\000�7%\b���∑\030\000\000\000�7%\bHRQ\f\000\000\000\000\f0�\216�F�∑\b^∏\217r\222�∑\220a∏\217�^∏\217�]∏\217���∑\f0�\216�]∏\217\f\000\000\000\000\000"..., ialign = 65538, lalign = 65538, falign = 9.18382988e-41, dalign = 3.2380074297143616e-319, palign = 0x10002 <Address 0x10002 out of bounds>} ber = (BerElement *) 0x8fb85ce4 a = (Attribute *) 0x0 i = -1883742496 j = 0 rc = 118 bytes = 1030648675 edn = 0x86389fef "reqStart=20080331134601.000004Z,cn=log" userattrs = 1 acl_state = {as_recorded = 0, as_vd_acl = 0x0, as_vi_acl = 0x0, as_vd_acl_mask = 0, as_vd_acl_matches = {{rm_so = 0, rm_eo = 0} <repeats 100 times>}, as_vd_acl_count = 0, as_vd_access = 0x0, as_vd_access_count = 0, as_result = 0, as_vd_ad = 0x0} attrsonly = 0 ad_entry = (AttributeDescription *) 0x816cd90 e_flags = (char **) 0x0 #10 0xb7a098e8 in syncprov_sendresp (op=0x8fb860c0, opc=0x8fb85f6c, so=0x825fb18, e=0x8fb85f98, mode=3) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:798 on = (slap_overinst *) 0x81bec18 rs = {sr_type = REP_SEARCH, sr_tag = 0, sr_msgid = 0, sr_err = 0, sr_matched = 0x0, sr_text = 0x0, sr_ref = 0x0, sr_ctrls = 0x8fb85ee8, sr_un = {sru_sasl = {r_sasldata = 0x8fb85eb8}, sru_extended = {r_rspoid = 0x8fb85eb8 "", r_rspdata = 0x21}, sru_search = {r_entry = 0x8fb85eb8, r_attr_flags = 33, r_operational_attrs = 0x0, r_attrs = 0x0, r_nentries = 0, r_v2ref = 0x0}}, sr_flags = 0} ctrls = {0x8ec83024, 0x0} cookie = {bv_len = 12, bv_val = 0x8ec8300c "csn=,rid=001"} e_uuid = {e_id = 0, e_name = {bv_len = 38, bv_val = 0x86389fc8 "reqStart=20080331134601.000004Z,cn=log"}, e_nname = {bv_len = 38, bv_val = 0x86389fef "reqStart=20080331134601.000004Z,cn=log"}, e_attrs = 0x0, e_ocflags = 0, e_bv = {bv_len = 0, bv_val = 0x0}, e_private = 0x0} a_uuid = {a_desc = 0x8169d00, a_vals = 0x0, a_nvals = 0x8fb85f84, a_next = 0x0, a_flags = 0} __PRETTY_FUNCTION__ = "syncprov_sendresp" #11 0xb7a09b5b in syncprov_qplay (op=0x8fb860c0, on=0x81bec18, so=0x825fb18) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:853 sr = (syncres *) 0x86389fa0 e = (Entry *) 0x0 opc = {son = 0x81bec18, smatches = 0x7, sdn = {bv_len = 38, bv_val = 0x86389fc8 "reqStart=20080331134601.000004Z,cn=log"}, sndn = {bv_len = 38, bv_val = 0x86389fef "reqStart=20080331134601.000004Z,cn=log"}, suuid = {bv_len = 16, bv_val = 0x8638a016 "\214(g�\223t\020,\206∑o_�K_◊0"}, sctxcsn = {bv_len = 0, bv_val = 0x8638a027 ""}, sreference = 0} rc = 0 #12 0xb7a09d20 in syncprov_qtask (ctx=0x8fb862b4, arg=0x8db02330) at /var/jwm/o2/openldap/servers/slapd/overlays/syncprov.c:898 rtask = (struct re_s *) 0x8db02330 so = (syncops *) 0x825fb18 on = (slap_overinst *) 0x81bec18 opbuf = {buffer = "\220a∏\217c\000\000\000�\\\003H\000\000\000\000�_∏\217\006\000\000\000\221˝%\b\006\000\000\000\230˝%\b\002\000\000\000\000\000\000\000ˇˇˇˇˇˇˇˇ\024�\033\b\000\000\000\000\224�%\bH�%\b.\000\000\000\237˝%\b", '\0' <repeats 12 times>, "\001", '\0' <repeats 39 times>, "�a∏\217\200", '\0' <repeats 11 times>, "\025\000\000\000{˝%\b\025\000\000\000{˝%\b", '\0' <repeats 48 times>, "\001\000\000\000\a\000\000\000x\2378\220\002\000\000\000\003\000\000\000\000\000\000\000�b∏\217�7%\b�⁄\025\bconn=7 op=1", '\0' <repeats 172 times>, ialign = -1883741808, lalign = -1883741808, falign = -1.81813805e-29, dalign = 2.1126888698355955e-312, palign = 0x8fb86190 "\001"} op = (Operation *) 0x8fb860c0 be = {bd_info = 0x81beb18, be_ctrls = "\000\001\001\001\000\000\001\000\001\000\001\001\001\000\001", '\0' <repeats 17 times>, "\001", be_flags = 256, be_restrictops = 0, be_requires = 0, be_ssf_set = {sss_ssf = 0, sss_transport = 0, sss_tls = 0, sss_sasl = 0, sss_update_ssf = 0, sss_update_transport = 0, sss_update_tls = 0, sss_update_sasl = 0, sss_simple_bind = 0}, be_suffix = 0x81be8e0, be_nsuffix = 0x81be8f8, be_schemadn = {bv_len = 0, bv_val = 0x0}, be_schemandn = {bv_len = 0, bv_val = 0x0}, be_rootdn = {bv_len = 14, bv_val = 0x81be798 "cn=root,cn=log"}, be_rootndn = {bv_len = 14, bv_val = 0x81be980 "cn=root,cn=log"}, be_rootpw = {bv_len = 0, bv_val = 0x0}, be_max_deref_depth = 15, be_def_limit = {lms_t_soft = 3600, lms_t_hard = 0, lms_s_soft = 500, lms_s_hard = 0, lms_s_unchecked = -1, lms_s_pr = 0, lms_s_pr_hide = 0, lms_s_pr_total = 0}, be_limits = 0x81be970, be_acl = 0x81ae418, be_dfltaccess = ACL_READ, be_replica = 0x0, be_replogfile = 0x0, be_update_ndn = {bv_len = 0, bv_val = 0x0}, be_update_refs = 0x0, be_pending_csn_list = 0x8237f48, be_pcl_mutex = {__m_reserved = 0, __m_count = 0, __m_owner = 0x0, __m_kind = 0, __m_lock = {__status = 0, __spinlock = 0}}, be_pcl_mutexp = 0x81be5f8, be_syncinfo = 0x0, be_pb = 0x0, be_cf_ocs = 0xb7a44ce0, be_private = 0x81be630, be_next = {stqe_next = 0x81bee50}} rc = -1208475305 #13 0xb7f80fd9 in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:478 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x82604e8 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x82537d0, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8240a18, ltk_data = 0x47, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0xb7a2fe55, ltk_data = 0x8e482008, ltk_free = 0xb7a2fe2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x42, ltk_free = 0xb7a3e64d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2411228080 i = 610 keyslot = 610 hash = 610 #14 0xb7d110bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #15 0xb7ca601e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 1 (Thread -1212397344 (LWP 13658)): #0 0xb7d12183 in pthread_join () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f81f9b in ldap_pvt_thread_join (thread=2756373424, thread_return=0x0) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:193 No locals. #2 0x08070524 in slapd_daemon () at /var/jwm/o2/openldap/servers/slapd/daemon.c:2579 listener_tid = 2756373424 rc = 0 #3 0x0805a58d in main (argc=9, argv=0xbffb3d54) at /var/jwm/o2/openldap/servers/slapd/main.c:859 i = 9 no_detach = 0 rc = 0 urls = 0x8162008 "ldap:/// ldaps:///" username = 0x8162030 "gidNumber" groupname = 0x8162020 "\202��∑∞�\237∑" sandbox = 0x0 syslogUser = 160 g_argc = 9 g_argv = (char **) 0xbffb3d54 configfile = 0x8162040 "/etc/ldap/slapd.conf.master" configdir = 0x0 serverName = 0xbffb3ea7 "slapd" serverMode = 1 scp = (struct sync_cookie *) 0x0 scp_entry = (struct sync_cookie *) 0x0 debug_unknowns = (char **) 0x0 syslog_unknowns = (char **) 0x0 serverNamePrefix = 0x81112bb "" l = 3086380280 slapd_pid_file_unlink = 1 slapd_args_file_unlink = 1 __PRETTY_FUNCTION__ = "main" #0 0xb7c02947 in raise () from /lib/tls/libc.so.6 # This is the main slapd configuration file. See slapd.conf(5) for more # info on the configuration options. include /etc/ldap/schema/core.schema include /etc/ldap/schema/cosine.schema include /etc/ldap/schema/nis.schema include /etc/ldap/schema/inetorgperson.schema include /etc/ldap/schema/qmail.schema include /etc/ldap/schema/radius.schema include /etc/ldap/schema/isis.schema pidfile /var/run/slapd/slapd.pid argsfile /var/run/slapd/slapd.args loglevel 0 modulepath /usr/lib/ldap moduleload back_monitor moduleload back_bdb moduleload accesslog moduleload syncprov moduleload pw-netscape threads 32 # Number of threads to use with tools (slapindex, etc.) tool-threads 1 allow bind_v2 TLSCACertificateFile /etc/ldap/isis-ca.pem TLSCertificateFile /etc/ldap/slapd.crt TLSCertificateKeyFile /etc/ldap/slapd.key password-hash {CRYPT} # Use MD5-based crypt(3) password-crypt-salt-format $1$%.8s sizelimit 500 # Enable the monitor (cn=Monitor) backend. database monitor # The log database, for delta-syncrepl. database bdb suffix cn=log directory /var/lib/ldap/log cachesize 10000 checkpoint 5000 5 rootdn cn=root,cn=log limits dn.exact=cn=replica,o=org size=unlimited time=unlimited index objectClass,entryCSN,entryUUID eq index reqStart,reqEnd,reqResult eq overlay syncprov syncprov-checkpoint 100 5 syncprov-reloadhint true syncprov-nopresent true # The main database. database bdb suffix o=org directory /var/lib/ldap cachesize 10000 checkpoint 5000 5 replogfile /var/lib/ldap/replog replica host=172.16.4.10:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.4.11:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.4.12:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.4.13:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.5.81:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.5.82:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.5.83:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.5.84:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.5.85:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] replica host=172.16.5.86:389 binddn=cn=replica,o=org bindmethod=simple credentials=[elided] rootdn cn=root,o=org rootpw [elided] limits dn.exact=cn=replica,o=org size=unlimited time=unlimited index entryCSN,entryUUID eq index objectClass,accountStatus,group eq index uid,sn,businessName eq,subany index mail,mailAlternateAddress eq index uidNumber,gidNumber eq index parent eq index billingTelephoneNumber,telephoneNumber eq,subany index fictitiousTelephoneNumber eq,subany index filterName subany index hasPriv pres,eq index dslCircuitId eq,subany index statusChangeTimestamp,scheduledStatusChange eq index outsideAgent eq index radiusFramedIPAddress eq index lanNetwork eq,subany index routerName,routerInterface eq index serviceType,billingType eq index realm eq index accountUniqueID eq index domainNames pres,eq index dc pres,eq index registrationType,orderId,registrationStatus eq overlay syncprov syncprov-checkpoint 100 10 syncprov-sessionlog 100 syncprov-reloadhint true overlay accesslog logdb cn=log logops writes logsuccess true # Scan the log DB every day, and purge entries older than 14 days. logpurge 14+00:00 01+00:00
--On Tuesday, April 15, 2008 5:33 PM +0000 jwm@horde.net wrote: > moduleload pw-netscape What is this? > threads 32 How many CPUs does your server have? This is a particularly high thread setting. Most often, a lower setting results in better performance (I generally use 8 threads on dual-CPU systems). Having too many threads has resulted in strange behavior for me in the past as well. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration
On Tue, Apr 15, 2008 at 11:12:20AM -0700, Quanah Gibson-Mount wrote: > --On Tuesday, April 15, 2008 5:33 PM +0000 jwm@horde.net wrote: > > moduleload pw-netscape > > What is this? http://www.openldap.org/devel/cvsweb.cgi/contrib/slapd-modules/passwd/netscape.c > > threads 32 > > How many CPUs does your server have? Two physical cores, four if you count x86 hyperthread "processors." > This is a particularly high thread setting. Most often, a lower setting > results in better performance (I generally use 8 threads on dual-CPU > systems). Having too many threads has resulted in strange behavior for me > in the past as well. FWIW, slapd has been rock-solid on this hardware with this (or essentially similar) configuration since before 2.1.30 up through 2.3.30. We skipped forward to 2.3.41, and started seeing these crashes. However, we weren't using syncrepl until 2.3.41, either. john -- John Morrissey _o /\ ---- __o jwm@horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__
--On Tuesday, April 15, 2008 3:49 PM -0400 John Morrissey <jwm@horde.net> wrote: > On Tue, Apr 15, 2008 at 11:12:20AM -0700, Quanah Gibson-Mount wrote: >> --On Tuesday, April 15, 2008 5:33 PM +0000 jwm@horde.net wrote: >> > moduleload pw-netscape >> >> What is this? > > http://www.openldap.org/devel/cvsweb.cgi/contrib/slapd-modules/passwd/net > scape.c > >> > threads 32 >> >> How many CPUs does your server have? > > Two physical cores, four if you count x86 hyperthread "processors." So two. ;) You could set tool-threads to 2 then, it'd increase slapadds if you ever do them. >> This is a particularly high thread setting. Most often, a lower setting >> results in better performance (I generally use 8 threads on dual-CPU >> systems). Having too many threads has resulted in strange behavior for >> me in the past as well. > > FWIW, slapd has been rock-solid on this hardware with this (or essentially > similar) configuration since before 2.1.30 up through 2.3.30. We skipped > forward to 2.3.41, and started seeing these crashes. However, we weren't > using syncrepl until 2.3.41, either. Yeah, just noting my past experience. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration
jwm@horde.net wrote: > Full_Name: John Morrissey > Version: 2.3.41 > OS: Linux > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (66.133.190.110) > > OK, the backtraces helped a lot. Thread 6 hit the assertion while trying to close the connection, and thread 5 was already trying to close the connection. And Thread 5 was waiting for thread 2 to wake up and give up the connection handle. Seems like a bug in connection.c, aggravated by the presence of persistent searches on the connection. > (continuing the openldap-software thread starting at > http://marc.info/?l=openldap-software&m=120654684131594&w=2) > > An assertion failure causes slapd to crash every few days in our environment. > The assertion seems to be in servers/slapd/connection.s:680: > > assert( c->c_writewaiter == 0); > -- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/
Howard Chu wrote: > jwm@horde.net wrote: >> Full_Name: John Morrissey >> Version: 2.3.41 >> OS: Linux >> URL: ftp://ftp.openldap.org/incoming/ >> Submission from: (NULL) (66.133.190.110) >> >> > OK, the backtraces helped a lot. Thread 6 hit the assertion while trying to > close the connection, and thread 5 was already trying to close the connection. > And Thread 5 was waiting for thread 2 to wake up and give up the connection > handle. Seems like a bug in connection.c, aggravated by the presence of > persistent searches on the connection. Please try the patch in slapd/connection.c 1.416 and report your results, thanks. -- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/
changed notes changed state Open to Test moved from Incoming to Software Bugs
On Tue, Apr 15, 2008 at 01:20:58PM -0700, Howard Chu wrote: > Howard Chu wrote: > Please try the patch in slapd/connection.c 1.416 and report your results, > thanks. I patched our local slapd yesterday; I'll let you know in a couple of weeks, once we can be certain that slapd is no longer crashing. john -- John Morrissey _o /\ ---- __o jwm@horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__
--On April 17, 2008 8:11:11 PM +0000 jwm@horde.net wrote: > On Tue, Apr 15, 2008 at 01:20:58PM -0700, Howard Chu wrote: >> Howard Chu wrote: >> Please try the patch in slapd/connection.c 1.416 and report your >> results, thanks. > > I patched our local slapd yesterday; I'll let you know in a couple of > weeks, once we can be certain that slapd is no longer crashing. Hi John, I'm working on putting together OpenLDAP 2.3.42 release, so I was wondering if you've seen any ill effects from this patch. Thanks, Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration
On Mon, Apr 21, 2008 at 09:54:31AM -0700, Quanah Gibson-Mount wrote: > --On April 17, 2008 8:11:11 PM +0000 jwm@horde.net wrote: > >On Tue, Apr 15, 2008 at 01:20:58PM -0700, Howard Chu wrote: > > > Howard Chu wrote: > > > Please try the patch in slapd/connection.c 1.416 and report your > > > results, thanks. > > > > I patched our local slapd yesterday; I'll let you know in a couple of > > weeks, once we can be certain that slapd is no longer crashing. > > I'm working on putting together OpenLDAP 2.3.42 release, so I was wondering > if you've seen any ill effects from this patch. After being up for about a day, our NOC reported that our patched slapd wasn't responding and restarted it. I'm not sure if it really *was* wedged or if they were just confused or trigger-happy, since they didn't do a whole lot of troubleshooting first. The backtrace shows that slapd got a SIGTERM, and that every thread was waiting except for one in epoll_wait(); I'm not sure if that's normal state for an idle slapd. Other than that questionable problem, it's been fine. john Program received signal SIGTERM, Terminated. [Switching to Thread -1212565280 (LWP 26178)] 0xb7ce9183 in pthread_join () from /lib/tls/libpthread.so.0 Thread 14 (Thread 2141186992 (LWP 5848)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x9562048, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0xf5, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x7dbfa008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x42, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2141186992 i = 697 keyslot = 697 hash = 697 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 13 (Thread 2145381296 (LWP 5847)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x9a428f0, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0xf2, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x7e3fb008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x43, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2145381296 i = 761 keyslot = 761 hash = 761 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 12 (Thread -2144339024 (LWP 5846)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x8f497f8, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0xf1, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x7ebfc008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x41, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2150628272 i = 602 keyslot = 602 hash = 602 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 11 (Thread -2125464656 (LWP 5356)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0xcc7c050, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0xed, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x808ff008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x40, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2169502640 i = 635 keyslot = 635 hash = 635 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 10 (Thread -1967129680 (LWP 26656)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x9401ac8, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8238260, ltk_data = 0x3d, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x8247af0, ltk_data = 0xbe, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x89efe008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2327837616 i = 756 keyslot = 756 hash = 756 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 9 (Thread -1936733264 (LWP 26210)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x844f890, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0x83, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x8b3fa008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x3c, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2358234032 i = 662 keyslot = 662 hash = 662 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 8 (Thread -1931486288 (LWP 26209)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x846cae8, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8238260, ltk_data = 0x3a, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x8bcfc008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8247af0, ltk_data = 0x82, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2363481008 i = 758 keyslot = 758 hash = 758 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 7 (Thread -1917846608 (LWP 26208)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x82606a8, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0x7c, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x8cdfe008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x3b, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2377120688 i = 743 keyslot = 743 hash = 743 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 6 (Thread -1884959824 (LWP 26205)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x825cf38, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0x4a, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x8e459008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x34, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2410007472 i = 687 keyslot = 687 hash = 687 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 5 (Thread -1879712848 (LWP 26204)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x825c578, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8247af0, ltk_data = 0x51, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x8dc58008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8238260, ltk_data = 0x38, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2415254448 i = 783 keyslot = 783 hash = 783 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 4 (Thread -1875518544 (LWP 26203)): #0 0xb7ceac01 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f590a0 in ldap_pvt_thread_cond_wait (cond=0x816f374, mutex=0x816f35c) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:299 No locals. #2 0xb7f5806a in ldap_int_thread_pool_wrapper (xpool=0x816f358) at /var/jwm/o2/openldap/libraries/libldap_r/tpool.c:466 pool = (struct ldap_int_thread_pool_s *) 0x816f358 ctx = (ldap_int_thread_ctx_t *) 0x0 ltc_key = {{ltk_key = 0x80cb11d, ltk_data = 0x8259f38, ltk_free = 0x80caf58 <slap_sl_mem_destroy>}, {ltk_key = 0x8238260, ltk_data = 0x1c, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0xb7a06e55, ltk_data = 0x8ee5c008, ltk_free = 0xb7a06e2a <search_stack_free>}, {ltk_key = 0x8247af0, ltk_data = 0x7d, ltk_free = 0xb7a1564d <bdb_locker_id_free>}, {ltk_key = 0x0, ltk_data = 0x0, ltk_free = 0} <repeats 28 times>} tid = 2419448752 i = 592 keyslot = 592 hash = 592 #3 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #4 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 3 (Thread -1538761808 (LWP 26202)): #0 0xb7c7d679 in epoll_wait () from /lib/tls/libc.so.6 No symbol table info available. #1 0x0806f7fa in slapd_daemon_task (ptr=0x0) at /var/jwm/o2/openldap/servers/slapd/daemon.c:2174 ns = 1 at = 0 nfds = 12 revents = (struct epoll_event *) 0xb7b37008 tvp = (struct timeval *) 0xa44853a4 cat = {tv_sec = 1208360230, tv_usec = 0} i = 0 nwriters = 0 now = 1208360042 tv = {tv_sec = 188, tv_usec = 0} tdelta = 1 rtask = (struct re_s *) 0x81bea68 l = 4 last_idle_check = 0 idle = {tv_sec = 0, tv_usec = 0} ebadf = 0 #2 0xb7ce80bd in start_thread () from /lib/tls/libpthread.so.0 No symbol table info available. #3 0xb7c7d01e in clone () from /lib/tls/libc.so.6 No symbol table info available. Thread 1 (Thread -1212565280 (LWP 26178)): #0 0xb7ce9183 in pthread_join () from /lib/tls/libpthread.so.0 No symbol table info available. #1 0xb7f58f9b in ldap_pvt_thread_join (thread=2756205488, thread_return=0x0) at /var/jwm/o2/openldap/libraries/libldap_r/thr_posix.c:193 No locals. #2 0x08070524 in slapd_daemon () at /var/jwm/o2/openldap/servers/slapd/daemon.c:2579 listener_tid = 2756205488 rc = 0 #3 0x0805a58d in main (argc=9, argv=0xbff9b084) at /var/jwm/o2/openldap/servers/slapd/main.c:859 i = 9 no_detach = 0 rc = 0 urls = 0x8162008 "ldap:/// ldaps:///" username = 0x8162030 "gidNumber" groupname = 0x8162020 "\202.Í·°K\235·" sandbox = 0x0 syslogUser = 160 g_argc = 9 g_argv = (char **) 0xbff9b084 configfile = 0x8162040 "/etc/ldap/slapd.conf.master" configdir = 0x0 serverName = 0xbff9be9b "slapd" serverMode = 1 scp = (struct sync_cookie *) 0x0 scp_entry = (struct sync_cookie *) 0x0 debug_unknowns = (char **) 0x0 syslog_unknowns = (char **) 0x0 serverNamePrefix = 0x81112bb "" l = 3086212344 slapd_pid_file_unlink = 1 slapd_args_file_unlink = 1 __PRETTY_FUNCTION__ = "main" -- John Morrissey _o /\ ---- __o jwm@horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__
changed notes changed state Test to Release
changed notes
changed notes changed state Release to Closed
fixed? in HEAD fixed in RE24 fixed in RE23