[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: (ITS#8296) slapd suddenly crash when using syncprov



--001a1130d27c49538c05232c9dd4
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I cloned the git repository "git://git.openldap.org/openldap.git", then I
compiled this version "2.X" as specified in the 1st message.
Please consider that, after recompiling this version, I rebooted the server
where slapd is running.

As far as I can see, it seems the memory consumption is the same as 2.4.42:
it starts to increase up to 60%.
In fact, with gdb, I got now an assertion failed due to:

----
5630f547 connection_get(22): got connid=3D1001
5630f547 connection_read(22): checking for input on id=3D1001
ber_get_next
ber_get_next: tag 0x30 len 188 contents:
5630f547 op tag 0x66, time 1446049095
ber_get_next
5630f547 conn=3D1001 op=3D46535 do_modify
ber_scanf fmt ({m) ber:
ber_scanf fmt ({e{m[W]}}) ber:
5630f547 =3D> get_ctrls
ber_scanf fmt ({m) ber:
5630f547 =3D> get_ctrls: oid=3D"2.16.840.1.113730.3.4.2" (noncritical)
5630f547 <=3D get_ctrls: n=3D1 rc=3D0 err=3D""
5630f547 >>> dnPrettyNormal:
<cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch>
5630f547 <<< dnPrettyNormal:
<cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch>,
<cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivates,c=3Dch>
5630f547 >>> dnPretty: <cn=3DSimon
Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch>
5630f547 <<< dnPretty: <cn=3DSimon
Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch>
5630f547 >>> dnNormalize: <cn=3DSimon
Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch>
5630f547 <<< dnNormalize: <cn=3Dsimon
cottet.7601000061447,ou=3Dhcprofessional,dc=3Dhpd,o=3Dvivates,c=3Dch>
5630f547
bdb_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivate=
s,c=3Dch")
5630f547 bdb_entry_get: rc=3D0
5630f547 syncprov_matchops: sid ffffffff fscope 1 rc 6
5630f547 =3D=3D> unique_modify
<cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch>
5630f547
bdb_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivate=
s,c=3Dch")
5630f547 bdb_entry_get: rc=3D0
5630f547 unique_modify: administrative bypass, skipping
5630f547 bdb_modify: txn1 id: 80005c1f
5630f547
bdb_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivate=
s,c=3Dch")
5630f547 bdb_modify: txn2 id: 80005c20
5630f547 bdb_modify_internal: 0x00000288:
cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch
5630f547 oc_check_required entry
(cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch), ob=
jectClass
"VivatesHCRelationship"
5630f547 oc_check_allowed type "relationshipType"
5630f547 oc_check_allowed type "owner"
5630f547 oc_check_allowed type "objectClass"
5630f547 oc_check_allowed type "cn"
5630f547 oc_check_allowed type "member"
5630f547 oc_check_allowed type "structuralObjectClass"
5630f547 oc_check_allowed type "entryUUID"
5630f547 oc_check_allowed type "creatorsName"
5630f547 oc_check_allowed type "createTimestamp"
5630f547 oc_check_allowed type "entryCSN"
5630f547 oc_check_allowed type "modifiersName"
5630f547 oc_check_allowed type "modifyTimestamp"
5630f547 =3D> key_change(DELETE,288)
5630f547 <=3D key_change 0
5630f547 =3D> key_change(ADD,288)
5630f547 <=3D key_change 0
5630f547 =3D> entry_encode(0x00000288):
cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch
5630f547 ch_malloc of 837196 bytes failed
slapd: ch_malloc.c:57: ch_malloc: Assertion `0' failed.

Program received signal SIGABRT, Aborted.
[Switching to Thread 0x9baffb70 (LWP 3069)]
0x00130424 in __kernel_vsyscall ()
Missing separate debuginfos, use: debuginfo-install
libtool-ltdl-2.2.6-15.5.el6.i686

(gdb) bt
#0  0x00130424 in __kernel_vsyscall ()
#1  0x003ac871 in raise (sig=3D6) at
../nptl/sysdeps/unix/sysv/linux/raise.c:64
#2  0x003ae14a in abort () at abort.c:92
#3  0x003a5b8b in __assert_fail_base (fmt=3D0x4dad58 "%s%s%s:%u:
%s%sAssertion `%s' failed.\n%n", assertion=3D0x81c79c9 "0", file=3D0x81ac34=
7
"ch_malloc.c", line=3D57, function=3D0x81ac3df "ch_malloc") at assert.c:96
#4  0x003a5c46 in __assert_fail (assertion=3D0x81c79c9 "0", file=3D0x81ac34=
7
"ch_malloc.c", line=3D57, function=3D0x81ac3df "ch_malloc") at assert.c:105
#5  0x0809768a in ch_malloc (size=3D837196) at ch_malloc.c:57
#6  0x080857d1 in entry_encode (e=3D0x9bafdb9c, bv=3D0x9bafda04) at entry.c=
:710
#7  0x0814a4a5 in bdb_id2entry_put (be=3D<value optimized out>, tid=3D<valu=
e
optimized out>, e=3D<value optimized out>, flag=3D0) at id2entry.c:54
#8  0x080fa6f4 in bdb_modify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c=
:679
#9  0x080e884d in overlay_op_walk (op=3D0xa22b3bd8, rs=3D0x9baff0cc,
which=3Dop_modify, oi=3D0x8353670, on=3D0x0) at backover.c:696
#10 0x080e94e9 in over_op_func (op=3D0xa22b3bd8, rs=3D0x9baff0cc,
which=3Dop_modify) at backover.c:749
#11 0x080944b1 in fe_op_modify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at
modify.c:303
#12 0x08094f27 in do_modify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:=
177
#13 0x0807b043 in connection_operation (ctx=3D0x9baff1e8, arg_v=3D0xa22b3bd=
8)
at connection.c:1137
#14 0x0807bb57 in connection_read_thread (ctx=3D0x9baff1e8, argv=3D0x16) at
connection.c:1283
#15 0x0013d309 in ldap_int_thread_pool_wrapper (xpool=3D0x8299a40) at
tpool.c:956
#16 0x0036db39 in start_thread (arg=3D0x9baffb70) at pthread_create.c:301
#17 0x00464c2e in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:133

----


So, a malloc failed returning NULL.
This happens also with the 2.4.42.


Now I relaunch again the loading procedure and see what's happening.

2015-10-28 16:41 GMT+01:00 Michael Str=C3=B6der <michael@stroeder.com>:

> Any chance for you to test RE24 branch with the code to be released as
> 2.4.43?
>
> There were some fixes for crashing syncrepl added therein.
>
> Ciao, Michael.
>



--=20
 Maurizio Lattuada

--001a1130d27c49538c05232c9dd4
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I cloned the git repository &quot;<span style=3D"color:rgb=
(0,0,0);font-family:sans-serif;font-size:13px">git://<a href=3D"http://git.=
openldap.org/openldap.git">git.openldap.org/openldap.git</a>&quot;,=C2=A0</=
span><span style=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13px"=
>then I compiled this version &quot;2.X&quot; as specified in the 1st messa=
ge.</span><div><span style=3D"color:rgb(0,0,0);font-family:sans-serif;font-=
size:13px">Please consider that, after recompiling this version, I rebooted=
 the server where slapd is running.</span><font color=3D"#000000" face=3D"s=
ans-serif"><br></font></div><div><font color=3D"#000000" face=3D"sans-serif=
"><br></font><div><span style=3D"color:rgb(0,0,0);font-family:sans-serif;fo=
nt-size:13px">As far as I can see, it seems the memory consumption is the s=
ame as 2.4.42: it starts to increase up to 60%.</span></div><div><span styl=
e=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13px">In fact, with =
gdb, I got now an assertion failed due to:</span><br></div><div><span style=
=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13px"><br></span></di=
v><div><span style=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13p=
x">----</span></div><div><div style=3D""><font color=3D"#000000" face=3D"sa=
ns-serif">5630f547 connection_get(22): got connid=3D1001</font></div><div s=
tyle=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 connection_r=
ead(22): checking for input on id=3D1001</font></div><div style=3D""><font =
color=3D"#000000" face=3D"sans-serif">ber_get_next</font></div><div style=
=3D""><font color=3D"#000000" face=3D"sans-serif">ber_get_next: tag 0x30 le=
n 188 contents:</font></div><div style=3D""><font color=3D"#000000" face=3D=
"sans-serif">5630f547 op tag 0x66, time 1446049095</font></div><div style=
=3D""><font color=3D"#000000" face=3D"sans-serif">ber_get_next</font></div>=
<div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 conn=
=3D1001 op=3D46535 do_modify</font></div><div style=3D""><font color=3D"#00=
0000" face=3D"sans-serif">ber_scanf fmt ({m) ber:</font></div><div style=3D=
""><font color=3D"#000000" face=3D"sans-serif">ber_scanf fmt ({e{m[W]}}) be=
r:</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">=
5630f547 =3D&gt; get_ctrls</font></div><div style=3D""><font color=3D"#0000=
00" face=3D"sans-serif">ber_scanf fmt ({m) ber:</font></div><div style=3D""=
><font color=3D"#000000" face=3D"sans-serif">5630f547 =3D&gt; get_ctrls: oi=
d=3D&quot;2.16.840.1.113730.3.4.2&quot; (noncritical)</font></div><div styl=
e=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 &lt;=3D get_ctr=
ls: n=3D1 rc=3D0 err=3D&quot;&quot;</font></div><div style=3D""><font color=
=3D"#000000" face=3D"sans-serif">5630f547 &gt;&gt;&gt; dnPrettyNormal: &lt;=
cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch&gt;</=
font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630=
f547 &lt;&lt;&lt; dnPrettyNormal: &lt;cn=3D1000000000000_O2HP,ou=3DRelation=
ship,dc=3DHPD,o=3Dvivates,c=3Dch&gt;, &lt;cn=3D1000000000000_o2hp,ou=3Drela=
tionship,dc=3Dhpd,o=3Dvivates,c=3Dch&gt;</font></div><div style=3D""><font =
color=3D"#000000" face=3D"sans-serif">5630f547 &gt;&gt;&gt; dnPretty: &lt;c=
n=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=
=3Dch&gt;</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-=
serif">5630f547 &lt;&lt;&lt; dnPretty: &lt;cn=3DSimon Cottet.7601000061447,=
ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch&gt;</font></div><div style=
=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 &gt;&gt;&gt; dnN=
ormalize: &lt;cn=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,=
o=3Dvivates,c=3Dch&gt;</font></div><div style=3D""><font color=3D"#000000" =
face=3D"sans-serif">5630f547 &lt;&lt;&lt; dnNormalize: &lt;cn=3Dsimon cotte=
t.7601000061447,ou=3Dhcprofessional,dc=3Dhpd,o=3Dvivates,c=3Dch&gt;</font><=
/div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 b=
db_dn2entry(&quot;cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvi=
vates,c=3Dch&quot;)</font></div><div style=3D""><font color=3D"#000000" fac=
e=3D"sans-serif">5630f547 bdb_entry_get: rc=3D0</font></div><div style=3D""=
><font color=3D"#000000" face=3D"sans-serif">5630f547 syncprov_matchops: si=
d ffffffff fscope 1 rc 6</font></div><div style=3D""><font color=3D"#000000=
" face=3D"sans-serif">5630f547 =3D=3D&gt; unique_modify &lt;cn=3D1000000000=
000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch&gt;</font></div><div=
 style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 bdb_dn2ent=
ry(&quot;cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivates,c=
=3Dch&quot;)</font></div><div style=3D""><font color=3D"#000000" face=3D"sa=
ns-serif">5630f547 bdb_entry_get: rc=3D0</font></div><div style=3D""><font =
color=3D"#000000" face=3D"sans-serif">5630f547 unique_modify: administrativ=
e bypass, skipping</font></div><div style=3D""><font color=3D"#000000" face=
=3D"sans-serif">5630f547 bdb_modify: txn1 id: 80005c1f</font></div><div sty=
le=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 bdb_dn2entry(&=
quot;cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivates,c=3Dch&=
quot;)</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-ser=
if">5630f547 bdb_modify: txn2 id: 80005c20</font></div><div style=3D""><fon=
t color=3D"#000000" face=3D"sans-serif">5630f547 bdb_modify_internal: 0x000=
00288: cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dc=
h</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5=
630f547 oc_check_required entry (cn=3D1000000000000_O2HP,ou=3DRelationship,=
dc=3DHPD,o=3Dvivates,c=3Dch), objectClass &quot;VivatesHCRelationship&quot;=
</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">56=
30f547 oc_check_allowed type &quot;relationshipType&quot;</font></div><div =
style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_al=
lowed type &quot;owner&quot;</font></div><div style=3D""><font color=3D"#00=
0000" face=3D"sans-serif">5630f547 oc_check_allowed type &quot;objectClass&=
quot;</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-seri=
f">5630f547 oc_check_allowed type &quot;cn&quot;</font></div><div style=3D"=
"><font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_allowed typ=
e &quot;member&quot;</font></div><div style=3D""><font color=3D"#000000" fa=
ce=3D"sans-serif">5630f547 oc_check_allowed type &quot;structuralObjectClas=
s&quot;</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-se=
rif">5630f547 oc_check_allowed type &quot;entryUUID&quot;</font></div><div =
style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_al=
lowed type &quot;creatorsName&quot;</font></div><div style=3D""><font color=
=3D"#000000" face=3D"sans-serif">5630f547 oc_check_allowed type &quot;creat=
eTimestamp&quot;</font></div><div style=3D""><font color=3D"#000000" face=
=3D"sans-serif">5630f547 oc_check_allowed type &quot;entryCSN&quot;</font><=
/div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 o=
c_check_allowed type &quot;modifiersName&quot;</font></div><div style=3D"">=
<font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_allowed type =
&quot;modifyTimestamp&quot;</font></div><div style=3D""><font color=3D"#000=
000" face=3D"sans-serif">5630f547 =3D&gt; key_change(DELETE,288)</font></di=
v><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 &lt;=
=3D key_change 0</font></div><div style=3D""><font color=3D"#000000" face=
=3D"sans-serif">5630f547 =3D&gt; key_change(ADD,288)</font></div><div style=
=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 &lt;=3D key_chan=
ge 0</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif=
">5630f547 =3D&gt; entry_encode(0x00000288): cn=3D1000000000000_O2HP,ou=3DR=
elationship,dc=3DHPD,o=3Dvivates,c=3Dch</font></div><div style=3D""><font c=
olor=3D"#000000" face=3D"sans-serif">5630f547 ch_malloc of 837196 bytes fai=
led</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif"=
>slapd: ch_malloc.c:57: ch_malloc: Assertion `0&#39; failed.</font></div><d=
iv style=3D""><font color=3D"#000000" face=3D"sans-serif"><br></font></div>=
<div style=3D""><font color=3D"#000000" face=3D"sans-serif">Program receive=
d signal SIGABRT, Aborted.</font></div><div style=3D""><font color=3D"#0000=
00" face=3D"sans-serif">[Switching to Thread 0x9baffb70 (LWP 3069)]</font><=
/div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">0x00130424=
 in __kernel_vsyscall ()</font></div><div style=3D""><font color=3D"#000000=
" face=3D"sans-serif">Missing separate debuginfos, use: debuginfo-install l=
ibtool-ltdl-2.2.6-15.5.el6.i686</font></div></div><div style=3D""><font col=
or=3D"#000000" face=3D"sans-serif"><br></font></div><div style=3D""><font c=
olor=3D"#000000" face=3D"sans-serif"><div>(gdb) bt</div><div>#0 =C2=A00x001=
30424 in __kernel_vsyscall ()</div><div>#1 =C2=A00x003ac871 in raise (sig=
=3D6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64</div><div>#2 =C2=A00x00=
3ae14a in abort () at abort.c:92</div><div>#3 =C2=A00x003a5b8b in __assert_=
fail_base (fmt=3D0x4dad58 &quot;%s%s%s:%u: %s%sAssertion `%s&#39; failed.\n=
%n&quot;, assertion=3D0x81c79c9 &quot;0&quot;, file=3D0x81ac347 &quot;ch_ma=
lloc.c&quot;, line=3D57, function=3D0x81ac3df &quot;ch_malloc&quot;) at ass=
ert.c:96</div><div>#4 =C2=A00x003a5c46 in __assert_fail (assertion=3D0x81c7=
9c9 &quot;0&quot;, file=3D0x81ac347 &quot;ch_malloc.c&quot;, line=3D57, fun=
ction=3D0x81ac3df &quot;ch_malloc&quot;) at assert.c:105</div><div>#5 =C2=
=A00x0809768a in ch_malloc (size=3D837196) at ch_malloc.c:57</div><div>#6 =
=C2=A00x080857d1 in entry_encode (e=3D0x9bafdb9c, bv=3D0x9bafda04) at entry=
.c:710</div><div>#7 =C2=A00x0814a4a5 in bdb_id2entry_put (be=3D&lt;value op=
timized out&gt;, tid=3D&lt;value optimized out&gt;, e=3D&lt;value optimized=
 out&gt;, flag=3D0) at id2entry.c:54</div><div>#8 =C2=A00x080fa6f4 in bdb_m=
odify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:679</div><div>#9 =C2=
=A00x080e884d in overlay_op_walk (op=3D0xa22b3bd8, rs=3D0x9baff0cc, which=
=3Dop_modify, oi=3D0x8353670, on=3D0x0) at backover.c:696</div><div>#10 0x0=
80e94e9 in over_op_func (op=3D0xa22b3bd8, rs=3D0x9baff0cc, which=3Dop_modif=
y) at backover.c:749</div><div>#11 0x080944b1 in fe_op_modify (op=3D0xa22b3=
bd8, rs=3D0x9baff0cc) at modify.c:303</div><div>#12 0x08094f27 in do_modify=
 (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:177</div><div>#13 0x0807b04=
3 in connection_operation (ctx=3D0x9baff1e8, arg_v=3D0xa22b3bd8) at connect=
ion.c:1137</div><div>#14 0x0807bb57 in connection_read_thread (ctx=3D0x9baf=
f1e8, argv=3D0x16) at connection.c:1283</div><div>#15 0x0013d309 in ldap_in=
t_thread_pool_wrapper (xpool=3D0x8299a40) at tpool.c:956</div><div>#16 0x00=
36db39 in start_thread (arg=3D0x9baffb70) at pthread_create.c:301</div><div=
>#17 0x00464c2e in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:133<=
/div><div><br></div><div>----</div><div><br></div><div><br></div><div>So, a=
 malloc failed returning NULL.</div><div>This happens also with the 2.4.42.=
</div><div><br></div><div><br></div><div>Now I relaunch again the loading p=
rocedure and see what&#39;s happening.</div></font></div></div></div><div c=
lass=3D"gmail_extra"><br><div class=3D"gmail_quote">2015-10-28 16:41 GMT+01=
:00 Michael Str=C3=B6der <span dir=3D"ltr">&lt;<a href=3D"mailto:michael@st=
roeder.com" target=3D"_blank">michael@stroeder.com</a>&gt;</span>:<br><bloc=
kquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #cc=
c solid;padding-left:1ex">Any chance for you to test RE24 branch with the c=
ode to be released as 2.4.43?<br>
<br>
There were some fixes for crashing syncrepl added therein.<br>
<br>
Ciao, Michael.<br>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class=
=3D"gmail_signature"><div dir=3D"ltr">=C2=A0Maurizio Lattuada<br></div></di=
v>
</div>

--001a1130d27c49538c05232c9dd4--