[Date Prev][Date Next]
[Chronological]
[Thread]
[Top]
Re: (ITS#6298) ldapsearch hangs after ldapadd
--00151743f754b6ee3f0473da2c09
Content-Type: text/plain; charset=ISO-8859-1
Aster recompiling OpenLDAP with changes to servers/slapd/back-bdb/idl.h
>
>
#define BDB_IDL_LOGN 16 /* DB_SIZE is 2^16, UM_SIZE is 2^17 */
#define BDB_IDL_DB_SIZE (1<<(BDB_IDL_LOGN+1)) /* moved from 64k to
128K */
#define BDB_IDL_UM_SIZE (1<<(BDB_IDL_LOGN+2)) /* moved from 128k to
256k */
I'm unable to reproduce the issue.... it looks like problem solved...
time ldapsearch -h localhost -x -b
ou=bestMatchPrefixList,ou=sipDirektor,dc=ot,dc=hr -D cn=admin,dc=ot,dc=hr
-w passwd objectClass=originatorPrefixID
# extended LDIF
#
# LDAPv3
# base <ou=bestMatchPrefixList,ou=sipDirektor,dc=ot,dc=hr> with scope
subtree
# filter: objectClass=originatorPrefixID
# requesting: ALL
#
<----------------snip-------------------->
# 000010, 078120.100.10000.100, 385, bestMatchPrefixList, sipDirektor, ot.hr
dn:
originatorPrefixID=000010,carrierPrefixID=078120.100.10000.100,bestMatchPr
efix=385,ou=bestMatchPrefixList,ou=sipDirektor,dc=ot,dc=hr
originatorPrefix: 000010
priority: 100
originator: T-COM/HT
originatorPrefixID: 000010
objectClass: top
objectClass: originatorPrefixID
# search result
search: 2
result: 0 Success
# numResponses: 84256
# numEntries: 84255
real 0m22.500s
user 0m1.635s
sys 0m1.671s
[tculjaga@l01lnp1 lib]$
[tculjaga@l01lnp1 lib]$
What can we expect as the DB grows? Does it mean i will have to increase the
values again?
What is the limit and drawback?
Tihomir.
On Fri, Sep 18, 2009 at 10:10 AM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
> I'm gonna try this:
>
>
> In the file 'servers/slapd/back-bdb/idl.h':
>
> #define BDB_IDL_LOGN 16 /* DB_SIZE is 2^16, UM_SIZE is 2^17 */
>
> #define BDB_IDL_DB_SIZE (1<<(BDB_IDL_LOGN+1)) /* modified from 64k
> to 128K */
> #define BDB_IDL_UM_SIZE (1<<(BDB_IDL_LOGN+2)) /* modified from 128k
> to 256k */
>
>
>
> i have a question for the line in the file 'include/ldap_pvt_thread.h':
>
> define LDAP_PVT_THREAD_STACK_SIZE ( 1 * 1024 * 1024 * sizeof(void *) )
>
>
> ehat is sizeof(void *) when i run 64bit OS?
>
>
>
>
>
> On Fri, Sep 18, 2009 at 8:49 AM, Howard Chu <hyc@symas.com> wrote:
>
>> tculjaga@gmail.com wrote:
>>
>>> Full_Name: Tihomir Culjaga
>>> Version: 2.4.18
>>> OS: CentOS 5.3
>>> URL: ftp://ftp.openldap.org/incoming/
>>> Submission from: (NULL) (93.136.5.55)
>>>
>>
>> commands to perform whole-tree ldapsearch
>>>
>>
>> Note to developers: this description is a red herring. The actual search
>> that demonstrates the problem was posted later, here:
>>
>> http://www.openldap.org/lists/openldap-technical/200909/msg00129.html
>>
>> ldapsearch -h localhost -x -b
>>> ou=bestMatchPrefixList,ou=sipDirektor,dc=ot,dc=hr -D cn=admin,dc=ot,dc=hr
>>> -w
>>> passwd
>>>
>>>
>>>
>>> DB information
>>>
>>> 3437278 entries
>>>
>>> du -c -h /var/lib/ldap/*.bdb
>>> 204K /var/lib/ldap/bestMatchPrefix.bdb
>>> 982M /var/lib/ldap/dn2id.bdb
>>> 2.4G /var/lib/ldap/id2entry.bdb
>>> 1.9M /var/lib/ldap/objectClass.bdb
>>> 1.3M /var/lib/ldap/originatorPrefixID.bdb
>>> 48M /var/lib/ldap/uniqueID.bdb
>>> 3.4G total
>>>
>>
>> --
>> -- Howard Chu
>> CTO, Symas Corp. http://www.symas.com
>> Director, Highland Sun http://highlandsun.com/hyc/
>> Chief Architect, OpenLDAP http://www.openldap.org/project/
>>
>
>
--00151743f754b6ee3f0473da2c09
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Aster recompiling OpenLDAP with changes to servers/slapd/back-bdb/idl.h<blo=
ckquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, 204,=
204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"></blockquote><br>#def=
ine BDB_IDL_LOGN=A0=A0=A0 16=A0=A0=A0=A0=A0 /* DB_SIZE is 2^16, UM_SIZE is =
2^17 */<br>
<br>#define BDB_IDL_DB_SIZE=A0=A0=A0=A0=A0=A0=A0=A0 (1<<(BDB_IDL_LOGN=
+1)) /* moved from 64k to 128K */<br>
#define BDB_IDL_UM_SIZE=A0=A0=A0=A0=A0=A0=A0=A0 (1<<(BDB_IDL_LOGN+2))=
/* moved from 128k to 256k */<br><br><br>I'm unable to reproduce the i=
ssue.... it looks like problem solved...<br><br><br>time ldapsearch=A0 -h l=
ocalhost -x -b ou=3DbestMatchPrefixList,ou=3DsipDirektor,dc=3Dot,dc=3Dhr=A0=
-D cn=3Dadmin,dc=3Dot,dc=3Dhr -w passwd objectClass=3DoriginatorPrefixID<b=
r>
# extended LDIF<br>#<br># LDAPv3<br># base <ou=3DbestMatchPrefixList,ou=
=3DsipDirektor,dc=3Dot,dc=3Dhr> with scope subtree<br># filter: objectCl=
ass=3DoriginatorPrefixID<br># requesting: ALL<br>#<br><br><-------------=
---snip--------------------><br>
<br># 000010, 078120.100.10000.100, 385, bestMatchPrefixList, sipDirektor, =
<a href=3D"http://ot.hr";>ot.hr</a><br>dn: originatorPrefixID=3D000010,carri=
erPrefixID=3D078120.100.10000.100,bestMatchPr<br>=A0efix=3D385,ou=3DbestMat=
chPrefixList,ou=3DsipDirektor,dc=3Dot,dc=3Dhr<br>
originatorPrefix: 000010<br>priority: 100<br>originator: T-COM/HT<br>origin=
atorPrefixID: 000010<br>objectClass: top<br>objectClass: originatorPrefixID=
<br><br># search result<br>search: 2<br>result: 0 Success<br><br># numRespo=
nses: 84256<br>
# numEntries: 84255<br><br>real=A0=A0=A0 0m22.500s<br>user=A0=A0=A0 0m1.635=
s<br>sys=A0=A0=A0=A0 0m1.671s<br>[tculjaga@l01lnp1 lib]$ <br>[tculjaga@l01l=
np1 lib]$ <br><br><br>What can we expect as the DB grows? Does it mean i wi=
ll have to increase the values again? <br>
<br>What is the limit and drawback?<br><br><br>Tihomir.<br><br><br><br><div=
class=3D"gmail_quote">On Fri, Sep 18, 2009 at 10:10 AM, Tihomir Culjaga <s=
pan dir=3D"ltr"><<a href=3D"mailto:tculjaga@gmail.com";>tculjaga@gmail.co=
m</a>></span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">I'm gonna try=
this:<br><br><br>In the file 'servers/slapd/back-bdb/idl.h':<br><b=
r>
#define BDB_IDL_LOGN=A0=A0=A0 16=A0=A0=A0=A0=A0 /* DB_SIZE is 2^16, UM_SIZE=
is 2^17 */<br><br>#define BDB_IDL_DB_SIZE=A0=A0=A0=A0=A0=A0=A0=A0 (1<&l=
t;(BDB_IDL_LOGN+1)) /* modified from 64k to 128K */<br>
#define BDB_IDL_UM_SIZE=A0=A0=A0=A0=A0=A0=A0=A0 (1<<(BDB_IDL_LOGN+2))=
/* modified from 128k to 256k */<br><br><br><br>i have a question for the =
line in the file 'include/ldap_pvt_thread.h':<br><br>define LDAP_PV=
T_THREAD_STACK_SIZE ( 1 * 1024 * 1024 * sizeof(void *) )<br>
<br><br>ehat is sizeof(void *) when i run 64bit OS?<div><div></div><div cla=
ss=3D"h5"><br><br><br><br><br><div class=3D"gmail_quote">On Fri, Sep 18, 20=
09 at 8:49 AM, Howard Chu <span dir=3D"ltr"><<a href=3D"mailto:hyc@symas=
.com" target=3D"_blank">hyc@symas.com</a>></span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><a href=3D"mailto=
:tculjaga@gmail.com" target=3D"_blank">tculjaga@gmail.com</a> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Full_Name: Tihomir Culjaga<br>
Version: 2.4.18<br>
OS: CentOS 5.3<br>
URL: <a href=3D"ftp://ftp.openldap.org/incoming/"; target=3D"_blank">ftp://f=
tp.openldap.org/incoming/</a><br>
Submission from: (NULL) (93.136.5.55)<br>
</blockquote>
<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
commands to perform whole-tree ldapsearch<br>
</blockquote>
<br>
Note to developers: this description is a red herring. The actual search th=
at demonstrates the problem was posted later, here:<br>
<br>
<a href=3D"http://www.openldap.org/lists/openldap-technical/200909/msg00129=
.html" target=3D"_blank">http://www.openldap.org/lists/openldap-technical/2=
00909/msg00129.html</a><br>
<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
=A0 =A0ldapsearch =A0-h localhost -x -b<br>
ou=3DbestMatchPrefixList,ou=3DsipDirektor,dc=3Dot,dc=3Dhr -D cn=3Dadmin,dc=
=3Dot,dc=3Dhr -w<br>
passwd<br>
<br>
<br>
<br>
DB information<br>
<br>
3437278 entries<br>
<br>
du -c -h /var/lib/ldap/*.bdb<br>
=A0 204K /var/lib/ldap/bestMatchPrefix.bdb<br>
=A0 982M /var/lib/ldap/dn2id.bdb<br>
=A0 2.4G /var/lib/ldap/id2entry.bdb<br>
=A0 1.9M /var/lib/ldap/objectClass.bdb<br>
=A0 1.3M /var/lib/ldap/originatorPrefixID.bdb<br>
=A0 48M =A0/var/lib/ldap/uniqueID.bdb<br>
=A0 3.4G total<br>
</blockquote>
<br>
-- <br>
=A0-- Howard Chu<br>
=A0CTO, Symas Corp. =A0 =A0 =A0 =A0 =A0 <a href=3D"http://www.symas.com"; t=
arget=3D"_blank">http://www.symas.com</a><br>
=A0Director, Highland Sun =A0 =A0 <a href=3D"http://highlandsun.com/hyc/"; =
target=3D"_blank">http://highlandsun.com/hyc/</a><br>
=A0Chief Architect, OpenLDAP =A0<a href=3D"http://www.openldap.org/project=
/" target=3D"_blank">http://www.openldap.org/project/</a><br>
</blockquote></div><br>
</div></div></blockquote></div><br>
--00151743f754b6ee3f0473da2c09--