[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: (ITS#5860) slapd memeory leak under openldap 2.4



--0-65098359-1232716543=:26208
Content-Type: text/plain; charset=us-ascii

Howard,

I had the monitor enabled. But I could not see nothing related to cache in its output.

I executed the command :

ldapsearch -LLL -x -b "cn=monitor" -H ldap://10.142.15.42:389 > monitor_2.txt

It is supposed to be all information provided by monitor, as I know.

Please see file attached with information.

I still not sure what or which cache is consuming all memory. I do not understand why we place cache size definitions to slapd and it doesn't respect them.

Regards,

Rodrigo.

--- On Thu, 1/22/09, Howard Chu <hyc@symas.com> wrote:

> From: Howard Chu <hyc@symas.com>
> Subject: Re: (ITS#5860) slapd memeory leak under openldap 2.4
> To: rlvcosta@yahoo.com
> Cc: openldap-its@openldap.org
> Date: Thursday, January 22, 2009, 8:36 PM
> rlvcosta@yahoo.com wrote:
> > Quanah,
> > 
> > I just used tcmalloc but I still with the same
> behavior. slapd doesn't
> > have  limit for the cache and then it cannot run large
> databases.
> 
> As a side comment, we have already documented that about 1
> million entries is the practical limit for slapd on a 32 bit
> machine. Since 64 bit machines are so common today, making
> slapd perform well on a 32 bit machine is no longer a
> priority.
> 
> Also, by design, tcmalloc doesn't release freed memory
> back to the OS, since it will most likely be needed again.
> It's normal for the slapd process size to never shrink.
> 
> One thing you can check is to add a "database
> monitor" to your slapd configuration; one of the
> entries under cn=monitor will report the number of items in
> the back-bdb cache. Please provide this information here.
> 
> --   -- Howard Chu
>   CTO, Symas Corp.           http://www.symas.com
>   Director, Highland Sun     http://highlandsun.com/hyc/
>   Chief Architect, OpenLDAP 
> http://www.openldap.org/project/


      
--0-65098359-1232716543=:26208
Content-Type: text/plain; name="monitor_2.txt"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="monitor_2.txt"

ZG46IGNuPU1vbml0b3INCm9iamVjdENsYXNzOiBtb25pdG9yU2VydmVyDQpj
bjogTW9uaXRvcg0KZGVzY3JpcHRpb246IFRoaXMgc3VidHJlZSBjb250YWlu
cyBtb25pdG9yaW5nL21hbmFnaW5nIG9iamVjdHMuDQpkZXNjcmlwdGlvbjog
VGhpcyBvYmplY3QgY29udGFpbnMgaW5mb3JtYXRpb24gYWJvdXQgdGhpcyBz
ZXJ2ZXIuDQpkZXNjcmlwdGlvbjogTW9zdCBvZiB0aGUgaW5mb3JtYXRpb24g
aXMgaGVsZCBpbiBvcGVyYXRpb25hbCBhdHRyaWJ1dGVzLCB3aGljaCANCiBt
dXN0IGJlIGV4cGxpY2l0bHkgcmVxdWVzdGVkLg0KDQpkbjogY249QmFja2Vu
ZHMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JDb250YWluZXIN
CmNuOiBCYWNrZW5kcw0KZGVzY3JpcHRpb246IFRoaXMgc3Vic3lzdGVtIGNv
bnRhaW5zIGluZm9ybWF0aW9uIGFib3V0IGF2YWlsYWJsZSBiYWNrZW5kcy4N
Cg0KZG46IGNuPUJhY2tlbmQgMCxjbj1CYWNrZW5kcyxjbj1Nb25pdG9yDQpv
YmplY3RDbGFzczogbW9uaXRvcmVkT2JqZWN0DQpjbjogQmFja2VuZCAwDQpz
ZWVBbHNvOiBjbj1EYXRhYmFzZSAwLGNuPURhdGFiYXNlcyxjbj1Nb25pdG9y
DQoNCmRuOiBjbj1CYWNrZW5kIDEsY249QmFja2VuZHMsY249TW9uaXRvcg0K
b2JqZWN0Q2xhc3M6IG1vbml0b3JlZE9iamVjdA0KY246IEJhY2tlbmQgMQ0K
DQpkbjogY249QmFja2VuZCAyLGNuPUJhY2tlbmRzLGNuPU1vbml0b3INCm9i
amVjdENsYXNzOiBtb25pdG9yZWRPYmplY3QNCmNuOiBCYWNrZW5kIDINCnNl
ZUFsc286IGNuPURhdGFiYXNlIDEsY249RGF0YWJhc2VzLGNuPU1vbml0b3IN
CnNlZUFsc286IGNuPURhdGFiYXNlIDIsY249RGF0YWJhc2VzLGNuPU1vbml0
b3INCg0KZG46IGNuPUJhY2tlbmQgMyxjbj1CYWNrZW5kcyxjbj1Nb25pdG9y
DQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2JqZWN0DQpjbjogQmFja2VuZCAz
DQpzZWVBbHNvOiBjbj1EYXRhYmFzZSAzLGNuPURhdGFiYXNlcyxjbj1Nb25p
dG9yDQoNCmRuOiBjbj1Db25uZWN0aW9ucyxjbj1Nb25pdG9yDQpvYmplY3RD
bGFzczogbW9uaXRvckNvbnRhaW5lcg0KY246IENvbm5lY3Rpb25zDQpkZXNj
cmlwdGlvbjogVGhpcyBzdWJzeXN0ZW0gY29udGFpbnMgaW5mb3JtYXRpb24g
YWJvdXQgY29ubmVjdGlvbnMuDQoNCmRuOiBjbj1Db25uZWN0aW9uIDMsY249
Q29ubmVjdGlvbnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JD
b25uZWN0aW9uDQpjbjogQ29ubmVjdGlvbiAzDQoNCmRuOiBjbj1NYXggRmls
ZSBEZXNjcmlwdG9ycyxjbj1Db25uZWN0aW9ucyxjbj1Nb25pdG9yDQpvYmpl
Y3RDbGFzczogbW9uaXRvckNvdW50ZXJPYmplY3QNCmNuOiBNYXggRmlsZSBE
ZXNjcmlwdG9ycw0KDQpkbjogY249VG90YWwsY249Q29ubmVjdGlvbnMsY249
TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JDb3VudGVyT2JqZWN0DQpj
bjogVG90YWwNCg0KZG46IGNuPUN1cnJlbnQsY249Q29ubmVjdGlvbnMsY249
TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JDb3VudGVyT2JqZWN0DQpj
bjogQ3VycmVudA0KDQpkbjogY249RGF0YWJhc2VzLGNuPU1vbml0b3INCm9i
amVjdENsYXNzOiBtb25pdG9yQ29udGFpbmVyDQpjbjogRGF0YWJhc2VzDQpk
ZXNjcmlwdGlvbjogVGhpcyBzdWJzeXN0ZW0gY29udGFpbnMgaW5mb3JtYXRp
b24gYWJvdXQgY29uZmlndXJlZCBkYXRhYmFzZXMuDQoNCmRuOiBjbj1Gcm9u
dGVuZCxjbj1EYXRhYmFzZXMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1v
bml0b3JlZE9iamVjdA0KY246IEZyb250ZW5kDQoNCmRuOiBjbj1EYXRhYmFz
ZSAwLGNuPURhdGFiYXNlcyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9u
aXRvcmVkT2JqZWN0DQpjbjogRGF0YWJhc2UgMA0Kc2VlQWxzbzogY249QmFj
a2VuZCAwLGNuPUJhY2tlbmRzLGNuPU1vbml0b3INCg0KZG46IGNuPURhdGFi
YXNlIDEsY249RGF0YWJhc2VzLGNuPU1vbml0b3INCm9iamVjdENsYXNzOiBt
b25pdG9yZWRPYmplY3QNCm9iamVjdENsYXNzOiBvbG1CREJEYXRhYmFzZQ0K
Y246IERhdGFiYXNlIDENCnNlZUFsc286IGNuPUJhY2tlbmQgMixjbj1CYWNr
ZW5kcyxjbj1Nb25pdG9yDQoNCmRuOiBjbj1EYXRhYmFzZSAyLGNuPURhdGFi
YXNlcyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2JqZWN0
DQpvYmplY3RDbGFzczogb2xtQkRCRGF0YWJhc2UNCmNuOiBEYXRhYmFzZSAy
DQpzZWVBbHNvOiBjbj1CYWNrZW5kIDIsY249QmFja2VuZHMsY249TW9uaXRv
cg0KDQpkbjogY249RGF0YWJhc2UgMyxjbj1EYXRhYmFzZXMsY249TW9uaXRv
cg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JlZE9iamVjdA0KY246IERhdGFiYXNl
IDMNCnNlZUFsc286IGNuPUJhY2tlbmQgMyxjbj1CYWNrZW5kcyxjbj1Nb25p
dG9yDQoNCmRuOiBjbj1MaXN0ZW5lcnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xh
c3M6IG1vbml0b3JDb250YWluZXINCmNuOiBMaXN0ZW5lcnMNCmRlc2NyaXB0
aW9uOiBUaGlzIHN1YnN5c3RlbSBjb250YWlucyBpbmZvcm1hdGlvbiBhYm91
dCBhY3RpdmUgbGlzdGVuZXJzLg0KDQpkbjogY249TGlzdGVuZXIgMCxjbj1M
aXN0ZW5lcnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JlZE9i
amVjdA0KY246IExpc3RlbmVyIDANCmxhYmVsZWRVUkk6IGxkYXA6Ly8xMC4x
NDIuMTUuNDI6Mzg5DQoNCmRuOiBjbj1MaXN0ZW5lciAxLGNuPUxpc3RlbmVy
cyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2JqZWN0DQpj
bjogTGlzdGVuZXIgMQ0KbGFiZWxlZFVSSTogbGRhcDovLzEwLjE0Mi4xNS4x
NzI6Mzg5DQoNCmRuOiBjbj1Mb2csY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6
IG1vbml0b3JDb250YWluZXINCmNuOiBMb2cNCmRlc2NyaXB0aW9uOiBUaGlz
IHN1YnN5c3RlbSBjb250YWlucyBpbmZvcm1hdGlvbiBhYm91dCBsb2dnaW5n
Lg0KZGVzY3JpcHRpb246IFNldCB0aGUgYXR0cmlidXRlICJtYW5hZ2VkSW5m
byIgdG8gdGhlIGRlc2lyZWQgbG9nIGxldmVscy4NCg0KZG46IGNuPU9wZXJh
dGlvbnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JDb250YWlu
ZXINCmNuOiBPcGVyYXRpb25zDQpkZXNjcmlwdGlvbjogVGhpcyBzdWJzeXN0
ZW0gY29udGFpbnMgaW5mb3JtYXRpb24gYWJvdXQgcGVyZm9ybWVkIG9wZXJh
dGlvbnMuDQoNCmRuOiBjbj1CaW5kLGNuPU9wZXJhdGlvbnMsY249TW9uaXRv
cg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JPcGVyYXRpb24NCmNuOiBCaW5kDQoN
CmRuOiBjbj1VbmJpbmQsY249T3BlcmF0aW9ucyxjbj1Nb25pdG9yDQpvYmpl
Y3RDbGFzczogbW9uaXRvck9wZXJhdGlvbg0KY246IFVuYmluZA0KDQpkbjog
Y249U2VhcmNoLGNuPU9wZXJhdGlvbnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xh
c3M6IG1vbml0b3JPcGVyYXRpb24NCmNuOiBTZWFyY2gNCg0KZG46IGNuPUNv
bXBhcmUsY249T3BlcmF0aW9ucyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczog
bW9uaXRvck9wZXJhdGlvbg0KY246IENvbXBhcmUNCg0KZG46IGNuPU1vZGlm
eSxjbj1PcGVyYXRpb25zLGNuPU1vbml0b3INCm9iamVjdENsYXNzOiBtb25p
dG9yT3BlcmF0aW9uDQpjbjogTW9kaWZ5DQoNCmRuOiBjbj1Nb2RyZG4sY249
T3BlcmF0aW9ucyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvck9w
ZXJhdGlvbg0KY246IE1vZHJkbg0KDQpkbjogY249QWRkLGNuPU9wZXJhdGlv
bnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JPcGVyYXRpb24N
CmNuOiBBZGQNCg0KZG46IGNuPURlbGV0ZSxjbj1PcGVyYXRpb25zLGNuPU1v
bml0b3INCm9iamVjdENsYXNzOiBtb25pdG9yT3BlcmF0aW9uDQpjbjogRGVs
ZXRlDQoNCmRuOiBjbj1BYmFuZG9uLGNuPU9wZXJhdGlvbnMsY249TW9uaXRv
cg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JPcGVyYXRpb24NCmNuOiBBYmFuZG9u
DQoNCmRuOiBjbj1FeHRlbmRlZCxjbj1PcGVyYXRpb25zLGNuPU1vbml0b3IN
Cm9iamVjdENsYXNzOiBtb25pdG9yT3BlcmF0aW9uDQpjbjogRXh0ZW5kZWQN
Cg0KZG46IGNuPU92ZXJsYXlzLGNuPU1vbml0b3INCm9iamVjdENsYXNzOiBt
b25pdG9yQ29udGFpbmVyDQpjbjogT3ZlcmxheXMNCmRlc2NyaXB0aW9uOiBU
aGlzIHN1YnN5c3RlbSBjb250YWlucyBpbmZvcm1hdGlvbiBhYm91dCBhdmFp
bGFibGUgb3ZlcmxheXMuDQoNCmRuOiBjbj1PdmVybGF5IDAsY249T3Zlcmxh
eXMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JlZE9iamVjdA0K
Y246IE92ZXJsYXkgMA0KDQpkbjogY249U0FTTCxjbj1Nb25pdG9yDQpvYmpl
Y3RDbGFzczogbW9uaXRvckNvbnRhaW5lcg0KY246IFNBU0wNCmRlc2NyaXB0
aW9uOiBUaGlzIHN1YnN5c3RlbSBjb250YWlucyBpbmZvcm1hdGlvbiBhYm91
dCBTQVNMLg0KDQpkbjogY249U3RhdGlzdGljcyxjbj1Nb25pdG9yDQpvYmpl
Y3RDbGFzczogbW9uaXRvckNvbnRhaW5lcg0KY246IFN0YXRpc3RpY3MNCmRl
c2NyaXB0aW9uOiBUaGlzIHN1YnN5c3RlbSBjb250YWlucyBzdGF0aXN0aWNz
Lg0KDQpkbjogY249Qnl0ZXMsY249U3RhdGlzdGljcyxjbj1Nb25pdG9yDQpv
YmplY3RDbGFzczogbW9uaXRvckNvdW50ZXJPYmplY3QNCmNuOiBCeXRlcw0K
DQpkbjogY249UERVLGNuPVN0YXRpc3RpY3MsY249TW9uaXRvcg0Kb2JqZWN0
Q2xhc3M6IG1vbml0b3JDb3VudGVyT2JqZWN0DQpjbjogUERVDQoNCmRuOiBj
bj1FbnRyaWVzLGNuPVN0YXRpc3RpY3MsY249TW9uaXRvcg0Kb2JqZWN0Q2xh
c3M6IG1vbml0b3JDb3VudGVyT2JqZWN0DQpjbjogRW50cmllcw0KDQpkbjog
Y249UmVmZXJyYWxzLGNuPVN0YXRpc3RpY3MsY249TW9uaXRvcg0Kb2JqZWN0
Q2xhc3M6IG1vbml0b3JDb3VudGVyT2JqZWN0DQpjbjogUmVmZXJyYWxzDQoN
CmRuOiBjbj1UaHJlYWRzLGNuPU1vbml0b3INCm9iamVjdENsYXNzOiBtb25p
dG9yQ29udGFpbmVyDQpjbjogVGhyZWFkcw0KZGVzY3JpcHRpb246IFRoaXMg
c3Vic3lzdGVtIGNvbnRhaW5zIGluZm9ybWF0aW9uIGFib3V0IHRocmVhZHMu
DQoNCmRuOiBjbj1NYXgsY249VGhyZWFkcyxjbj1Nb25pdG9yDQpvYmplY3RD
bGFzczogbW9uaXRvcmVkT2JqZWN0DQpjbjogTWF4DQpkZXNjcmlwdGlvbjog
TWF4aW11bSBudW1iZXIgb2YgdGhyZWFkcyBhcyBjb25maWd1cmVkDQoNCmRu
OiBjbj1NYXggUGVuZGluZyxjbj1UaHJlYWRzLGNuPU1vbml0b3INCm9iamVj
dENsYXNzOiBtb25pdG9yZWRPYmplY3QNCmNuOiBNYXggUGVuZGluZw0KZGVz
Y3JpcHRpb246IE1heGltdW0gbnVtYmVyIG9mIHBlbmRpbmcgdGhyZWFkcw0K
DQpkbjogY249T3Blbixjbj1UaHJlYWRzLGNuPU1vbml0b3INCm9iamVjdENs
YXNzOiBtb25pdG9yZWRPYmplY3QNCmNuOiBPcGVuDQpkZXNjcmlwdGlvbjog
TnVtYmVyIG9mIG9wZW4gdGhyZWFkcw0KDQpkbjogY249U3RhcnRpbmcsY249
VGhyZWFkcyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2Jq
ZWN0DQpjbjogU3RhcnRpbmcNCmRlc2NyaXB0aW9uOiBOdW1iZXIgb2YgdGhy
ZWFkcyBiZWluZyBzdGFydGVkDQoNCmRuOiBjbj1BY3RpdmUsY249VGhyZWFk
cyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2JqZWN0DQpj
bjogQWN0aXZlDQpkZXNjcmlwdGlvbjogTnVtYmVyIG9mIGFjdGl2ZSB0aHJl
YWRzDQoNCmRuOiBjbj1QZW5kaW5nLGNuPVRocmVhZHMsY249TW9uaXRvcg0K
b2JqZWN0Q2xhc3M6IG1vbml0b3JlZE9iamVjdA0KY246IFBlbmRpbmcNCmRl
c2NyaXB0aW9uOiBOdW1iZXIgb2YgcGVuZGluZyB0aHJlYWRzDQoNCmRuOiBj
bj1CYWNrbG9hZCxjbj1UaHJlYWRzLGNuPU1vbml0b3INCm9iamVjdENsYXNz
OiBtb25pdG9yZWRPYmplY3QNCmNuOiBCYWNrbG9hZA0KZGVzY3JpcHRpb246
IE51bWJlciBvZiBhY3RpdmUgcGx1cyBwZW5kaW5nIHRocmVhZHMNCg0KZG46
IGNuPVN0YXRlLGNuPVRocmVhZHMsY249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6
IG1vbml0b3JlZE9iamVjdA0KY246IFN0YXRlDQpkZXNjcmlwdGlvbjogVGhy
ZWFkIHBvb2wgc3RhdGUNCg0KZG46IGNuPVJ1bnF1ZXVlLGNuPVRocmVhZHMs
Y249TW9uaXRvcg0Kb2JqZWN0Q2xhc3M6IG1vbml0b3JlZE9iamVjdA0KY246
IFJ1bnF1ZXVlDQpkZXNjcmlwdGlvbjogUXVldWUgb2YgcnVubmluZyB0aHJl
YWRzIC0gYmVzaWRlcyB0aG9zZSBoYW5kbGluZyBvcGVyYXRpb25zDQoNCmRu
OiBjbj1UYXNrbGlzdCxjbj1UaHJlYWRzLGNuPU1vbml0b3INCm9iamVjdENs
YXNzOiBtb25pdG9yZWRPYmplY3QNCmNuOiBUYXNrbGlzdA0KZGVzY3JpcHRp
b246IExpc3Qgb2YgcnVubmluZyBwbHVzIHN0YW5kYnkgdGhyZWFkcyAtIGJl
c2lkZXMgdGhvc2UgaGFuZGxpbmcgb3BlDQogcmF0aW9ucw0KDQpkbjogY249
VGltZSxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvckNvbnRhaW5l
cg0KY246IFRpbWUNCmRlc2NyaXB0aW9uOiBUaGlzIHN1YnN5c3RlbSBjb250
YWlucyBpbmZvcm1hdGlvbiBhYm91dCB0aW1lLg0KDQpkbjogY249U3RhcnQs
Y249VGltZSxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2Jq
ZWN0DQpjbjogU3RhcnQNCg0KZG46IGNuPUN1cnJlbnQsY249VGltZSxjbj1N
b25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvcmVkT2JqZWN0DQpjbjogQ3Vy
cmVudA0KDQpkbjogY249VXB0aW1lLGNuPVRpbWUsY249TW9uaXRvcg0Kb2Jq
ZWN0Q2xhc3M6IG1vbml0b3JlZE9iamVjdA0KY246IFVwdGltZQ0KDQpkbjog
Y249VExTLGNuPU1vbml0b3INCm9iamVjdENsYXNzOiBtb25pdG9yQ29udGFp
bmVyDQpjbjogVExTDQpkZXNjcmlwdGlvbjogVGhpcyBzdWJzeXN0ZW0gY29u
dGFpbnMgaW5mb3JtYXRpb24gYWJvdXQgVExTLg0KDQpkbjogY249V2FpdGVy
cyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9uaXRvckNvbnRhaW5lcg0K
Y246IFdhaXRlcnMNCmRlc2NyaXB0aW9uOiBUaGlzIHN1YnN5c3RlbSBjb250
YWlucyBpbmZvcm1hdGlvbiBhYm91dCByZWFkL3dyaXRlIHdhaXRlcnMuDQoN
CmRuOiBjbj1SZWFkLGNuPVdhaXRlcnMsY249TW9uaXRvcg0Kb2JqZWN0Q2xh
c3M6IG1vbml0b3JDb3VudGVyT2JqZWN0DQpjbjogUmVhZA0KDQpkbjogY249
V3JpdGUsY249V2FpdGVycyxjbj1Nb25pdG9yDQpvYmplY3RDbGFzczogbW9u
aXRvckNvdW50ZXJPYmplY3QNCmNuOiBXcml0ZQ0KDQo=

--0-65098359-1232716543=:26208--