Issue 5152 - too much logging
Summary: too much logging
Status: VERIFIED FIXED
Alias: None
Product: OpenLDAP
Classification: Unclassified
Component: slapd (show other issues)
Version: unspecified
Hardware: All All
: --- normal
Target Milestone: ---
Assignee: OpenLDAP project
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2007-09-24 22:29 UTC by babu.suresh@pacificlife.com
Modified: 2009-02-17 06:45 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this issue.
Description babu.suresh@pacificlife.com 2007-09-24 22:29:47 UTC
Full_Name: Babu
Version: 2.3.32
OS: RedHAT3
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (198.181.11.27)


Hello,

We are having hell of problems in production with # logs getting
generated..almost 4Gig worth of transaction binary/BDB logs in a day(4000 10mb
files). 

No debugging/logging turned in slapd.

Log rotate scripts is moving the logs to diff location to keep the prod up..but
few times we ran of space and I don't find any clue on minimize and log only for
updated transactions. It seems BDB is recording every read/write(not sure)..I
can't enable Auto_Achieve as need them for recovery.

Any known issue in the space? How to turn of unwanted logging of BDB?


==================Here are the detail of prod volume & DB_CONFIG file=====
openldap-2.3.32&BDB 4.5.20
our ldap/BDB is generating too many logs file. 
Total records in ldap/BDB - 110k
Reads  - 10k/day
Updates - 1k/day

=================DB_CONFIG=======
# one 0.25 GB cache
#set_cachesize 0 268435456 1
set_cachesize 0 	5242880 1

# Data Directory
set_lk_max_locks   8000
set_lk_max_lockers 8000
set_lk_max_objects 8000
set_lg_max      8048576

===============SLAPD.conf========
Nothing special in and inxed we have are========

#index
index   uid     eq
index   cn      eq
index   uniqueMember    eq
index   objectClass     pres,eq
=============

thank you

# Transaction Log settings
set_lg_regionmax 262144
set_lg_bsize 2097152


Comment 1 babu.suresh@pacificlife.com 2007-09-25 00:06:26 UTC
Guys,

Any input is greatly appreciated. Please let me know if you need more
details of the issue.

Thank you
_babu 

-----Original Message-----
From: openldap-its@OpenLDAP.org [mailto:openldap-its@OpenLDAP.org] 
Sent: Monday, September 24, 2007 3:30 PM
To: Suresh, Babu
Subject: Re: (ITS#5152) too much logging


*** THIS IS AN AUTOMATICALLY GENERATED REPLY ***

Thanks for your report to the OpenLDAP Issue Tracking System.  Your
report has been assigned the tracking number ITS#5152.

One of our support engineers will look at your report in due course.
Note that this may take some time because our support engineers are
volunteers.  They only work on OpenLDAP when they have spare time.

If you need to provide additional information in regards to your issue
report, you may do so by replying to this message.  Note that any mail
sent to openldap-its@openldap.org with (ITS#5152) in the subject will
automatically be attached to the issue report.

	mailto:openldap-its@openldap.org?subject=(ITS#5152)

You may follow the progress of this report by loading the following URL
in a web browser:
    http://www.OpenLDAP.org/its/index.cgi?findid=5152

Please remember to retain your issue tracking number (ITS#5152) on any
further messages you send to us regarding this report.  If you don't
then you'll just waste our time and yours because we won't be able to
properly track the report.

Please note that the Issue Tracking System is not intended to be used to
seek help in the proper use of OpenLDAP Software.
Such requests will be closed.

OpenLDAP Software is user supported.
	http://www.OpenLDAP.org/support/

--------------
Copyright 1998-2006 The OpenLDAP Foundation, All Rights Reserved.



------------------------------------------------------------------------------
The information in this e-mail and any attachments are for the sole use of the intended recipient and may contain privileged and confidential information.  If you are not the intended recipient, any use, disclosure, copying or distribution of this message or attachment is strictly prohibited.  If you believe that you have received this e-mail in error, please contact the sender immediately and delete the e-mail and all of its attachments.
==============================================================================


Comment 2 Howard Chu 2007-09-25 02:18:05 UTC
babu.suresh@pacificlife.com wrote:
> Full_Name: Babu
> Version: 2.3.32
> OS: RedHAT3
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (198.181.11.27)
> 
> 
> Hello,
> 
> We are having hell of problems in production with # logs getting
> generated..almost 4Gig worth of transaction binary/BDB logs in a day(4000 10mb
> files). 
> 
> No debugging/logging turned in slapd.
> 
> Log rotate scripts is moving the logs to diff location to keep the prod up..but
> few times we ran of space and I don't find any clue on minimize and log only for
> updated transactions. It seems BDB is recording every read/write(not sure)..I
> can't enable Auto_Achieve as need them for recovery.
> 
> Any known issue in the space? How to turn of unwanted logging of BDB?

Learn how to use BerkeleyDB.
http://www.oracle.com/technology/documentation/berkeley-db/db/ref/transapp/archival.html

The ITS is for reporting actual bugs in the software. There is no bug here. 
This ITS will be closed.
-- 
   -- Howard Chu
   Chief Architect, Symas Corp.  http://www.symas.com
   Director, Highland Sun        http://highlandsun.com/hyc/
   Chief Architect, OpenLDAP     http://www.openldap.org/project/

Comment 3 Howard Chu 2007-09-25 02:30:30 UTC
changed state Open to Closed
Comment 4 babu.suresh@pacificlife.com 2007-09-25 22:05:29 UTC
Hello,

I got the DB recovery part...my problem more of hell of logs files..I
want to know anyway we can minimize the logging of DB? Any option in my
DB_CONFIG causing this?

Please help..

_babu 

-----Original Message-----
From: Howard Chu [mailto:hyc@symas.com] 
Sent: Monday, September 24, 2007 7:18 PM
To: Suresh, Babu
Cc: openldap-its@openldap.org
Subject: Re: (ITS#5152) too much logging

babu.suresh@pacificlife.com wrote:
> Full_Name: Babu
> Version: 2.3.32
> OS: RedHAT3
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (198.181.11.27)
> 
> 
> Hello,
> 
> We are having hell of problems in production with # logs getting 
> generated..almost 4Gig worth of transaction binary/BDB logs in a 
> day(4000 10mb files).
> 
> No debugging/logging turned in slapd.
> 
> Log rotate scripts is moving the logs to diff location to keep the 
> prod up..but few times we ran of space and I don't find any clue on 
> minimize and log only for updated transactions. It seems BDB is 
> recording every read/write(not sure)..I can't enable Auto_Achieve as
need them for recovery.
> 
> Any known issue in the space? How to turn of unwanted logging of BDB?

Learn how to use BerkeleyDB.
http://www.oracle.com/technology/documentation/berkeley-db/db/ref/transa
pp/archival.html

The ITS is for reporting actual bugs in the software. There is no bug
here. 
This ITS will be closed.
-- 
   -- Howard Chu
   Chief Architect, Symas Corp.  http://www.symas.com
   Director, Highland Sun        http://highlandsun.com/hyc/
   Chief Architect, OpenLDAP     http://www.openldap.org/project/


------------------------------------------------------------------------------
The information in this e-mail and any attachments are for the sole use of the intended recipient and may contain privileged and confidential information.  If you are not the intended recipient, any use, disclosure, copying or distribution of this message or attachment is strictly prohibited.  If you believe that you have received this e-mail in error, please contact the sender immediately and delete the e-mail and all of its attachments.
==============================================================================


Comment 5 Howard Chu 2009-02-17 06:45:24 UTC
moved from Incoming to Archive.Incoming