OpenLDAP
Up to top level
Build   Contrib   Development   Documentation   Historical   Incoming   Software Bugs   Software Enhancements   Web  

Logged in as guest

Viewing Archive.Incoming/5152
Full headers

From: babu.suresh@pacificlife.com
Subject: too much logging
Compose comment
Download message
State:
0 replies:
3 followups: 1 2 3

Major security issue: yes  no

Notes:

Notification:


Date: Mon, 24 Sep 2007 22:29:47 GMT
From: babu.suresh@pacificlife.com
To: openldap-its@OpenLDAP.org
Subject: too much logging
Full_Name: Babu
Version: 2.3.32
OS: RedHAT3
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (198.181.11.27)


Hello,

We are having hell of problems in production with # logs getting
generated..almost 4Gig worth of transaction binary/BDB logs in a day(4000 10mb
files). 

No debugging/logging turned in slapd.

Log rotate scripts is moving the logs to diff location to keep the prod up..but
few times we ran of space and I don't find any clue on minimize and log only for
updated transactions. It seems BDB is recording every read/write(not sure)..I
can't enable Auto_Achieve as need them for recovery.

Any known issue in the space? How to turn of unwanted logging of BDB?


==================Here are the detail of prod volume & DB_CONFIG file=====
openldap-2.3.32&BDB 4.5.20
our ldap/BDB is generating too many logs file. 
Total records in ldap/BDB - 110k
Reads  - 10k/day
Updates - 1k/day

=================DB_CONFIG=======
# one 0.25 GB cache
#set_cachesize 0 268435456 1
set_cachesize 0 	5242880 1

# Data Directory
set_lk_max_locks   8000
set_lk_max_lockers 8000
set_lk_max_objects 8000
set_lg_max      8048576

===============SLAPD.conf========
Nothing special in and inxed we have are========

#index
index   uid     eq
index   cn      eq
index   uniqueMember    eq
index   objectClass     pres,eq
=============

thank you

# Transaction Log settings
set_lg_regionmax 262144
set_lg_bsize 2097152



Followup 1

Download message
Subject: RE: (ITS#5152) too much logging
Date: Mon, 24 Sep 2007 17:06:26 -0700
From: "Suresh, Babu" <Babu.Suresh@pacificlife.com>
To: openldap-its@openldap.org
Guys,

Any input is greatly appreciated. Please let me know if you need more
details of the issue.

Thank you
_babu 

-----Original Message-----
From: openldap-its@OpenLDAP.org [mailto:openldap-its@OpenLDAP.org] 
Sent: Monday, September 24, 2007 3:30 PM
To: Suresh, Babu
Subject: Re: (ITS#5152) too much logging


*** THIS IS AN AUTOMATICALLY GENERATED REPLY ***

Thanks for your report to the OpenLDAP Issue Tracking System.  Your
report has been assigned the tracking number ITS#5152.

One of our support engineers will look at your report in due course.
Note that this may take some time because our support engineers are
volunteers.  They only work on OpenLDAP when they have spare time.

If you need to provide additional information in regards to your issue
report, you may do so by replying to this message.  Note that any mail
sent to openldap-its@openldap.org with (ITS#5152) in the subject will
automatically be attached to the issue report.

	mailto:openldap-its@openldap.org?subject=(ITS#5152)

You may follow the progress of this report by loading the following URL
in a web browser:
    http://www.OpenLDAP.org/its/index.cgi?findid=5152

Please remember to retain your issue tracking number (ITS#5152) on any
further messages you send to us regarding this report.  If you don't
then you'll just waste our time and yours because we won't be able to
properly track the report.

Please note that the Issue Tracking System is not intended to be used to
seek help in the proper use of OpenLDAP Software.
Such requests will be closed.

OpenLDAP Software is user supported.
	http://www.OpenLDAP.org/support/

--------------
Copyright 1998-2006 The OpenLDAP Foundation, All Rights Reserved.



------------------------------------------------------------------------------
The information in this e-mail and any attachments are for the sole use of the
intended recipient and may contain privileged and confidential information.  If
you are not the intended recipient, any use, disclosure, copying or distribution
of this message or attachment is strictly prohibited.  If you believe that you
have received this e-mail in error, please contact the sender immediately and
delete the e-mail and all of its attachments.
==============================================================================




Followup 2

Download message
Date: Mon, 24 Sep 2007 19:18:05 -0700
From: Howard Chu <hyc@symas.com>
To: babu.suresh@pacificlife.com
CC: openldap-its@openldap.org
Subject: Re: (ITS#5152) too much logging
babu.suresh@pacificlife.com wrote:
> Full_Name: Babu
> Version: 2.3.32
> OS: RedHAT3
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (198.181.11.27)
> 
> 
> Hello,
> 
> We are having hell of problems in production with # logs getting
> generated..almost 4Gig worth of transaction binary/BDB logs in a day(4000
10mb
> files). 
> 
> No debugging/logging turned in slapd.
> 
> Log rotate scripts is moving the logs to diff location to keep the prod
up..but
> few times we ran of space and I don't find any clue on minimize and log
only for
> updated transactions. It seems BDB is recording every read/write(not
sure)..I
> can't enable Auto_Achieve as need them for recovery.
> 
> Any known issue in the space? How to turn of unwanted logging of BDB?

Learn how to use BerkeleyDB.
http://www.oracle.com/technology/documentation/berkeley-db/db/ref/transapp/archival.html

The ITS is for reporting actual bugs in the software. There is no bug here. 
This ITS will be closed.
-- 
   -- Howard Chu
   Chief Architect, Symas Corp.  http://www.symas.com
   Director, Highland Sun        http://highlandsun.com/hyc/
   Chief Architect, OpenLDAP     http://www.openldap.org/project/



Followup 3

Download message
Subject: RE: (ITS#5152) too much logging
Date: Tue, 25 Sep 2007 15:05:29 -0700
From: "Suresh, Babu" <Babu.Suresh@pacificlife.com>
To: "Howard Chu" <hyc@symas.com>
cc: openldap-its@openldap.org
Hello,

I got the DB recovery part...my problem more of hell of logs files..I
want to know anyway we can minimize the logging of DB? Any option in my
DB_CONFIG causing this?

Please help..

_babu 

-----Original Message-----
From: Howard Chu [mailto:hyc@symas.com] 
Sent: Monday, September 24, 2007 7:18 PM
To: Suresh, Babu
Cc: openldap-its@openldap.org
Subject: Re: (ITS#5152) too much logging

babu.suresh@pacificlife.com wrote:
> Full_Name: Babu
> Version: 2.3.32
> OS: RedHAT3
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (198.181.11.27)
> 
> 
> Hello,
> 
> We are having hell of problems in production with # logs getting 
> generated..almost 4Gig worth of transaction binary/BDB logs in a 
> day(4000 10mb files).
> 
> No debugging/logging turned in slapd.
> 
> Log rotate scripts is moving the logs to diff location to keep the 
> prod up..but few times we ran of space and I don't find any clue on 
> minimize and log only for updated transactions. It seems BDB is 
> recording every read/write(not sure)..I can't enable Auto_Achieve as
need them for recovery.
> 
> Any known issue in the space? How to turn of unwanted logging of BDB?

Learn how to use BerkeleyDB.
http://www.oracle.com/technology/documentation/berkeley-db/db/ref/transa
pp/archival.html

The ITS is for reporting actual bugs in the software. There is no bug
here. 
This ITS will be closed.
-- 
   -- Howard Chu
   Chief Architect, Symas Corp.  http://www.symas.com
   Director, Highland Sun        http://highlandsun.com/hyc/
   Chief Architect, OpenLDAP     http://www.openldap.org/project/


------------------------------------------------------------------------------
The information in this e-mail and any attachments are for the sole use of the
intended recipient and may contain privileged and confidential information.  If
you are not the intended recipient, any use, disclosure, copying or distribution
of this message or attachment is strictly prohibited.  If you believe that you
have received this e-mail in error, please contact the sender immediately and
delete the e-mail and all of its attachments.
==============================================================================



Up to top level
Build   Contrib   Development   Documentation   Historical   Incoming   Software Bugs   Software Enhancements   Web  

Logged in as guest


The OpenLDAP Issue Tracking System uses a hacked version of JitterBug

______________
© Copyright 2013, OpenLDAP Foundation, info@OpenLDAP.org