RE: back-bdb quirk?

["Howard Chu" <hyc@highlandsun.com>]

> -----Original Message-----
> From: Jonghyuk Choi [mailto:jongchoi@us.ibm.com]

> Pierangelo, increasing BDB_IDL_DB_SIZE worked in your case ?
> 
> buf[BDB_IDL_DB_SIZE] of bdb_idl_insert_key can overflow while running
> bdb_idl_fetch_key().
> Although I'm also not 100% sure whether increasing 
> BDB_IDL_DB_SIZE directly
> solves the problem,
> we seem to need a better management of IDL in memory.

Pierangelo reported that his problems occurred on the 16384th add. The
BDB_IDL_DB_SIZE was 65534, so changing that would have no impact on
the problem. Most likely the issue is setting a large enough BDB cachesize
for your data set. You need to make sure that the cachesize can fit
your entire working set at once. For a 10000 entry database I set the
cachesize to 2MB.
> 
> - Jong
> 
> ------------------------
> Jong Hyuk Choi
> IBM Thomas J. Watson Research Center - Enterprise Linux Group
> P. O. Box 218, Yorktown Heights, NY 10598
> email: jongchoi@us.ibm.com
> (phone) 914-945-3979    (fax) 914-945-4425   TL: 862-3979
> 
> 
> Pierangelo Masarati <masarati@aero.polimi.it>@OpenLDAP.org on 03/20/2002
> 08:52:50 AM
> 
> Sent by:    owner-openldap-devel@OpenLDAP.org
> 
> 
> To:    Howard Chu <hyc@highlandsun.com>
> cc:    openldap-devel@OpenLDAP.org
> Subject:    Re: back-bdb quirk?
> 
> 
> 
> Howard Chu wrote:
> >
> > Did you discover anything more about this problem? I have just now
> finished
> > adding 20000 entries to a database with no errors (using the current
> HEAD).
> > 0x4000 = 16384, I would have expected to see what you ran into unless
> it's
> > been fixed.
> 
> I've been out for a few days, and I had no chance to investigate or even
> retry
> with HEAD code; I'm afraid I can't work on that until Saturday. All I
> found is
> that the problem seems to be all confined in db4, so, unless it is (was)
> triggered by improper usage earlier in back-bdb, it sounds a bit
> difficult to
> investigate (I haven't studied anything of the internals of db4 yet).
> It sounds like exausting cursor resources, but I'm quite unfamiliar with
> the
> topic, sorry.
> 
> Pierangelo.
> 
> --
> Dr. Pierangelo Masarati               | voice: +39 02 2399 8309
> Dip. Ing. Aerospaziale                | fax:   +39 02 2399 8334
> Politecnico di Milano                 |
> mailto:pierangelo.masarati@polimi.it
> via La Masa 34, 20156 Milano, Italy   |
> http://www.aero.polimi.it/~masarati
> 
> 

  -- Howard Chu
  Chief Architect, Symas Corp.       Director, Highland Sun
  http://www.symas.com               http://highlandsun.com/hyc
  Symas: Premier OpenSource Development and Support