RE: Corrupt index files

["Howard Chu" <hyc@symas.com>]

> -----Original Message-----
> From: owner-openldap-software@OpenLDAP.org
> [mailto:owner-openldap-software@OpenLDAP.org]On Behalf Of John Morrissey

> On Fri, Aug 09, 2002 at 10:08:16AM +0200, Isaac Cruz Ballesteros wrote:
> % Also, which is the fastest configuration in order to add about 6500000
> % entries with slapadd? I've tried openldap 2.1.3 + BDB 4, with
> nosync and a
> % lot of cache, and it gets slower and slower (I have only one disk, and it
> % writes *a lot* of logs), so I'm going to try 2.0.25 with ldbm backend (I
> % suppose this won't write logs...)
>
> If you're looking to boost input speed, try altering the BDB environment
> with something like:
>
> set_cachesize 0 500000000 2
> set_flags DB_TXN_NOSYNC
>
> in /var/lib/ldap/DB_CONFIG (or wherever your BDB files are). You
> can bump up
> the cache size even more if you've got more RAM.

Note that this example requested 500MB of RAM. Obviously you should choose
a size that actually fits into your available RAM.
>
> This will cut disk I/O and speed up the import *dramatically,* but be
> prepared to have BDB write out a *lot* of transaction logs, especially for
> 6.5M entries. Hope your disk is big. :-)

Increasing the log buffer size will also help some. With a default logfile
size
of 10MB I use a log buffer size of 2MB. But yes, you're going to have a lot
of
log data.

  -- Howard Chu
  Chief Architect, Symas Corp.       Director, Highland Sun
  http://www.symas.com               http://highlandsun.com/hyc
  Symas: Premier OpenSource Development and Support