[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: Fast massive ldif load





--On October 7, 2009 11:09:18 PM +0200 Emmanuel Lecharny <elecharny@apache.org> wrote:

Quanah Gibson-Mount wrote:


--On October 7, 2009 3:32:51 PM -0400 Aaron Richton
<richton@nbcs.rutgers.edu> wrote:

On Wed, 7 Oct 2009, iz1ksw iz1ksw wrote:

What is the fastest way (in terms of openldap settings) to perform a
massive load (~200MB ldif file) of data into openldap directory?

Try "slapadd -q" (read slapadd(8) man page to get started).

slapadd -q is important, but so is having a large enough BDB cache in
the DB_CONFIG file, plus setting the right number of tool threads.  I
took a load down from 17 hours to less than 2 hours adjusting all of
those correctly and adding -q.

The LDIF file is only 200Mb large. It should be a matter of minutes to
load it on a decent machine, even when using the standard parameters :)


There is not a 1 to 1 correlation between LDIF file size and resulting database size. My LDIF file was 300MB and the resulting database was 12.5 GB.

--Quanah


--

Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra ::  the leader in open source messaging and collaboration