[Date Prev][Date Next]
[Chronological]
[Thread]
[Top]
Re: Slow to add 1 million items
Am Tue, 4 Feb 2014 10:25:15 +0000
schrieb Chris Card <ctcard@hotmail.com>:
> ________________________________
>
> > Hello all,
> >
> > I've been Google'ing around and searching the archives, but I
> > haven't quite been able to find an answer, so I wanted to ask the
> > list.
> >
> > I've been experimenting with OpenLDAP adds to see how quickly we
> > can get data inserted into the DB.
> >
> > I'm using Ubuntu 10.04, and I've tried both the packaged OpenLDAP
> > 2.4.21 using hdb, and just recently the latest OpenLDAP 2.4.39
> > using lmdb, both with relatively similar results.
> >
> > The short version is: to insert 1 million records, it's taking
> > about 8 hours on a machine with 2GB RAM / 3Ghz / SSD, which seems
> > like a long time to me.
> >
> > The insert method is to use a single big ldiff file like this:
have you read slapd-hdb(5) and slapd-mdb(5) on proper database
configuration?
a slapadd of 1 mio entries takes about 30 min, depending on hardware
and filesystem, I haven't used ldapadd for some time, but it shouldn't
take much longer.
-Dieter
--
Dieter KlÃnter | Systemberatung
http://dkluenter.de
GPG Key ID: E9ED159B
53Â37'09,95"N
10Â08'02,42"E