[Date Prev][Date Next]
[Chronological]
[Thread]
[Top]
restricting slapd memory consumption
Hi,
I'm wondering, how I could restrict the memory usage of the slapd process.
We got a quite large amount of data (23 million entries) in our login
ldap. Since we are still using OpenLDAP 2.0 and of course want to
migrate now, I added our data into an OpenLDAP 2.3.37 (this version will
be updated soon). The problem I stumble over is that while inserting the
data with ldapadd (mainly to check the performance we have to expect in
the future), the amount of memory the slapd uses endlessly grows. The
slapd process uses 11GB of memory after the insert has finished.
We are using the BDB backend which is currently configured to use 4GB of
shared memory.
Machine: Linux masterldap 2.6.21.5 #1 SMP Mon Jul 2 13:54:33 CEST 2007
x86_64 GNU/Linux, with 2 Dual-Core AMD Opteron(tm) Processor 2218 and
16GB of RAM.
slapd.conf (converted to cn=config format):
include /usr/local/our/ldap/etc/openldap/schema/core.schema
include /usr/local/our/ldap/etc/openldap/schema/our.schema
pidfile /usr/local/our/ldap/var/ldap/run/slapd.pid
argsfile /usr/local/our/ldap/var/ldap/run/slapd.args
# Load dynamic backend modules:
modulepath /usr/local/our/ldap/lib
moduleload back_bdb.la
access to * by * write
loglevel 0
sizelimit 10000
timelimit 3600
cachesize 1000000
tool-threads 2
# backend definition
backend bdb
database config
rootdn "cn=root,cn=config"
rootpw {SSHA}***
#######################################################################
# BDB database definitions
#######################################################################
# first database definition & config directives
database bdb
directory /usr/local/our/ldap/var/ldap/openldap-data/
replogfile /usr/local/our/ldap/log/replica.log
suffix "o=our"
rootdn "cn=root,o=our"
rootpw {SSHA}***
index cid eq
index cn eq,sub
index objectClass eq
index folderName eq
index locked eq
DB_CONFIG:
set_flags DB_LOG_AUTOREMOVE
set_cachesize 4 0 2
set_lg_max 524288000
set_lg_regionmax 512000
set_lg_bsize 268435456