(ITS#3585) Patch: Slurpd taking in too many objects (killed by AIX) + slurpd -g/-u

[hdnews@gawab.com]

Full_Name: Hans Oesterholt-Dijkema & Bas ten Berge
Version: 2.2.23
OS: AIX 5.2L
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (194.134.135.5)


SLURPD MEMORY PROBLEM PATCH
---------------------------

While our volume of objects in LDAP is increasing
we encountered problems doing replication on our AIX
platform.  In certain situations we need  to replicate
a large number of objects in a relativly short time.

As the slave servers can't keep up with the replication
process, the queue of objects to be processed gets very
large (>1GB). 

Slurpd keeps taking in objects from the replication log,
because it's waiting for an end of file. This goes on,
until slurpd is taking up 256MB of memory, after which
AIX kills it. Because the replication log keeps growing, 
restarting slurpd doesn't help, it just dies again.

As we are running openldap in a production environment,
this behaviour was not acceptable for us. We cannot have
a slurpd dying, because we depend on it to replicate a
master server to several slave servers.

So we've made a patch on openldap-stable 2.2.23. Now
it is possible to configure 'replica-max-object-queue-depth' in
slapd.conf. It defaults to 2500 objects. This makes slurpd
keeping the object queue to about 2500 objects (it will still
slowly increase if an LDAP server is not available (one object
per 2 seconds)).

This patch has been made against openldap 2.2.23 and can be installed, doing:

   cd openldap-2.2.23
   patch -p1 <[whereverthepatchmayreside]/slurpd.object.take.in.and.uid.gid.patch


SLURPD -u/-g OPTION
-------------------

This patch enables slurpd to be started as a specific user or group,
just like slapd. 

###################################################################
Hello Hans,

Friday, March 4, 2005, 3:38:42 PM, you wrote:

HOD> Dear All,

HOD> While working on the 'replica-max-object-queue-depth' patch
HOD> we also worked on providing -u/-g behaviour to slurpd, as is
HOD> available for slapd.

HOD> Is anyone interested in a patch for this?

In ALT Linux Distrib we have patch like this, but I'll be very glad to
see your patch!

HOD> Best whishes,

HOD> Hans Oesterholt-Dijkema & Bas ten Berge

-- Best regards, Volkov 
###################################################################

This patch has been made against openldap 2.2.23 and can be installed, doing:

   cd openldap-2.2.23
   patch -p1 <[whereverthepatchmayreside]/slurpd.object.take.in.and.uid.gid.patch

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Note, both patches are in one patch. Sorry for the inconveniance!