[Date Prev][Date Next]
Re: Less aggressive syncrepl ?
Quanah Gibson-Mount wrote:
--On Tuesday, March 02, 2010 7:58 PM +0100 email@example.com wrote:
25 consumers doing a full refresh probably ate up all threads
the producer. You should either cascade your consumers (build a
replication chain where a layer of consumers acts as producers for the
remaining), or increase the number of threads on the producer.
Using delta-syncrepl can also help reduce such a load.
So if I understand it completely:
* I could increase Threads on ldapmaster, from the default (16?) to say 32.
It is a 4 core server, dedicated to slapd. Most documentation does seem to
discourage this though.
However, doing something like rsync will generally only yield 500KB/s to 1MB/s
of speed. Most likely due to disk IO. It appears that it had 25 or so servers
trying to do a complete sync/consistency-check. So perhaps there just isn't more
to get out of it while the setup is this way.
* Make master sync only to slave01 and slave02, and they in turn, sync to
everyone else. Is this the recommended setup?
Change the other 23 servers to sync with slave01 and slave02 instead. This way
master only has a few servers to sync with, and each slave has "its share of the
workload". But can I specify more than one "provider" in syncrepl command as a
But I would guess you can not. (it only has one master right now anyway, just
* Investigate delta-sync
Unknown to me, will need to research if our current ldap software version can
support it. Perhaps try it on the test-servers.
* Logical tree split
I guess potentially I could run multiple masters, and have separate trees (one
for mail, one for www, one for dns etc) but it would be nice not to have to do that.
For the time being I stopped syncrepl on all but 10 servers, so that we could
have a read/write ldapmaster while it sorted itself out. It appears those 10
servers needed about 14 hours to sync. I have re-added the remaining servers to
sync now and we should be back to stable in 14 hours or so.
Jorgen Lundman | <firstname.lastname@example.org>
Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work)
Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell)
Japan | +81 (0)3 -3375-1767 (home)