[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: slapd stability problems with add/change operations



Quanah Gibson-Mount wrote:

I'm not quite sure what you mean here.

Are you:

1) set up slapd configuration
  leave slapd off
  slapadd database

yes, sorry for the confusion. I do this but it locks *after* slapdadd finished properly and I start the DB. So I think it's your 3) if I understand you correctly:


3) set up slapd configuration
  leave slapd off
  slapadd database

start slapd

do more adds via ldapmodify

via the perl-interface to LDAP from our metadatabase that is. (btw, can that be a problem?)


On debian we even migrated from kernel 2.4 to 2.6 because we thought it might be a native thread problem, but same game. I definitely want to do a dump with the debug-version tomorrow, but as I said I need some hints. I know how to build it and I know how to attach to the process with GDB, but what exactly do I have to deliver after that? Would be nice if you could give me some hints so I can do that tomorrow.

Attached are two files, the first is the slapd log with the add that actually hangs the machine, the second is the same timeframe with strace. Note the sched_yield() at the end, that goes on like this forever. More details hopefully tomorrow with the friendly support of gdb... :)

cu

Adrian



--
Adrian Gschwend
System Administrator
Berne University of Applied Sciences
Biel, Switzerland
Aug 17 14:34:41 herodot slapd[2949]: conn=11 fd=19 ACCEPT from IP=147.87.244.193:35302 (IP=147.87.96.34:636)
Aug 17 14:34:41 herodot slapd[2949]: conn=10 op=2 UNBIND
Aug 17 14:34:41 herodot slapd[2949]: conn=10 fd=18 closed
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=0 BIND dn="cn=ldap-slave,ou=srv-account,dc=bfh,dc=ch" method=128
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=0 BIND dn="cn=ldap-slave,ou=srv-account,dc=bfh,dc=ch" mech=SIMPLE ssf=0
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=0 RESULT tag=97 err=0 text=
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=1 SRCH base="dc=bfh,dc=ch" scope=2 deref=0 filter="(objectClass=*)"
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=1 SRCH attr=* +
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=113 SRCH base="dc=bfh,dc=ch" scope=2 deref=2 filter="(&(cn=inr_wgs.fbw-prof)(objectClass=posixGroup))"
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=113 SRCH attr=gidNumber
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=113 SEARCH RESULT tag=101 err=0 nentries=1 text=
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=114 SRCH base="dc=bfh,dc=ch" scope=2 deref=2 filter="(uid=gec2)"
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=114 SRCH attr=uid
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=114 SEARCH RESULT tag=101 err=0 nentries=0 text=
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=1 SEARCH RESULT tag=101 err=0 nentries=16 text=
Aug 17 14:34:41 herodot slapd[2949]: conn=11 op=2 UNBIND
Aug 17 14:34:41 herodot slapd[2949]: conn=11 fd=19 closed
Aug 17 14:34:41 herodot slapd[2949]: conn=8 op=115 ADD dn="cn=Grosjean Claude [gec2],ou=FBW,ou=Staff,ou=WGS,dc=bfh,dc=ch"
2954  send(3, "<167>Aug 17 14:34:41 slapd[2949]"..., 119, 0 <unfinished ...>
2950  select(20, [4 6 7 8 9 12], [], NULL, NULL <unfinished ...>
2954  <... send resumed> )              = 119
2954  rt_sigaction(SIGPIPE, {SIG_IGN}, NULL, 8) = 0
2954  pread(11, "\2\0\0\0004\356\233\0\1\0\0\0\0\0\0\0\0\0\0\0\2\0\340\17"..., 4096, 4096) = 4096
2954  pread(11, "\4\0\0\0%\37\"\0\266\0\0\0\0\0\0\0\0\0\0\0f\0h\6\2\3\364"..., 4096, 745472) = 4096
2954  pread(11, "\4\0\0\0\307\2012\0G\0\0\0D\0\0\0I\0\0\0V\0\4\3\1\5P\3"..., 4096, 290816) = 4096
2954  time(NULL)                        = 1124282081
2954  time([1124282081])                = 1124282081
2954  gettimeofday({1124282081, 677892}, NULL) = 0
2954  pread(11, "\4\0\0\0-\\\"\0\267\0\0\0\0\0\0\0\0\0\0\0m\0\344\5\2\3"..., 4096, 749568) = 4096
2954  pread(11, "\4\0\0\0\t\v/\0H\0\0\0E\0\0\0J\0\0\0\\\0\344\1\1\5\270"..., 4096, 294912) = 4096
2954  pread(11, "\4\0\0\0\377\2022\0\255\0\0\0\251\0\0\0\270\0\0\0\254\0"..., 4096, 708608) = 4096
2954  pread(11, "\4\0\0\0{\2032\0\334\0\0\0\331\0\0\0\7\0\0\0x\1\314\10"..., 4096, 901120) = 4096
2954  pread(11, "\4\0\0\0\367\2032\0\320\0\0\0\274\0\0\0\325\0\0\0V\000"..., 4096, 851968) = 4096
2954  pread(11, "\3\0\0\0r\vr\0\326\0\0\0\325\0\0\0\0\0\0\0\30\1\0\n\1\5"..., 4096, 876544) = 4096
2954  pread(11, "\4\0\0\0\177\2042\0\332\0\0\0a\2\0\0\0\0\0\0\2\0\344\17"..., 4096, 892928) = 4096
2954  pread(11, "\4\0\0\0p\302.\0\347\0\0\0\0\0\0\0\350\0\0\0h\1\300\4\1"..., 4096, 946176) = 4096
2954  pread(11, "\4\0\0\0;\2042\0\350\0\0\0\347\0\0\0\0\0\0\0\371\0008\10"..., 4096, 950272) = 4096
2954  pread(10, "\4\0\0\0Bc1\0\0\0\0\0b1\5\0\t\0\0\0\0@\0\0\0\t\0\0\0\0"..., 16384, 0) = 16384
2954  pread(13, "\1\0\0\0\216T6\0\4\0\0\0\0\0\0\0\5\0\0\0\10\0\264\17\1"..., 4096, 16384) = 4096
2954  pread(13, "\4\0\0\0g\2132\0\2\0\0\0\211\f\0\0\0\0\0\0\t\0t\17\2\3"..., 4096, 8192) = 4096
2954  pread(13, "\1\0\0\0&Q@\0\16\0\0\0\0\0\0\0\17\0\0\0\225\1X\3\1\f\370"..., 4096, 57344) = 4096
2954  pread(13, "\4\0\0\0#\2132\0F\0\0\0?\0\0\0\0\0\0\0,\0\240\16\1\f\370"..., 4096, 286720) = 4096
2954  pread(13, "\4\0\0\0\343\2132\0\10\0\0\0\31\v\0\0\0\0\0\0\10\0\204"..., 4096, 32768) = 4096
2954  pread(13, "\1\0\0\0_8\\\0\20\0\0\0\0\0\0\0\21\0\0\0\225\1X\3\1\f\370"..., 4096, 65536) = 4096
2954  pread(13, "\4\0\0\0\237\2132\0@\0\0\0009\0\0\0\0\0\0\0I\0\270\r\1"..., 4096, 262144) = 4096
2954  pread(13, "\4\0\0\0_\2142\0\t\0\0\0\31\v\0\0\0\0\0\0\10\0\204\17\2"..., 4096, 36864) = 4096
2954  pread(13, "\1\0\0\0KJ\\\0\22\0\0\0\0\0\0\0\23\0\0\0\225\1X\3\1\f\370"..., 4096, 73728) = 4096
2954  pread(13, "\4\0\0\0\33\2142\0A\0\0\0:\0\0\0\0\0\0\0I\0\270\r\1\f\370"..., 4096, 266240) = 4096
2954  pread(13, "\1\0\0\0\352\3235\0\5\0\0\0\4\0\0\0\6\0\0\0\6\0\314\17"..., 4096, 20480) = 4096
2954  pread(13, "\4\0\0\0\333\2142\0\v\0\0\0\22\v\0\0\0\0\0\0\10\0\204\17"..., 4096, 45056) = 4096
2954  pread(13, "\1\0\0\0\375\231\\\0\26\0\0\0\0\0\0\0\27\0\0\0\225\1X\3"..., 4096, 90112) = 4096
2954  pread(13, "\4\0\0\0\227\2142\0C\0\0\0<\0\0\0\0\0\0\0B\0\360\r\1\f"..., 4096, 274432) = 4096
2954  pread(13, "\1\0\0\0\21787\0\6\0\0\0\5\0\0\0\7\0\0\0\2\0\354\17\1\5"..., 4096, 24576) = 4096
2954  pread(13, "\4\0\0\0W\2152\0\r\0\0\0\22\v\0\0\0\0\0\0\10\0\204\17\2"..., 4096, 53248) = 4096
2954  pread(13, "\1\0\0\0\351\253\\\0\30\0\0\0\0\0\0\0\31\0\0\0\225\1X\3"..., 4096, 98304) = 4096
2954  pread(13, "\4\0\0\0\23\2152\0D\0\0\0=\0\0\0\0\0\0\0B\0\360\r\1\f\370"..., 4096, 278528) = 4096
2954  pread(13, "\4\0\0\0\323\2152\0\f\0\0\0\375\n\0\0\0\0\0\0\10\0\204"..., 4096, 49152) = 4096
2954  pread(13, "\1\0\0\0]\344]\0\32\0\0\0\0\0\0\0\33\0\0\0\225\1X\3\1\f"..., 4096, 106496) = 4096
2954  pread(13, "\4\0\0\0\217\2152\0E\0\0\0>\0\0\0\0\0\0\0004\0`\16\1\f"..., 4096, 282624) = 4096
2954  pread(13, "\4\0\0\0O\2162\0\n\0\0\0\31\v\0\0\0\0\0\0\10\0\204\17\2"..., 4096, 40960) = 4096
2954  pread(13, "\1\0\0\0\3]\\\0\24\0\0\0\0\0\0\0\25\0\0\0\225\1X\3\1\f"..., 4096, 81920) = 4096
2954  pread(13, "\4\0\0\0\v\2162\0B\0\0\0;\0\0\0\0\0\0\0I\0\270\r\1\f\370"..., 4096, 270336) = 4096
2954  stat64("/var/lib/ldap/gidNumber.bdb", {st_mode=S_IFREG|0600, st_size=77824, ...}) = 0
2954  stat64("/var/lib/ldap/gidNumber.bdb", {st_mode=S_IFREG|0600, st_size=77824, ...}) = 0
2954  open("/var/lib/ldap/gidNumber.bdb", O_RDWR|O_LARGEFILE) = 18
2954  fcntl64(18, F_SETFD, FD_CLOEXEC)  = 0
2954  read(18, "\4\0\0\0\221\272\t\0\0\0\0\0b1\5\0\t\0\0\0\0\20\0\0\0\t"..., 512) = 512
2954  close(18)                         = 0
2954  stat64("/var/lib/ldap/gidNumber.bdb", {st_mode=S_IFREG|0600, st_size=77824, ...}) = 0
2954  open("/var/lib/ldap/gidNumber.bdb", O_RDWR|O_LARGEFILE) = 18
2954  fcntl64(18, F_SETFD, FD_CLOEXEC)  = 0
2954  fstat64(18, {st_mode=S_IFREG|0600, st_size=77824, ...}) = 0
2954  pread(18, "\4\0\0\0\221\272\t\0\0\0\0\0b1\5\0\t\0\0\0\0\20\0\0\0\t"..., 4096, 0) = 4096
2954  time(NULL)                        = 1124282081
2954  pread(18, "\3\0\0\0TW@\0\1\0\0\0\0\0\0\0\0\0\0\0\n\0d\17\2\3\364\17"..., 4096, 4096) = 4096
2954  pread(18, "\4\0\0\0\277\2162\0\4\0\0\0\17\0\0\0\f\0\0\0F\1\24\n\1"..., 4096, 16384) = 4096
2954  pread(14, "\4\0\0\0GD\"\0\371\0\0\0\0\0\0\0\0\0\0\0\333\0T\2\2\3\364"..., 4096, 1019904) = 4096
2954  pread(14, "\4\0\0\0\fX1\0\242\1\0\0!\1\0\0 \0\0\0\222\1\230\7\1\5"..., 4096, 1712128) = 4096
2954  pread(14, "\4\0\0\0V\321&\0\16\1\0\0006\0\0\0\231\1\0\0\304\0\250"..., 4096, 1105920) = 4096
2954  pread(14, "\4\0\0\0$\242\'\0\265\1\0\0k\1\0\0004\0\0\0\246\1\320\7"..., 4096, 1789952) = 4096
2954  pread(14, "\4\0\0\0\266\311/\0001\0\0\0\233\1\0\0(\1\0\0\32\1\260"..., 4096, 200704) = 4096
2954  pread(14, "\4\0\0\0\336\264/\0\276\0\0\0k\0\0\0006\1\0\0N\1\220\10"..., 4096, 778240) = 4096
2954  pread(14, "\4\0\0\0\220Z1\0\260\1\0\0\0\1\0\0<\0\0\0V\1`\10\1\5\370"..., 4096, 1769472) = 4096
2954  pread(14, "\4\0\0\0\224\361-\0`\1\0\0\342\0\0\0f\0\0\0\250\1\200\6"..., 4096, 1441792) = 4096
2954  pread(14, "\4\0\0\0P\3200\0d\1\0\0\322\0\0\0S\0\0\0\324\1\210\5\1"..., 4096, 1458176) = 4096
2954  pread(14, "\4\0\0\0\254\257&\0\261\0\0\0x\0\0\0,\1\0\0\n\1\260\n\1"..., 4096, 724992) = 4096
2954  pread(14, "\4\0\0\0~\2621\0008\1\0\0\323\0\0\0O\0\0\0\16\2\360\4\1"..., 4096, 1277952) = 4096
2954  pread(14, "\4\0\0\0\372\324)\0a\1\0\0\344\0\0\0[\0\0\0\314\1\310\6"..., 4096, 1445888) = 4096
2954  pread(14, "\4\0\0\0\274\261&\0\6\1\0\0 \0\0\0\214\1\0\0\322\0\260"..., 4096, 1073152) = 4096
2954  pread(14, "\4\0\0\0\22;1\0y\0\0\0T\1\0\0\304\0\0\0t\1 \10\1\5\370"..., 4096, 495616) = 4096
2954  pread(14, "\4\0\0\0\314\2120\0f\1\0\0\27\1\0\0b\0\0\0\256\1\240\5"..., 4096, 1466368) = 4096
2954  pread(14, "\4\0\0\0\314\263&\0L\0\0\0\266\1\0\0\351\0\0\0\270\0\354"..., 4096, 311296) = 4096
2954  pread(14, "\4\0\0\0\234x+\0Z\1\0\0\302\0\0\0#\0\0\0\316\1\310\6\1"..., 4096, 1417216) = 4096
2954  pread(14, "\4\0\0\0\253z2\0i\0\0\0\274\1\0\0\n\0\0\0\366\1t\6\1\5"..., 4096, 430080) = 4096
2954  pread(14, "\4\0\0\0\3w2\0\34\0\0\0\36\1\0\0\253\0\0\0\262\1\250\6"..., 4096, 114688) = 4096
2954  pread(14, "\4\0\0\0I\361/\0\v\1\0\0\244\0\0\0\271\1\0\0\300\0\310"..., 4096, 1093632) = 4096
2954  pread(14, "\4\0\0\0\210*2\0\177\1\0\0S\0\0\0~\0\0\0\240\1\0\7\1\5"..., 4096, 1568768) = 4096
2954  pread(14, "\4\0\0\0\253\2252\0Y\1\0\0\321\0\0\0\7\0\0\0\356\1\200"..., 4096, 1413120) = 4096
2954  pread(14, "\4\0\0\0\4\3131\0Y\0\0\0y\1\0\0\201\0\0\0d\0\304\r\1\5"..., 4096, 364544) = 4096
2954  pread(14, "\4\0\0\0\353|2\0\310\0\0\0\0\0\0\0\0\0\0\0^\1\20\5\1\f"..., 4096, 819200) = 4096
2954  pread(14, "\4\0\0\0\4Y1\0J\1\0\0\324\0\0\0(\0\0\0\362\1P\5\1\5\370"..., 4096, 1351680) = 4096
2954  pread(14, "\4\0\0\0\227t2\0\5\0\0\0\310\1\0\0\306\0\0\0\360\1\244"..., 4096, 20480) = 4096
2954  pread(14, "\4\0\0\0\270\212*\0\257\1\0\0\32\1\0\0F\0\0\0H\1\210\10"..., 4096, 1765376) = 4096
2954  pread(14, "\4\0\0\0004\273&\0k\1\0\0\334\0\0\0\265\1\0\0\266\0p\f"..., 4096, 1486848) = 4096
2954  stat64("/var/lib/ldap/uidNumber.bdb", {st_mode=S_IFREG|0600, st_size=90112, ...}) = 0
2954  stat64("/var/lib/ldap/uidNumber.bdb", {st_mode=S_IFREG|0600, st_size=90112, ...}) = 0
2954  open("/var/lib/ldap/uidNumber.bdb", O_RDWR|O_LARGEFILE) = 19
2954  fcntl64(19, F_SETFD, FD_CLOEXEC)  = 0
2954  read(19, "\3\0\0\0\375\223\217\0\0\0\0\0b1\5\0\t\0\0\0\0\20\0\0\0"..., 512) = 512
2954  close(19)                         = 0
2954  stat64("/var/lib/ldap/uidNumber.bdb", {st_mode=S_IFREG|0600, st_size=90112, ...}) = 0
2954  open("/var/lib/ldap/uidNumber.bdb", O_RDWR|O_LARGEFILE) = 19
2954  fcntl64(19, F_SETFD, FD_CLOEXEC)  = 0
2954  fstat64(19, {st_mode=S_IFREG|0600, st_size=90112, ...}) = 0
2954  pread(19, "\3\0\0\0\375\223\217\0\0\0\0\0b1\5\0\t\0\0\0\0\20\0\0\0"..., 4096, 0) = 4096
2954  time(NULL)                        = 1124282081
2954  pread(19, "\3\0\0\0=\224\217\0\1\0\0\0\0\0\0\0\0\0\0\0\24\0\304\16"..., 4096, 4096) = 4096
2954  pread(19, "\4\0\0\0\353\1772\0\23\0\0\0\4\0\0\0\t\0\0\0\376\0\20\10"..., 4096, 77824) = 4096
2954  stat64("/var/lib/ldap/entryUUID.bdb", {st_mode=S_IFREG|0600, st_size=106496, ...}) = 0
2954  stat64("/var/lib/ldap/entryUUID.bdb", {st_mode=S_IFREG|0600, st_size=106496, ...}) = 0
2954  open("/var/lib/ldap/entryUUID.bdb", O_RDWR|O_LARGEFILE) = 20
2954  fcntl64(20, F_SETFD, FD_CLOEXEC)  = 0
2954  read(20, "\4\0\0\0\271\23!\0\0\0\0\0b1\5\0\t\0\0\0\0\20\0\0\0\t\0"..., 512) = 512
2954  close(20)                         = 0
2954  stat64("/var/lib/ldap/entryUUID.bdb", {st_mode=S_IFREG|0600, st_size=106496, ...}) = 0
2954  open("/var/lib/ldap/entryUUID.bdb", O_RDWR|O_LARGEFILE) = 20
2954  fcntl64(20, F_SETFD, FD_CLOEXEC)  = 0
2954  fstat64(20, {st_mode=S_IFREG|0600, st_size=106496, ...}) = 0
2954  pread(20, "\4\0\0\0\271\23!\0\0\0\0\0b1\5\0\t\0\0\0\0\20\0\0\0\t\0"..., 4096, 0) = 4096
2954  time(NULL)                        = 1124282081
2954  pread(20, "\4\0\0\0\371\23!\0\1\0\0\0\0\0\0\0\0\0\0\0\30\0\204\16"..., 4096, 4096) = 4096
2954  pread(20, "\4\0\0\0Af/\0\t\0\0\0\17\0\0\0\21\0\0\0d\1\340\4\1\5\370"..., 4096, 36864) = 4096
2954  pread(10, "\4\0\0\0\217\3443\0\2\0\0\0\0\0\0\0\3\0\0\0<\0\254\2\1"..., 16384, 32768) = 16384
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
2954  sched_yield()                     = 0
...
...
...