[Date Prev][Date Next] [Chronological] [Thread] [Top]

checkpointing BDB transactions and deleting BDB transaction logfiles



Hi,

an OpenLDAP server (Linux, OpenLDAP 2.2.24, BDB 4.2.52 + 2 patches by Sleepycat, bdb backend) writes lots of BDB transaction logfiles. The data gets pushed on a regular basis into the directory and is deleted after a while based on createTimestamp. I don't have long running sessions. New data is just quickly pushed into it by a PHP driven web application.

The transaction logfiles do not get removed by "db_archive -d". Usually they don't, sometimes they do, mainly after a server restart.

I already tried

database        bdb
checkpoint      512 20

in /etc/openldap/slapd.conf, but it does not work as expected. Should I use BDB's own checkpointing utility?

http://www.sleepycat.com/docs/utility/db_checkpoint.html

Yet to notice: the process lists holds several long running slapds (for two days now).

Should I use OpenLDAP's monitor backend to get an idea what all these slapds are doing?


OpenLDAP backend directory:

total 1729588
-rw------- 1 ldap ldap 684032 2005-03-29 12:58 createTimestamp.bdb
-rw------- 1 ldap ldap 8192 2005-03-17 08:31 __db.001
-rw------- 1 ldap ldap 270336 2005-03-17 08:31 __db.002
-rw------- 1 ldap ldap 98304 2005-03-17 08:31 __db.003
-rw------- 1 ldap ldap 368640 2005-03-17 08:31 __db.004
-rw------- 1 ldap ldap 24576 2005-03-17 08:31 __db.005
-rw------- 1 ldap ldap 64106496 2005-03-29 12:58 dn2id.bdb
-rw------- 1 ldap ldap 208961536 2005-03-29 12:58 id2entry.bdb
-rw------- 1 ldap ldap 10475445 2005-03-27 17:15 log.0000000564
-rw------- 1 ldap ldap 10485736 2005-03-27 17:41 log.0000000565
-rw------- 1 ldap ldap 10485731 2005-03-27 18:06 log.0000000566
-rw------- 1 ldap ldap 10485711 2005-03-27 18:18 log.0000000567
-rw------- 1 ldap ldap 10485730 2005-03-27 18:24 log.0000000568
-rw------- 1 ldap ldap 10485737 2005-03-27 18:29 log.0000000569
-rw------- 1 ldap ldap 10485305 2005-03-27 18:34 log.0000000570
-rw------- 1 ldap ldap 10470369 2005-03-27 18:39 log.0000000571
-rw------- 1 ldap ldap 10485501 2005-03-27 18:44 log.0000000572
-rw------- 1 ldap ldap 10485400 2005-03-27 18:49 log.0000000573
-rw------- 1 ldap ldap 10485669 2005-03-27 18:54 log.0000000574
-rw------- 1 ldap ldap 10477015 2005-03-27 18:59 log.0000000575
-rw------- 1 ldap ldap 10485598 2005-03-27 19:04 log.0000000576
-rw------- 1 ldap ldap 10485720 2005-03-27 19:09 log.0000000577
-rw------- 1 ldap ldap 10485559 2005-03-27 19:14 log.0000000578
-rw------- 1 ldap ldap 10485750 2005-03-27 19:19 log.0000000579
-rw------- 1 ldap ldap 10485145 2005-03-27 19:24 log.0000000580
-rw------- 1 ldap ldap 10485746 2005-03-27 19:29 log.0000000581
-rw------- 1 ldap ldap 10485705 2005-03-27 19:34 log.0000000582
-rw------- 1 ldap ldap 10485721 2005-03-27 19:39 log.0000000583
-rw------- 1 ldap ldap 10485746 2005-03-27 19:44 log.0000000584
-rw------- 1 ldap ldap 10485733 2005-03-27 19:49 log.0000000585
-rw------- 1 ldap ldap 10485646 2005-03-27 19:54 log.0000000586
-rw------- 1 ldap ldap 10485726 2005-03-27 19:59 log.0000000587
-rw------- 1 ldap ldap 10485743 2005-03-27 20:04 log.0000000588
-rw------- 1 ldap ldap 10485304 2005-03-27 20:09 log.0000000589
-rw------- 1 ldap ldap 10485719 2005-03-27 20:14 log.0000000590
-rw------- 1 ldap ldap 10485748 2005-03-27 20:19 log.0000000591
-rw------- 1 ldap ldap 10485344 2005-03-27 20:24 log.0000000592
-rw------- 1 ldap ldap 10485510 2005-03-27 20:29 log.0000000593
-rw------- 1 ldap ldap 10485665 2005-03-27 20:34 log.0000000594
-rw------- 1 ldap ldap 10485743 2005-03-27 20:39 log.0000000595
-rw------- 1 ldap ldap 10469499 2005-03-27 20:44 log.0000000596
-rw------- 1 ldap ldap 10485372 2005-03-27 20:49 log.0000000597
-rw------- 1 ldap ldap 10483551 2005-03-27 20:54 log.0000000598
-rw------- 1 ldap ldap 10485667 2005-03-27 20:58 log.0000000599
-rw------- 1 ldap ldap 10485752 2005-03-27 21:03 log.0000000600
-rw------- 1 ldap ldap 10485759 2005-03-27 21:08 log.0000000601
-rw------- 1 ldap ldap 10485713 2005-03-27 21:13 log.0000000602
-rw------- 1 ldap ldap 10485456 2005-03-27 21:18 log.0000000603
-rw------- 1 ldap ldap 10485606 2005-03-27 21:23 log.0000000604
-rw------- 1 ldap ldap 10471924 2005-03-27 21:28 log.0000000605
-rw------- 1 ldap ldap 10485746 2005-03-27 21:33 log.0000000606
-rw------- 1 ldap ldap 10485113 2005-03-27 21:38 log.0000000607
-rw------- 1 ldap ldap 10485726 2005-03-27 21:43 log.0000000608
-rw------- 1 ldap ldap 10485691 2005-03-27 21:48 log.0000000609
-rw------- 1 ldap ldap 10485751 2005-03-27 21:53 log.0000000610
-rw------- 1 ldap ldap 10485301 2005-03-27 21:58 log.0000000611
-rw------- 1 ldap ldap 10485753 2005-03-27 22:03 log.0000000612
-rw------- 1 ldap ldap 10485753 2005-03-27 22:07 log.0000000613
-rw------- 1 ldap ldap 10485488 2005-03-27 22:12 log.0000000614
-rw------- 1 ldap ldap 10485707 2005-03-27 22:17 log.0000000615
-rw------- 1 ldap ldap 10475661 2005-03-27 22:42 log.0000000616
-rw------- 1 ldap ldap 10485710 2005-03-27 23:12 log.0000000617
-rw------- 1 ldap ldap 10485737 2005-03-27 23:44 log.0000000618
-rw------- 1 ldap ldap 10485760 2005-03-28 00:16 log.0000000619
-rw------- 1 ldap ldap 10485731 2005-03-28 00:21 log.0000000620
-rw------- 1 ldap ldap 10485746 2005-03-28 00:26 log.0000000621
-rw------- 1 ldap ldap 10485116 2005-03-28 00:31 log.0000000622
-rw------- 1 ldap ldap 10485453 2005-03-28 00:35 log.0000000623
-rw------- 1 ldap ldap 10485714 2005-03-28 01:04 log.0000000624
-rw------- 1 ldap ldap 10485544 2005-03-28 02:06 log.0000000625
-rw------- 1 ldap ldap 10485521 2005-03-28 02:18 log.0000000626
-rw------- 1 ldap ldap 10485745 2005-03-28 02:23 log.0000000627
-rw------- 1 ldap ldap 10485732 2005-03-28 03:02 log.0000000628
-rw------- 1 ldap ldap 10485745 2005-03-28 04:16 log.0000000629
-rw------- 1 ldap ldap 10485748 2005-03-28 04:21 log.0000000630
-rw------- 1 ldap ldap 10485760 2005-03-28 04:53 log.0000000631
-rw------- 1 ldap ldap 10485725 2005-03-28 06:15 log.0000000632
-rw------- 1 ldap ldap 10485723 2005-03-28 06:19 log.0000000633
-rw------- 1 ldap ldap 10485730 2005-03-28 06:49 log.0000000634
-rw------- 1 ldap ldap 10485738 2005-03-28 07:59 log.0000000635
-rw------- 1 ldap ldap 10485573 2005-03-28 08:18 log.0000000636
-rw------- 1 ldap ldap 10485405 2005-03-28 08:23 log.0000000637
-rw------- 1 ldap ldap 10475099 2005-03-28 08:53 log.0000000638
-rw------- 1 ldap ldap 10476362 2005-03-28 09:33 log.0000000639
-rw------- 1 ldap ldap 10469950 2005-03-28 10:01 log.0000000640
-rw------- 1 ldap ldap 10485668 2005-03-28 10:17 log.0000000641
-rw------- 1 ldap ldap 10474836 2005-03-28 10:22 log.0000000642
-rw------- 1 ldap ldap 10479838 2005-03-28 10:37 log.0000000643
-rw------- 1 ldap ldap 10485744 2005-03-28 11:14 log.0000000644
-rw------- 1 ldap ldap 10485725 2005-03-28 11:41 log.0000000645
-rw------- 1 ldap ldap 10485712 2005-03-28 12:05 log.0000000646
-rw------- 1 ldap ldap 10485119 2005-03-28 12:18 log.0000000647
-rw------- 1 ldap ldap 10485693 2005-03-28 12:33 log.0000000648
-rw------- 1 ldap ldap 10485705 2005-03-28 12:49 log.0000000649
-rw------- 1 ldap ldap 10485730 2005-03-28 13:05 log.0000000650
-rw------- 1 ldap ldap 10485582 2005-03-28 13:21 log.0000000651
-rw------- 1 ldap ldap 10485738 2005-03-28 13:36 log.0000000652
-rw------- 1 ldap ldap 10485563 2005-03-28 13:58 log.0000000653
-rw------- 1 ldap ldap 10485666 2005-03-28 14:16 log.0000000654
-rw------- 1 ldap ldap 10477969 2005-03-28 14:33 log.0000000655
-rw------- 1 ldap ldap 10485388 2005-03-28 14:58 log.0000000656
-rw------- 1 ldap ldap 10485514 2005-03-28 15:28 log.0000000657
-rw------- 1 ldap ldap 10485673 2005-03-28 16:00 log.0000000658
-rw------- 1 ldap ldap 10485438 2005-03-28 16:17 log.0000000659
-rw------- 1 ldap ldap 10485717 2005-03-28 16:38 log.0000000660
-rw------- 1 ldap ldap 10485728 2005-03-28 17:02 log.0000000661
-rw------- 1 ldap ldap 10485735 2005-03-28 17:25 log.0000000662
-rw------- 1 ldap ldap 10485716 2005-03-28 17:48 log.0000000663
-rw------- 1 ldap ldap 10485742 2005-03-28 18:11 log.0000000664
-rw------- 1 ldap ldap 10485725 2005-03-28 18:19 log.0000000665
-rw------- 1 ldap ldap 10485726 2005-03-28 18:42 log.0000000666
-rw------- 1 ldap ldap 10485720 2005-03-28 19:02 log.0000000667
-rw------- 1 ldap ldap 10485755 2005-03-28 19:24 log.0000000668
-rw------- 1 ldap ldap 10485661 2005-03-28 19:50 log.0000000669
-rw------- 1 ldap ldap 10485756 2005-03-28 20:16 log.0000000670
-rw------- 1 ldap ldap 10485723 2005-03-28 20:21 log.0000000671
-rw------- 1 ldap ldap 10485133 2005-03-28 20:35 log.0000000672
-rw------- 1 ldap ldap 10485752 2005-03-28 21:04 log.0000000673
-rw------- 1 ldap ldap 10485757 2005-03-28 21:32 log.0000000674
-rw------- 1 ldap ldap 10485744 2005-03-28 22:03 log.0000000675
-rw------- 1 ldap ldap 10485721 2005-03-28 22:18 log.0000000676
-rw------- 1 ldap ldap 10485395 2005-03-28 22:23 log.0000000677
-rw------- 1 ldap ldap 10485730 2005-03-28 22:48 log.0000000678
-rw------- 1 ldap ldap 10485489 2005-03-28 23:31 log.0000000679
-rw------- 1 ldap ldap 10485249 2005-03-29 00:15 log.0000000680
-rw------- 1 ldap ldap 10485760 2005-03-29 00:20 log.0000000681
-rw------- 1 ldap ldap 10485712 2005-03-29 00:25 log.0000000682
-rw------- 1 ldap ldap 10474961 2005-03-29 00:34 log.0000000683
-rw------- 1 ldap ldap 10475937 2005-03-29 02:06 log.0000000684
-rw------- 1 ldap ldap 10485756 2005-03-29 02:19 log.0000000685
-rw------- 1 ldap ldap 10485730 2005-03-29 02:27 log.0000000686
-rw------- 1 ldap ldap 10485702 2005-03-29 04:18 log.0000000687
-rw------- 1 ldap ldap 10485719 2005-03-29 04:23 log.0000000688
-rw------- 1 ldap ldap 10485730 2005-03-29 05:15 log.0000000689
-rw------- 1 ldap ldap 10485369 2005-03-29 06:17 log.0000000690
-rw------- 1 ldap ldap 10485453 2005-03-29 06:21 log.0000000691
-rw------- 1 ldap ldap 10485747 2005-03-29 06:44 log.0000000692
-rw------- 1 ldap ldap 10485709 2005-03-29 08:15 log.0000000693
-rw------- 1 ldap ldap 10485714 2005-03-29 08:20 log.0000000694
-rw------- 1 ldap ldap 10485716 2005-03-29 08:34 log.0000000695
-rw------- 1 ldap ldap 10485511 2005-03-29 09:25 log.0000000696
-rw------- 1 ldap ldap 10485690 2005-03-29 10:10 log.0000000697
-rw------- 1 ldap ldap 10485732 2005-03-29 10:19 log.0000000698
-rw------- 1 ldap ldap 10485751 2005-03-29 10:28 log.0000000699
-rw------- 1 ldap ldap 10485744 2005-03-29 11:03 log.0000000700
-rw------- 1 ldap ldap 10485558 2005-03-29 11:33 log.0000000701
-rw------- 1 ldap ldap 10484140 2005-03-29 12:01 log.0000000702
-rw------- 1 ldap ldap 10485706 2005-03-29 12:17 log.0000000703
-rw------- 1 ldap ldap 10485538 2005-03-29 12:41 log.0000000704
-rw------- 1 ldap ldap 6426750 2005-03-29 12:58 log.0000000705
-rw------- 1 ldap ldap 2707456 2005-03-29 12:58 objectClass.bdb
-rw------- 1 ldap ldap 8921088 2005-03-29 12:58 uid.bdb



USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
ldap 5385 0.0 2.6 275556 54184 ? S Mar27 0:00 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5386 0.0 2.6 275556 54184 ? S Mar27 0:00 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5387 0.1 2.6 275556 54184 ? S Mar27 4:28 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5389 0.9 2.6 275556 54184 ? S Mar27 25:40 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5391 0.9 2.6 275556 54184 ? S Mar27 24:01 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5397 0.9 2.6 275556 54184 ? S Mar27 24:59 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5423 0.9 2.6 275556 54184 ? S Mar27 25:40 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5526 0.9 2.6 275556 54184 ? S Mar27 26:11 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5642 0.9 2.6 275556 54184 ? S Mar27 24:40 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5998 0.9 2.6 275556 54184 ? S Mar27 25:25 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 5999 0.9 2.6 275556 54184 ? S Mar27 25:26 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 6000 0.9 2.6 275556 54184 ? S Mar27 24:58 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7433 0.9 2.6 275556 54184 ? S Mar27 23:48 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7434 0.9 2.6 275556 54184 ? S Mar27 24:20 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7436 0.9 2.6 275556 54184 ? S Mar27 25:32 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7440 0.9 2.6 275556 54184 ? S Mar27 25:32 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7441 1.0 2.6 275556 54184 ? S Mar27 27:36 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7442 0.9 2.6 275556 54184 ? S Mar27 24:00 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 7444 1.0 2.6 275556 54184 ? S Mar27 27:03 /opt/openldap/libexec/slapd -h ldap:/// -u ldap -g ldap -l local6
ldap 12119 0.0 0.0 2476 936 pts/0 S 12:58 0:00 su - ldap
ldap 12120 0.0 0.0 3064 1816 pts/0 S 12:58 0:00 -bash
ldap 12232 0.0 0.0 2860 856 pts/0 R 13:01 0:00 ps uxw