[Date Prev][Date Next]
[Chronological]
[Thread]
[Top]
ITS#6365 Fwd: RE: truncated slapcat output
Fix verified.
-------- Original Message --------
Subject: RE: truncated slapcat output
Date: Thu, 11 Apr 2013 07:15:17 +0000
From: Hummel, Wolfgang <wolfgang.hummel@hp.com>
To: Howard Chu <hyc@symas.com>
Hello Howard,
we tested your fix for truncated slapcat and it works fine.
Please see test report below.
As I am not familiar with your processes in commenting on
bugfixes could you use the attached test report and
commit the fix so it will become part of next release ?
Thanks a lot for your support
Regards
Wolfgang Hummel
Test execution timeframe:
April 9th and 10th 2013
Test platform:
Hardware HP DL380 G5, 32 GB Memory, 2 Quadcore CPUs
OS RedHat 5.1
OpenLDAP 2.4.32 without / with slapcat truncate bugfix
bdb backend
Test setup:
- Subscriber profile DB with 1 Mio. entries, each with 10 attributes
Test execution:
- ldapbenchmark.pl executing ~ 5 ldapmodifies and ~ 2 ldapsearches / second
- slapcat_vfhu_vm_profiles.sh running slapcat in a cycle and counting entries
Test result without slapcat truncate bugfix:
- 1826 measurements of entry number
- 23 events with truncated slapcat output
- slapcat return code was always 0 !
Test result with slapcat truncate bugfix:
- 1647 measurements of entry number
- 0 events with truncated slapcat output
script to measure it:
#!/bin/bash
# run slapcat forever and always count number of entries
# they should always be the same
while :
do
slapcat -b ou=vm,ou=profiles,ou=xxxx,c=hu,o=yyyy|grep "^dn:"|wc -l
>>vfhu_vm_entries.txt
echo "Slapcat Return Code: $?; `date`">>vfhu_vm_entries.txt
sleep 1
done
log snippet with bug fix:
Slapcat Return Code: 0; Wed Apr 10 22:12:42 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 22:13:05 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 22:13:28 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 22:13:52 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 22:14:16 CEST 2013
1000001
log snippet without bugfix:
1000001
Slapcat Return Code: 0; Wed Apr 10 01:01:45 CEST 2013
319284
Slapcat Return Code: 0; Wed Apr 10 01:02:07 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 01:03:15 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 01:03:42 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 01:04:09 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 01:04:37 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 01:05:04 CEST 2013
437990
Slapcat Return Code: 0; Wed Apr 10 01:05:16 CEST 2013
146790
Slapcat Return Code: 0; Wed Apr 10 01:05:21 CEST 2013
72688
Slapcat Return Code: 0; Wed Apr 10 01:05:25 CEST 2013
1000001
Slapcat Return Code: 0; Wed Apr 10 01:05:50 CEST 2013
-----Original Message-----
From: Howard Chu [mailto:hyc@symas.com]
Sent: Dienstag, 26. März 2013 18:09
To: Hummel, Wolfgang
Subject: Re: truncated slapcat output
Hummel, Wolfgang wrote:
> Hello Howard,
>
> we are facing in production of our major customer VF the same problems as
> described in
>
> http://www.openldap.org/lists/openldap-technical/201301/msg00232.html
>
> We are using back-bdb and slapcat to create nightly ldif backups of all DBs
>
> where 2 of them each contains ~ 40 Mio. entries.
>
> Even though write traffic is low when the slapcat job runs, every 1 - 2 weeks
>
> output is truncated without error msg or error return code which creates problems
>
> for subsequent batch jobs.
>
> Therefore a slapcat that retries like slapd if a page is locked would be
>
> really important for us.
>
> 2 Questions:
>
> - Is the slapcat retry mechanism the fix you described in
> http://www.openldap.org/lists/openldap-technical/201301/msg00232.html ?
The patch for ITS#6365 was committed to master
commit 853b9d1335d27e280751e9cfb8ca6b5356ffec73
Author: Howard Chu <hyc@openldap.org>
Date: Thu Feb 7 18:23:25 2013 +0000
ITS#6365 wait for read locks in tool mode
> - When will it be available in OpenLDAP ?
When somebody follows up to the ITS and confirms that the patch fixes the
issue. So far nobody has followed up. You're welcome to test and followup.
>
> Regards
>
> Wolfgang Hummel
>
> ----------------------------------------------------------
>
> Postal Address: Hewlett-Packard GmbH
>
> Wolfgang Hummel
>
> Enterprise Services
>
> _/ Communication & Media Solutions
>
> _/ Herrenberger Str. 140
>
> _/_/_/ _/_/_/ 71034 Böblingen
>
> _/ _/ _/ _/ Phone: +49 7031 14-7375
>
> _/ _/ _/_/_/ Fax: +49 711 18562024
>
> _/ mobile: +49 151 14751791
>
> _/ E-Mail: wolfgang.hummel@hp.com
> <mailto:wolfgang.hummel@hp.com>
>
> ----------------------------------------------------------
>
> http://www.hp.com/de
>
> Hewlett-Packard GmbH, Herrenberger Str. 140, 71034 Böblingen
>
> Geschäftsführer: Volker Smid (Vorsitzender), Martin Kinne, Heiko Meyer, Ernst
> Reichart, Rainer Sterk Vorsitzender des Aufsichtsrates: Jörg Menno Harms Sitz
> der Gesellschaft: Böblingen, Amtsgericht Stuttgart HRB 244081, WEEE-Reg.-Nr.
> DE 30409072
>
--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/