[Date Prev][Date Next] [Chronological] [Thread] [Top]

Re: searching for attributes without index in 2.4.19 with bdb 4.5



Hi,

we did some further investigation in to that problem and it is
not as simple. When we start the slapd, everythin is o.k.
But after some time, the behavior of slapd changes, it seems to
tilt. Then searching for attributes without index is about 100 to
1000 times slower then with an new ldap. We have set the loglevel to
trace and found some differences, we can not explain:

If we search for attributes without index on a slapd before it tilts
it looks like that:


o.k.:

Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56172 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56173 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56174 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56175 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56176 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56177 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56178 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56179 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56180 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56181 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56182 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56183 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56184 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56185 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56186 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56187 does not match filter
Feb  4 17:48:40 ldapserver slapd[16810]: bdb_search: 56188 does not match filter

an after it tilts:

very very slow:

Feb  4 17:46:53 ldapserver slapd[20989]: bdb_search: 72869 does not match filter
Feb  4 17:46:53 ldapserver slapd[20989]: entry_decode: "uid=example3412,ou=unit1,o=example,c=de"
Feb  4 17:46:53 ldapserver slapd[20989]: <= entry_decode(uid=example3412,ou=unit1,o=example,c=de)
Feb  4 17:46:53 ldapserver slapd[20989]: bdb_search: 72870 does not match filter
Feb  4 17:46:53 ldapserver slapd[20989]: entry_decode: "uid=example3413,ou=unit1,o=example,c=de"
Feb  4 17:46:53 ldapserver slapd[20989]: <= entry_decode(uid=example3413,ou=unit1,o=example,c=de)
Feb  4 17:46:53 ldapserver slapd[20989]: bdb_search: 72871 does not match filter
Feb  4 17:46:53 ldapserver slapd[20989]: entry_decode: "uid=example3414,ou=unit1,o=example,c=de"
Feb  4 17:46:53 ldapserver slapd[20989]: <= entry_decode(uid=example3414,ou=unit1,o=example,c=de)
Feb  4 17:46:54 ldapserver slapd[20989]: bdb_search: 72872 does not match filter
Feb  4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3415,ou=unit1,o=example,c=de"
Feb  4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3415,ou=unit1,o=example,c=de)
Feb  4 17:46:54 ldapserver slapd[20989]: bdb_search: 72873 does not match filter
Feb  4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3416,ou=unit1,o=example,c=de"
Feb  4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3416,ou=unit1,o=example,c=de)
Feb  4 17:46:54 ldapserver slapd[20989]: bdb_search: 72874 does not match filter
Feb  4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3417,ou=unit1,o=example,c=de"
Feb  4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3417,ou=unit1,o=example,c=de)
Feb  4 17:46:54 ldapserver slapd[20989]: bdb_search: 72875 does not match filter
Feb  4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3418,ou=unit1,o=example,c=de"
Feb  4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3418,ou=unit1,o=example,c=de)
Feb  4 17:46:54 ldapserver slapd[20989]: bdb_search: 72876 does not match filter
Feb  4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3419,ou=unit1,o=example,c=de"
Feb  4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3419,ou=unit1,o=example,c=de)
Feb  4 17:46:54 ldapserver slapd[20989]: bdb_search: 72877 does not match filter
Feb  4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3420,ou=unit1,o=example,c=de"
Feb  4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3420,ou=unit1,o=example,c=de)
Feb  4 17:46:55 ldapserver slapd[20989]: bdb_search: 72878 does not match filter
Feb  4 17:46:55 ldapserver slapd[20989]: entry_decode: "uid=example3421,ou=unit1,o=example,c=de"
Feb  4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3421,ou=unit1,o=example,c=de)
Feb  4 17:46:55 ldapserver slapd[20989]: bdb_search: 72879 does not match filter
Feb  4 17:46:55 ldapserver slapd[20989]: entry_decode: "uid=example3422,ou=unit1,o=example,c=de"
Feb  4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3422,ou=unit1,o=example,c=de)
Feb  4 17:46:55 ldapserver slapd[20989]: bdb_search: 72880 does not match filter
Feb  4 17:46:55 ldapserver slapd[20989]: entry_decode: "uid=example3423,ou=unit1,o=example,c=de"
Feb  4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3423,ou=unit1,o=example,c=de)
Feb  4 17:46:55 ldapserver slapd[20989]: bdb_search: 72881 does not match filter

Why the slapd does these entry_decode thing? And why is it so slow with entry_decode?
We used the same searchfilter for both searches. 

Furthermore we changed the backend database from
bdb-4.5 to bdb-4.8.24, but the behavior is still the same.



regards


    Christoph &:-)






-----Ursprüngliche Nachricht-----
Von: Christoph Herrmann <C.Herrmann@science-computing.de>
Gesendet: Fr 11.12.2009 00:30
An: openldap-software@openldap.org; 
Betreff: searching for attributes without index in 2.4.19 with bdb 4.5

> Hello,
> 
> after upgrading from openldap-2.3.39 with bdb-4.2.52 to openldap 2.4.19 with 
> bdb-4.5
> searching for attributes without index is about three times slower. (same 
> machine, same
> data, all data fit in DB cache)
> 
> Are there any known problems or magic tuning options we have missed?
> 
> 
> regards
> 
> 
>     Christoph &:-)
> --
-- 
Vorstand/Board of Management:
Dr. Bernd Finkbeiner, Dr. Roland Niemeier, 
Dr. Arno Steitz, Dr. Ingrid Zech
Vorsitzender des Aufsichtsrats/
Chairman of the Supervisory Board:
Michel Lepert
Sitz/Registered Office: Tuebingen
Registergericht/Registration Court: Stuttgart
Registernummer/Commercial Register No.: HRB 382196