[Date Prev][Date Next]
RE: (ITS#3675) On Directory Server Performance Benchmarking
Your paper shows a sincere interest in contributing to the OpenLDAP
community. However well-intentioned your submission was, though, the unwary
reader could be misled by the current date on your paper and mistake the
information as representing the current state of affairs. Less scrupulous
folks :O desiring to present OpenLDAP in a bad light could cite your paper
and somewhat truthfully say "Benchmark information released as recently as
April, 2005, indicates that..."
Seeing as you took the time to change the date on the paper, would it also
be possible for you to repost it with a foreword that spells out:
1. The information presented in this paper was developed in 2002,
2. Is based on outdated versions of OpenLDAP, and
3. Benchmarks on current versions of OpenLDAP show that your concerns were
addressed, resulting in dramatic performance increases.
In support of this, you can use a link to our benchmark website
http://www.symas.com/benchmark.shtml in your reposted paper.
Also, if you have any further interest in benchmarking OpenLDAP, we'd
welcome the opportunity to provide guidance and assistance.
Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
> -----Original Message-----
> From: owner-openldap-bugs@OpenLDAP.org [mailto:owner-openldap-
> bugs@OpenLDAP.org] On Behalf Of firstname.lastname@example.org
> Sent: Friday, April 22, 2005 1:06 AM
> To: openldap-its@OpenLDAP.org
> Subject: Re: (ITS#3675) On Directory Server Performance Benchmarking
> Hi Howard,
> You are right. Actually, this work was done in 2002 when when 2.0.23 was
> just released. At that time, I thought there was no right forum to
> discuss these results. Only recently I realized that the results can be
> made public and the report made available. I guess, I missed the bus :)
> I have not really worked on the benchmarking after this project, although
> it might be interesting to apply the same set of experiments to the
> current releases.
> On Thu, 21 Apr 2005, Howard Chu wrote:
> > I'm curious why you chose such an old release for this study. OpenLDAP
> > was released in February 2002, with the final 2.0 release (2.0.27) in
> > September 2002. There have been two whole release streams since then.
> > the 2.1 release is now considered "Historic." As such, any lessons one
> > have gleaned from studying 2.0's performance characteristics were
> > and addressed years ago. For example, we have benchmarks showing that
> > OpenLDAP 2.1 is fully 200 times faster than 2.0, with 2.2 30-50% faster
> > than 2.1.
> > email@example.com wrote:
> >> Full_Name: Dhananjay Kulkarni
> >> Version: 2.0.23
> >> OS: Mandrake Linux 7.0
> >> URL: http://www.cs.ucr.edu/~kulkarni/Dhananjay-Kulkarni-050421.pdf
> >> Submission from: (NULL) (22.214.171.124)
> >> LDAP-based directory servers are being widely used in grid computing,
> >> directory-enabled networking and operating system support. Hence,
> >> benchmarking
> >> and analyzing the performance of a directory server is very crucial. In
> >> this
> >> paper, we analyze the performance of the openldap-2.0.23, which is an
> >> source LDAP directory server available from the OpenLDAP Foundation.
> >> goal is
> >> to benchmark the server performance through a variety of experiments.
> >> measure
> >> the throughput and the latency for LDAP queries using a stress test,
> >> the
> >> server is heavily loaded by a number clients simultaneously accessing
> >> service. In other experiments, we focus on analyzing the update
> >> and
> >> the effect of indexing on the performance of LDAP queries. Finally, we
> >> study and
> >> analyze our experimental results. Our benchmark shows that that the
> >> directory
> >> gets saturated around 100 simultaneous accesses and indexing/caching
> >> affect
> >> the latency by an order of magnitude. We posit that our results provide
> >> interesting insights into identifying system bottlenecks and tuning the
> >> server
> >> performance. Moreover, our results can be used as a guide while
> >> future directory server implementations.
> Dhananjay Kulkarni
> email: firstname.lastname@example.org
> web : http://www.cs.ucr.edu/~kulkarni
> phone: 951-787-2522
> "If you can't do great things, you can always try to do small things
> in a great way"