[Date Prev][Date Next]
[Chronological]
[Thread]
[Top]
RE: (ITS#3675) On Directory Server Performance Benchmarking
Hi Matthew,
Thanks for the suggestions (and the impending concern). I have included a
foreword in the paper and reposted the updated version. The same link
should still work. Also, as suggested by you, I have included 'Symas
Benchmarking Home' in the bibliography. This should point the reader to
more recent benchmarking results.
---
Foreword
The benchmarking experiments and results presented in this paper were
developed in 2002. Although the report was not made available earlier,
the information presented in this report was first prepared and
documented by the authors in 2002 itself. OpenLDAP 2.0.23 is now
out-dated, and hence our benchmarking observations should be used for
historical reference or issues related to version 2.0.23. Current
versions of OpenLDAP show that our concerns (detailed in this report)
were addressed, resulting in dramatic performance increase. Please
refer \cite{Symas} for some recent benchmarking results.
---
Sincerely,
-Dhananjay
On Thu, 5 May 2005, Matthew Hardin wrote:
> Hi Dhanjay,
>
> Your paper shows a sincere interest in contributing to the OpenLDAP
> community. However well-intentioned your submission was, though, the unwary
> reader could be misled by the current date on your paper and mistake the
> information as representing the current state of affairs. Less scrupulous
> folks :O desiring to present OpenLDAP in a bad light could cite your paper
> and somewhat truthfully say "Benchmark information released as recently as
> April, 2005, indicates that..."
>
> Seeing as you took the time to change the date on the paper, would it also
> be possible for you to repost it with a foreword that spells out:
>
> 1. The information presented in this paper was developed in 2002,
> 2. Is based on outdated versions of OpenLDAP, and
> 3. Benchmarks on current versions of OpenLDAP show that your concerns were
> addressed, resulting in dramatic performance increases.
>
> In support of this, you can use a link to our benchmark website
> http://www.symas.com/benchmark.shtml in your reposted paper.
>
> Also, if you have any further interest in benchmarking OpenLDAP, we'd
> welcome the opportunity to provide guidance and assistance.
>
> Sincerely,
>
> Matthew Hardin
> Symas Corporation
> Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
> http://www.symas.com
>
>> -----Original Message-----
>> From: owner-openldap-bugs@OpenLDAP.org [mailto:owner-openldap-
>> bugs@OpenLDAP.org] On Behalf Of kulkarni@cs.ucr.edu
>> Sent: Friday, April 22, 2005 1:06 AM
>> To: openldap-its@OpenLDAP.org
>> Subject: Re: (ITS#3675) On Directory Server Performance Benchmarking
>>
>> Hi Howard,
>>
>> You are right. Actually, this work was done in 2002 when when 2.0.23 was
>> just released. At that time, I thought there was no right forum to
>> discuss these results. Only recently I realized that the results can be
>> made public and the report made available. I guess, I missed the bus :)
>>
>> I have not really worked on the benchmarking after this project, although
>> it might be interesting to apply the same set of experiments to the
>> current releases.
>>
>> Regards,
>> -Dhananjay
>>
>>
>> On Thu, 21 Apr 2005, Howard Chu wrote:
>>
>>> I'm curious why you chose such an old release for this study. OpenLDAP
>> 2.0.23
>>> was released in February 2002, with the final 2.0 release (2.0.27) in
>>> September 2002. There have been two whole release streams since then.
>> Even
>>> the 2.1 release is now considered "Historic." As such, any lessons one
>> might
>>> have gleaned from studying 2.0's performance characteristics were
>> identified
>>> and addressed years ago. For example, we have benchmarks showing that
>>> OpenLDAP 2.1 is fully 200 times faster than 2.0, with 2.2 30-50% faster
>> even
>>> than 2.1.
>>>
>>> kulkarni@cs.ucr.edu wrote:
>>>
>>>> Full_Name: Dhananjay Kulkarni
>>>> Version: 2.0.23
>>>> OS: Mandrake Linux 7.0
>>>> URL: http://www.cs.ucr.edu/~kulkarni/Dhananjay-Kulkarni-050421.pdf
>>>> Submission from: (NULL) (24.180.55.253)
>>>>
>>>>
>>>> LDAP-based directory servers are being widely used in grid computing,
>>>> directory-enabled networking and operating system support. Hence,
>>>> benchmarking
>>>> and analyzing the performance of a directory server is very crucial. In
>>>> this
>>>> paper, we analyze the performance of the openldap-2.0.23, which is an
>> open
>>>> source LDAP directory server available from the OpenLDAP Foundation.
>> Our
>>>> goal is
>>>> to benchmark the server performance through a variety of experiments.
>> We
>>>> measure
>>>> the throughput and the latency for LDAP queries using a stress test,
>> where
>>>> the
>>>> server is heavily loaded by a number clients simultaneously accessing
>> the
>>>> service. In other experiments, we focus on analyzing the update
>> performance
>>>> and
>>>> the effect of indexing on the performance of LDAP queries. Finally, we
>>>> study and
>>>> analyze our experimental results. Our benchmark shows that that the
>>>> directory
>>>> gets saturated around 100 simultaneous accesses and indexing/caching
>> can
>>>> affect
>>>> the latency by an order of magnitude. We posit that our results provide
>>>> interesting insights into identifying system bottlenecks and tuning the
>>>> server
>>>> performance. Moreover, our results can be used as a guide while
>> developing
>>>> future directory server implementations.
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>
>> --
>> --------------------------------------------------------------------------
>> ----
>> Dhananjay Kulkarni
>> email: kulkarni@cs.ucr.edu
>> web : http://www.cs.ucr.edu/~kulkarni
>> phone: 951-787-2522
>> "If you can't do great things, you can always try to do small things
>> in a great way"
>> --------------------------------------------------------------------------
>> -----
>
>
--
------------------------------------------------------------------------------
Dhananjay Kulkarni
email: kulkarni@cs.ucr.edu
web : http://www.cs.ucr.edu/~kulkarni
phone: 951-787-2522
"If you can't do great things, you can always try to do small things
in a great way"
-------------------------------------------------------------------------------