Performance testing framework

[Jeremy Allison]

On Fri, Aug 19, 2016 at 01:32:23PM +1200, Douglas Bagnall wrote:
> 
> I have been mangling selftest to work in a mode that outputs
> performance timings and nothing else, and I have managed to backport
> this as far as 4.0 (which seems a long time ago to *me*). I've made a
> set of tests that exercise some simple AD stuff, and without further
> ado, here are some graphs:
> 
> https://www.samba.org/~dbagnall/perf-tests/
> 
> If for any reason you did not see, the graphs show that 4.0 to 4.3 are
> mostly similar, 4.4 is slow, and 4.5 is fast. Many operations
> involving many objects with linked attributes are roughly twice as
> fast in 4.5. This of course represents tester's bias: we've been
> working on that and want to show it.

This is *great* data ! Thanks a *LOT* for this !

> The times are formatted as JSON. I can hear you falling off your
> chairs. JSON?! Don't we have a perfectly good serialization format in
> ASN.1? Well, the aim is to generate automatic performance charts, akin

I would describe ASN.1 in many ways (all pejorative), but never
would I describe it as "perfectly good" :-). JSON by it's very
property of *not* being ASN.1 is a better choice :-).

Cheers,

	Jeremy.