Samba at 100k users inc groups! (was: Re: Filtering links by the uptodateness vector, sorting them client-side (was: Re: [PATCH] drs exop test & refactoring))

Andrew Bartlett abartlet at samba.org
Thu Jan 5 05:48:07 UTC 2017


On Thu, 2017-01-05 at 17:03 +1300, Andrew Bartlett wrote:
> On Wed, 2017-01-04 at 21:39 +1300, Andrew Bartlett wrote:
> > 
> > On Thu, 2016-12-22 at 22:36 +1300, Andrew Bartlett wrote:
> > > 
> > > On Mon, 2016-12-19 at 23:48 +1300, Andrew Bartlett wrote:
> > > 
> > > I'm glad to say Bob's changes are in.  A patch set for the link
> > > sorting
> > > is at:
> > > 
> 
> http://git.catalyst.net.nz/gw?p=samba.git;a=shortlog;h=refs/heads/ldb
> -sorted-links
> 
> > 
> > This work as continued, and it is almost finished, for the case of
> > adding links.  Delete and replace are still inefficient however.
> 
> I've been running the numbers on the new patches by Douglas, in
> particular seeing how many users we can add, including adding those
> users to 4 groups, in a 2 hour time limit.
> 
> On master, we peak at 55,000 users in that two hour window.  However,
> with Douglas' patch, we get to 55,000 users in just 50mins!
> 
> I'll know when my full test run completes - and probably find
> something
> else blows up first, but on current projections it will be quite
> practical to get 100,000 users into a samba DB, without excessive
> waiting.

We got to 86,000 users in the two-hour limit.  The resulting DB is
750MB, and even at this point it added a user and added them to the
four groups in only 0.16 seconds total!

Naturally there is still a slow-down, we don't yet have an O(1)
database :-)

> As a comparison, with Samba 4.4, we had trouble running this test up
> to
> even 20,000 users, as too many steps in our handlers were O(n^2). 

I have tests running to get exact numbers on 4.4 for comparison. 

> This is why I'm still so keen to try and land these patches for 4.6 -
> as finally, Samba as an AD DC really can scale!
> 
> (I actually think the patches are ready, after some squashing, and
> with
> just the tests for my new compatibleFeatures/incompatibleFeatures
> needed!)

If we can make it, this will certainly liven up our WHATSNEW!

Andrew Bartlett

-- 
Andrew Bartlett                       http://samba.org/~abartlet/
Authentication Developer, Samba Team  http://samba.org
Samba Developer, Catalyst IT          http://catalyst.net.nz/services/samba




More information about the samba-technical mailing list