Test infrastructure improvements
jelmer at samba.org
Sun Nov 16 10:32:20 MST 2014
On Sat, Nov 01, 2014 at 05:19:58PM +0100, Jelmer Vernooij wrote:
> On Sat, Oct 25, 2014 at 03:06:48PM -0700, Jelmer Vernooij wrote:
> > Matthieu and I got together a couple of weeks ago to hack on the
> > Samba testsuite.
> > Our main goal has so far been on reducing the overall run time of the
> > testsuite, through various means. Matthieu has been pesking me about
> > running tests in parallel for a long time.
> > I've put the todo-list we compiled on the wiki:
> > https://wiki.samba.org/index.php/Test_Infrastructure_Sprint
> > What we have at the moment:
> > * drop the samba3/samba4 distinction?
> I think this is a much larger change, since it ties in with other code changes
> to e.g. remove the distinction between smbtorture3 and smbtorture4.
> Perhaps we should hold off on this as part of the test infrastructure
> improvements, though I agree it would be a nice thing to do in general.
After discussion here this doesn't seem to be quite as hard as I thought, since
there is no relation between the test names and the underlying code. Would
be nice to do, though I'm holding off on it in favor of other things at the moment.
> > * randomize test order [mat]
> Any news on this?
I've filed a bug about the fact that we currently have a test that modifies its
environment (the demote test). This fundamentally breaks running with
randomized test order. https://bugzilla.samba.org/show_bug.cgi?id=10939
> > * parallelize with testr [jelmer]
> > * migrate to subunit2
> This is in progress; I've got some changes that update our in-tree subunit to
> version 2. We'll still use subunit1 output internally (by converting v2 output
> to v1 before we parsing it).
This is still in progress, and took longer than I was expecting. Patchset is out for review by abartlet at .
Jelmer Vernooij <jelmer at samba.org> - https://jelmer.uk/
More information about the samba-technical