autobuild failure for task source4 during test

tridge at samba.org tridge at samba.org
Tue Nov 30 14:23:11 MST 2010


Hi Volker,

 > Alternatively, someone could add magic to skip the source3
 > tests if only source4 was touched by a checkin, and to skip
 > the source4 test if only source3 was touched by a checkin.
 > Neither of these cases should affect the respective opposite
 > test.

I would prefer to just fix the problem, or identify a set of tests
that should be disabled.

There is enough common code between source3 and source4 that
identiying, in a script, that there is no chance of a bug between them
is likely to be very error prone. The source3 Makefile uses code from
source4 and the source4 build uses files from source3. 

I think the basic approach to flakey tests is fairly simple:

 - if the test fails frequently, then finding the problem or the commit
   that introduced it should not be too hard. We find and fix the
   problem

 - if the test fails very rarely, the finding the problem can be much
   harder, but at the same time, it means that an interim solution is
   to resubmit your changes to autobuild if you are sure the failure
   was unrelated.

As you have done, the failure should be reported on samba-technical so
it can be fixed.

Now I'll go and try and find the cause of this one :-)

Cheers, Tridge


More information about the samba-technical mailing list