[PATCH] Another flapping python 3 test

[Douglas Bagnall]

On 03/10/18 22:15, Noel Power wrote:
> 
> Do any of these tests also have the python2 variant also flapping ? It
> would be great to nail down where and why some of these are failing, It
> is really frustrating, any of the flapping tests don't seem to fail for
> me when I run them independently, Worse some of these seem to just
> randomly become flapping and then go quite again. At various times I
> burned alot of time trying unsuccessfully to get to the bottom of how
> some of these tests are failing but have been stumped due to
> unfamiliarity with the tests and inability to get them to fail outside
> of CI. If anyone can help with that it would be great, marking them as
> flapping is the best that can be done now but unfortunately risks hiding
> problems.
> 

Yes, some of the tests also fail on py2, and yes, it is very frustrating.

Here are the flapping python tests in the last 3 or so weeks (since
the py3 visualize tests were eliminated), in the 6-hourly flakey
tests (c. 90 tests).

Python 2:
$ ./parse-email/parse-autobuild-email  --file-regex sn-devel-144 --since 2018-09-11 --line-regex 'UNEXPECTED.+python' | grep -v python3
   3 UNEXPECTED(failure): samba4.drs.samba_tool_drs_showrepl.python(promoted_dc).samba_tool_drs_showrepl.SambaToolDrsShowReplTests.test_samba_tool_showrepl_summary_forced_failure(promoted_dc:local)
   1 UNEXPECTED(failure): samba4.drs.samba_tool_drs_showrepl.python(vampire_dc).samba_tool_drs_showrepl.SambaToolDrsShowReplTests.test_samba_tool_showrepl_summary_forced_failure(vampire_dc:local)
   1 UNEXPECTED(error): samba4.ldap_schema.python(ad_dc_ntvfs).__main__.SchemaTests.test_schemaUpdateNow(ad_dc_ntvfs)
   1 UNEXPECTED(failure): samba4.ldap.password_lockout.python(ad_dc_ntvfs).__main__.PasswordTestsWithSleep.test_login_lockout_krb5(ad_dc_ntvfs)

Python 3:
$ ./parse-email/parse-autobuild-email  --file-regex sn-devel-144 --since 2018-09-11 --line-regex 'UNEXPECTED.+python' | grep  python3
  21 UNEXPECTED(error): samba.tests.kcc.python3.samba.tests.kcc.KCCTests.test_verify(vampire_dc)
   8 UNEXPECTED(error): samba.tests.kcc.python3.samba.tests.kcc.KCCTests.test_verify(promoted_dc)
   1 UNEXPECTED(failure): samba4.drs.samba_tool_drs_showrepl.python(promoted_dc).python3.samba_tool_drs_showrepl.SambaToolDrsShowReplTests.test_samba_tool_showrepl_summary_forced_failure(promoted_dc:local)
   1 UNEXPECTED(error): samba.tests.kcc.python3.samba.tests.kcc.KCCTests.test_list_dsas(vampire_dc)
   1 UNEXPECTED(failure): samba4.drs.samba_tool_drs_showrepl.python(vampire_dc).python3.samba_tool_drs_showrepl.SambaToolDrsShowReplTests.test_samba_tool_showrepl_summary_forced_failure(vampire_dc:local)
   1 UNEXPECTED(error): samba4.drs.replica_sync.python(vampire_dc).python3.replica_sync.DrsReplicaSyncTestCase.test_ReplConflictsRenamedVsNewRemoteWin(vampire_dc:local)

The samba_tool_drs_showrepl tests are irritating for all pythons. This
is almost certainly due to races between various checks and updates. I
will try to rework them.

cheers,
Douglas