Flapping tests since the beginning of July

[Douglas Bagnall]

These are the tests that have been failing on sn-devel in the last
month or so. This is after the smbclient_tar thing was fixed.

As noted in another thread, several lines contain the string 'repl'.

Aggregating by the part of the test name matching /^[\w.]+/:

  13 samba4.drs.repl_schema.python
  12 samba4.drs.repl_move.python
  10 samba.tests.dns_forwarder.__main__.TestDnsForwarding.test_cname
   4 samba3.rpc.spoolss.printer.addprinter.sd
   3 samba4.drs.replica_sync.python
   2 samba4.blackbox.samba_tool_demote
   2 samba4.rpc.backupkey
   2 samba4.rpc.cracknames
   2 samba.tests.blackbox.samba_dnsupdate.samba.tests.blackbox.samba_dnsupdate.SambaDnsUpdateTests.test_samba_dnsupate_set_ip
   1 samba3.smb2.durable
   1 samba.tests.blackbox.samba_tool_drs.samba.tests.blackbox.samba_tool_drs.SambaToolDrsTests.test_samba_tool_kcc
   1 samba3.blackbox.smbclient_s3.crypt
   1 samba.tests.dns_forwarder.__main__.TestDnsForwarding.test_single_forwarder
   1 samba.tests.dns_forwarder.__main__.TestDnsForwarding.test_comatose_forwarder
   1 samba.tests.blackbox.samba_dnsupdate.samba.tests.blackbox.samba_dnsupdate.SambaDnsUpdateTests.test_samba_dnsupate_no_change
   1 samba4.ldap.secdesc.python


and the full list:

found 57 lines matching '^UNEXPECTED' in 254 files matching 'samba.stdout$'
  10 UNEXPECTED(error): samba.tests.dns_forwarder.__main__.TestDnsForwarding.test_cname(fl2003dc:local)
   6 UNEXPECTED(error): samba4.drs.repl_schema.python(promoted_dc).repl_schema.DrsReplSchemaTestCase.test_classWithCustomAttribute(promoted_dc)
   4 UNEXPECTED(error): samba4.drs.repl_schema.python(promoted_dc).repl_schema.DrsReplSchemaTestCase.test_classInheritance(promoted_dc)
   4 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveBetweenTreeOfObjectTestCase.test_ReplicateAddInConflictOU2(promoted_dc)
   4 UNEXPECTED(failure): samba3.rpc.spoolss.printer.addprinter.sd(ad_dc)
   2 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveBetweenTreeOfObjectTestCase.test_ReplicateAddInConflictOU_time(promoted_dc)
   2 UNEXPECTED(failure): samba.tests.blackbox.samba_dnsupdate.samba.tests.blackbox.samba_dnsupdate.SambaDnsUpdateTests.test_samba_dnsupate_set_ip(chgdcpass:local)
   2 UNEXPECTED(failure): samba4.rpc.cracknames on ncacn_ip_tcp with seal.cracknames.cracknames-test(ad_dc_ntvfs)
   2 UNEXPECTED(failure): samba4.blackbox.samba_tool_demote(vampire_dc).demote(vampire_dc)
   2 UNEXPECTED(error): samba4.drs.repl_schema.python(promoted_dc).repl_schema.DrsReplSchemaTestCase.test_all(promoted_dc)
   1 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveObjectTestCase.test_ReplicateMoveObject3b(promoted_dc)
   1 UNEXPECTED(failure): samba4.rpc.backupkey with seal.backupkey.server_wrap_encrypt_decrypt_wrong_key(ad_dc_ntvfs)
   1 UNEXPECTED(error): samba4.drs.replica_sync.python(promoted_dc).replica_sync.DrsReplicaSyncTestCase.test_ReplConflictsRemoteWin_with_child(promoted_dc:local)
   1 UNEXPECTED(error): samba.tests.blackbox.samba_tool_drs.samba.tests.blackbox.samba_tool_drs.SambaToolDrsTests.test_samba_tool_kcc(promoted_dc:local)
   1 UNEXPECTED(error): samba4.drs.repl_schema.python(promoted_dc).repl_schema.DrsReplSchemaTestCase.test_class(promoted_dc)
   1 UNEXPECTED(failure): samba.tests.dns_forwarder.__main__.TestDnsForwarding.test_single_forwarder(fl2003dc:local)
   1 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveBetweenTreeOfObjectTestCase.test_ReplicateMoveInTree1(promoted_dc)
   1 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveObjectTestCase.test_ReplicateMoveObject11(promoted_dc)
   1 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveBetweenTreeOfObjectTestCase.test_ReplicateAddInMovedOU(promoted_dc)
   1 UNEXPECTED(error): samba.tests.dns_forwarder.__main__.TestDnsForwarding.test_comatose_forwarder(fl2003dc:local)
   1 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.crypt (nt4_dc).creating a good symlink and deleting it by path(nt4_dc)
   1 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveObjectTestCase.test_ReplicateMoveObject4(promoted_dc)
   1 UNEXPECTED(failure): samba4.rpc.backupkey with seal.backupkey.server_wrap_decrypt_wrong_r2(ad_dc_ntvfs)
   1 UNEXPECTED(failure): samba3.smb2.durable-open.open2-lease(nt4_dc)
   1 UNEXPECTED(error): samba4.drs.replica_sync.python(vampire_dc).replica_sync.DrsReplicaSyncTestCase.test_ReplConflictsRemoteWin_with_child(vampire_dc:local)
   1 UNEXPECTED(error): samba4.drs.replica_sync.python(vampire_dc).replica_sync.DrsReplicaSyncTestCase.test_ReplConflictsRemoteWin(vampire_dc:local)
   1 UNEXPECTED(error): samba4.ldap.secdesc.python(fl2000dc).__main__.OwnerGroupDescriptorTests.test_141(fl2000dc)
   1 UNEXPECTED(error): samba4.drs.repl_move.python(promoted_dc).repl_move.DrsMoveObjectTestCase.test_ReplicateMoveObject2(promoted_dc)
   1 UNEXPECTED(failure): samba.tests.blackbox.samba_dnsupdate.samba.tests.blackbox.samba_dnsupdate.SambaDnsUpdateTests.test_samba_dnsupate_no_change(chgdcpass:local)


The good news is that the overall numbers are lower than they used to
be.

Douglas