Summary of flapping tests on sn-devel, ~ last 2 months

[Douglas Bagnall]

hi all,

I have re-run my script that counts sn_devel failures for roughly the
last couple of months (since I last wrote about this ~2016-03-11).
It only catches the ones that get as far as running the autobuild.

The short version is:

  73 samba4.blackbox.dbcheck
  64 samba3.blackbox.smbclient_tar
  25 samba4.ldap.notification.python
   7 samba3.blackbox.smbclient_s3.plain
   6 samba4.rpc.backupkey
   5 samba3.blackbox.smbclient_s3.sign
   3 samba4.rpc.cracknames
   3 samba3.smb2.notify.mask
   3 samba3.smb2.durable
   2 samba.blackbox.wbinfo
   2 samba4.blackbox.smbclient
   2 samba4.drs.repl_schema.python
   2 samba3.smb2.notify.rmdir3


and the long:

found 209 lines matching '^UNEXPECTED' in 289 files matching 'samba.stdout$'
  64 UNEXPECTED(failure): samba4.blackbox.dbcheck(ad_dc_ntvfs).dbcheck(ad_dc_ntvfs:local)
  30 UNEXPECTED(failure): samba3.blackbox.smbclient_tar (fileserver).create, reset archived files with -a(fileserver)
  24 UNEXPECTED(failure): samba4.ldap.notification.python(ad_dc_ntvfs).__main__.LDAPNotificationTest.test_max_search(ad_dc_ntvfs)
  18 UNEXPECTED(failure): samba3.blackbox.smbclient_tar (fileserver).create, combination of tarmode filter(fileserver)
  11 UNEXPECTED(failure): samba3.blackbox.smbclient_tar (fileserver).create, incremental with -g(fileserver)
   6 UNEXPECTED(failure): samba4.blackbox.dbcheck(vampire_dc).dbcheck(vampire_dc:local)
   4 UNEXPECTED(failure): samba3.blackbox.smbclient_tar (fileserver).create, incremental with tarmode(fileserver)
   3 UNEXPECTED(failure): samba4.rpc.backupkey with seal.backupkey.server_wrap_encrypt_decrypt_wrong_key(ad_dc_ntvfs)
   3 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.plain (ad_member) member creds.sending a message to the remote server(ad_member)
   3 UNEXPECTED(failure): samba4.rpc.backupkey with seal.backupkey.server_wrap_decrypt_wrong_r2(ad_dc_ntvfs)
   3 UNEXPECTED(failure): samba3.smb2.durable-open.open2-lease(nt4_dc)
   2 UNEXPECTED(failure): samba4.blackbox.dbcheck(promoted_dc).dbcheck(promoted_dc:local)
   2 UNEXPECTED(failure): samba4.rpc.cracknames on ncacn_ip_tcp with seal.cracknames.cracknames-test(ad_dc_ntvfs)
   2 UNEXPECTED(failure): samba3.smb2.notify.mask(nt4_dc)
   2 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.plain (nt4_dc).sending a message to the remote server(nt4_dc)
   2 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.sign (nt4_dc).creating a good symlink and deleting it by path(nt4_dc)
   2 UNEXPECTED(failure): samba4.blackbox.smbclient(chgdcpass:local).Test login with --machine-pass without kerberos(chgdcpass:local)
   2 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.plain (nt4_member) member creds.sending a message to the remote server(nt4_member)
   1 UNEXPECTED(error): samba4.drs.delete_object.python(promoted_dc).delete_object.DrsDeleteObjectTestCase.test_ReplicateDeletedObject2(promoted_dc)
   1 UNEXPECTED(failure): samba4.winbind.pac.GSSAPI(ad_member:local)
   1 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.sign (nt4_member) member creds.creating a good symlink and deleting it by path(nt4_member)
   1 UNEXPECTED(failure): samba.blackbox.wbinfo(rodc:local).wbinfo -N against rodc(rodc:local)
   1 UNEXPECTED(failure): samba3.rpc.spoolss.printer.addprinterex.sd(ad_dc)
   1 UNEXPECTED(failure): samba4.rpc.samr.users.privileges on ncacn_np with .samr.delete_privileged_user(ad_dc_ntvfs)
   1 UNEXPECTED(failure): samba3.blackbox.smbclient_tar (fileserver).create, reset archived files with tarmode(fileserver)
   1 UNEXPECTED(error): samba4.drs.repl_schema.python(promoted_dc).repl_schema.DrsReplSchemaTestCase.test_classWithCustomAttribute(promoted_dc)
   1 UNEXPECTED(error): samba3.smb2.notify.rmdir3(ad_dc) (samba.subunit.RemotedTestCase)
   1 UNEXPECTED(failure): samba4.rpc.cracknames on ncacn_ip_tcp.cracknames.cracknames-test(ad_dc_ntvfs)
   1 UNEXPECTED(failure): samba3.wbinfo_simple.(ad_member:local).--krb5auth=SAMBADOMAIN/Administrator%locDCpass1.wbinfo(ad_member:local)
   1 UNEXPECTED(failure): samba4.ldap.notification.python(ad_dc_ntvfs).__main__.LDAPNotificationTest.test_simple_search(ad_dc_ntvfs)
   1 UNEXPECTED(failure): samba3.smb2.notify.mask(ad_dc)
   1 UNEXPECTED(failure): samba4.drs.fsmo.python(vampire_dc).fsmo.DrsFsmoTestCase.test_SchemaMasterTransfer(vampire_dc)
   1 UNEXPECTED(failure): samba4.winbind.struct.domain_info(ad_member:local)
   1 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.sign (ad_member) member creds.creating a good symlink and deleting it by path(ad_member)
   1 UNEXPECTED(failure): samba3.rpc.spoolss.printer.addprinter.sd(ad_dc)
   1 UNEXPECTED(failure): samba.blackbox.wbinfo(ad_member:local).wbinfo -t against ad_member(ad_member:local)
   1 UNEXPECTED(failure): samba3.raw.notify.mask(nt4_dc)
   1 UNEXPECTED(failure): samba4.blackbox.kinit_trust(fl2003dc:local).Test login with user kerberos ccache(fl2003dc:local)
   1 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.crypt (nt4_dc).creating a good symlink and deleting it by path(nt4_dc)
   1 UNEXPECTED(failure): samba3.smbtorture_s3.plain(ad_dc_ntvfs).FDPASS.smbtorture(ad_dc_ntvfs)
   1 UNEXPECTED(failure): samba4.blackbox.dbcheck(fl2000dc).dbcheck(fl2000dc:local)
   1 UNEXPECTED(error): samba3.smb2.notify.rmdir3 (samba.subunit.RemotedTestCase)(ad_dc)
   1 UNEXPECTED(error): samba4.drs.repl_schema.python(promoted_dc).repl_schema.DrsReplSchemaTestCase.test_all(promoted_dc)
   1 UNEXPECTED(failure): samba3.blackbox.smbclient_s3.sign (ad_member) member creds.sending a message to the remote server(ad_member)


Douglas