Samba 4 test improvements

Jelmer Vernooij jelmer at samba.org
Tue Mar 6 13:37:46 GMT 2007


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Over the past few days, Andrew Bartlett and I have been working on
improving the test infrastructure in Samba 4. I thought I'd give a short
summary here to explain what changes we've made and how they can be used.

Detailed code coverage reports in HTML are now generated by the build
farm. There is also a new "code coverage" link with the code coverage
percentage on the summary page. We use lcov (part of the linux testing
project) to generate these pages. You can also generate these pages
manually in Samba 4 by running "make lcov".

See the following pages for the code coverage reports:
  * http://build.samba.org/lcov/data/tridge/samba4/ for Samba 4
  * http://build.samba.org/lcov/data/tridge/samba_3_0 for Samba 3

The main engine behind that runs the test suites, "selftest" has been
rewritten in perl (was in sh previously). This adds a few new features.

Maybe most noticeable is the addition of the TESTS make variable. If you
set this variable to some regular expression, 'make test' will only run
the tests whose name match that regular expression. For example, to run
just the SMB2 tests, run:

$ make test TESTS=SMB2

Tests that should be skipped for some reason can now be listed in the
file 'samba4-skip'.

Tests that are known to fail should be added wto the
samba4-knownfailures file. The system won't warn about tests that are in
that file and are failing.

The idea behind this is that we always run all tests, have a good idea
of what functionality is still missing or broken (looking at
samba4-knownfailures gives a good indication) and always run all working
tests.

Next, we should hopefully get testing with multiple smbds working
(setting up a domain, creating a DC, adding domain members, etc), so we
can test winbind.

Cheers,

Jelmer
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iQCVAwUBRe1upgy0JeEGD2blAQLPpgP/ShyeL9BCEMjzn9PjGdrfDjVUullawotF
tS0Rdt2+kpkKjHhSs+gaC6ZeA5iRI4+CAbNmxQJ41w2n2rQid/13ZzlaiQShgHeg
SD9qcHzlXtv4r6mWxYR9WMi5usTJhIAAI/2L8piknJmVzZiN553IX8mQv1mAJ2A3
3Az7f5iU23g=
=RLjK
-----END PGP SIGNATURE-----


More information about the samba-technical mailing list