To assist in automated quality assurance for distributions, the LSB supports running most of the distribution test suite in an automated fashion, either at the command line or via cron. The basis of that support is the LSB DTK Manager, which supports a command-line tool for running the tests. You can read more about that tool at the Nightly Run HOWTO.
We have also created a small wrapper around DTK Manager which does several things:
Here are simple instructions for preparing automatic test runs.
You first have to set up a system to test. This may be a native system, or a virtual machine using virtualization software. The system should be LSB-compliant; make sure, if your distribution needs special treatment to install LSB support, that the support is installed.
It's important to note that several of the LSB tests are not secure, and thus the tests should never be run on a system doing anything important. Ideally, native boxes running the tests will run nothing else, and will be shut off when not being tested. Virtual machines should not be kept running when not doing a test run.
One particular part of the LSB which must be supported beforehand is the installation of LSB-compliant RPM packages. Most distributions either support RPM directly, or via the "alien" package conversion tool. If your distribution has no way of installing RPMs, please contact the LSB workgroup; we would be happy to assist you, if we can, in supporting this vital infrastructure.
In addition to an LSB-compliant system, the automated tests will need the following:
There are a number of ways to get the LSB DTK Manager. See the Downloads page for details on installing a stable version of DTK Manager, or the LSB Wiki for information on snapshots, betas, and other unreleased versions.
At this point, you can run the automated test framework yourself:
Options exist for choosing which LSB version to test against, whether the tests should be automatically updated from the Linux Foundation archive, whether results should be uploaded to a server or emailed, etc.
We provide a wrapper script which can