mirror of https://github.com/qt/qtbase.git
655bed6568
Previously it re-ran only the failed tests, if a proper XML logfile was written. But in case of "crash" caused by the watchdog for QTEST_FUNCTION_TIMEOUT, the subsequent tests were not included in the XML logfile, thus those were never run. Fixes: QTQAINFRA-5226 Change-Id: Ib4f0849fa2511bb34365fd901fd53c5a3e3ab293 Reviewed-by: Edward Welbourne <edward.welbourne@qt.io> |
||
|---|---|---|
| .. | ||
| tests | ||
| README | ||
| qt-testrunner.py | ||
| sanitizer-testrunner.py | ||
README
qt-testrunner.py is a script that can wrap the execution of every test in Qt in order to iron out common issues with testing. It can be turned on by setting the environment variable TESTRUNNER=/path/to/qt-testrunner.py before invoking ctest. It is commonly in use in Coin, the Continuous Integration system of Qt. It offers the following functionality + Reads the XML test log and understands exactly which function of the test failed. + Checks the exit code and if needed repeats only the failed function of the test. + Appends output argument to it: "-o file.xml" + In case the test is executed multiple times - the previous output files are saved - the verbosity level is increased The script itself has a testsuite that is simply run by invoking qtbase/util/testrunner/tests/tst_testrunner.py Please *run this manually* before submitting a change to qt-testrunner and make sure it's passing. The reason it does not run automatically during the usual qtbase test run, is because + the test run should not depend on Python + we don't want to wrap the testrunner tests with testrunner.