List overview
Download

linaro-validation November 2018

linaro-validation@lists.linaro.org

4 participants
1 discussions

Start a nNew thread

ptest.py script seems to generate not really informative results

by Oleksandr Terentiev

Hi, I launched util-linux ptest using automated/linux/ptest/ptest.yaml from https://git.linaro.org/qa/test-definitions.git and received the following results: https://pastebin.com/nj9PYQzE As you can see some tests failed. However, case util-linux marked as passed. It looks like ptest.py only analyze return code of ptest-runner -d <ptest_dir> <ptest_name> command. And since ptest-runner finishes correctly exit code is 0. Therefore all tests are always marked as passed, and users never know when some of the tests fail. Maybe it worth to analyze each test? Best regards, Alex

6 years