The regressions reported in this report are not real failures. These failures caused due to No space Left on the LAVA.
LTP mm and cve tests are due to long runs and timedout tests after 15 minutes on qemu and not real failures.
- Naresh
On Fri, 8 Feb 2019 at 00:51, Linaro QA qa-reports@linaro.org wrote:
Summary
kernel: 4.4.174-rc1 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.4.y git commit: 968fa3bc933965940f7fb2a56789dac2bd12e4da git describe: v4.4.173-35-g968fa3bc9339 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.4-oe/build/v4.4.173-35-...
Regressions (compared to build v4.4.173)
qemu_arm: ltp-mm-tests: * ksm01
* test src: git://github.com/linux-test-project/ltp.gitqemu_i386: ltp-mm-tests: * ksm05
* test src: git://github.com/linux-test-project/ltp.gitqemu_x86_64: ltp-cve-tests: * cve-2011-2183
* test src: git://github.com/linux-test-project/ltp.gitltp-mm-tests: * ksm05
* test src: git://github.com/linux-test-project/ltp.gitltp-syscalls-tests: * lchown03 * linkat02 * lremovexattr01 * mknod07 * mknodat02 * mmap16 * mount01 * mount02 * mount03 * mount04 * mount06 * msync04 * preadv03 * preadv03_64 * pwritev03 * pwritev03_64 * quotactl01 * readahead02 * rename11 * renameat01 * setxattr01 * umount01 * umount02 * umount03 * umount2_01 * umount2_02 * umount2_03 * utime06
* test src: git://github.com/linux-test-project/ltp.gitFixes (compared to build v4.4.173)
qemu_x86_64: spectre-meltdown-checker-test: * CVE-2018-3639 * CVE-2018-3640
* test src: not informedx15 - arm: ltp-mm-tests: * ksm01
* test src: git://github.com/linux-test-project/ltp.gitBoards, architectures and test suites:
i386
- boot - pass: 14,
- kselftest - pass: 72, fail: 4, skip: 15, xfail: 62
- libhugetlbfs - pass: 1,
- ltp-containers-tests - pass: 79, xfail: 1
- ltp-cpuhotplug-tests - pass: 5, skip: 1,
- ltp-cve-tests - pass: 31, fail: 1, skip: 5, xfail: 1
- ltp-fcntl-locktests-tests - pass: 1,
- ltp-filecaps-tests - pass: 1,
- ltp-fs-tests - pass: 60, skip: 5,
- ltp-fs_bind-tests - pass: 1,
- ltp-fs_perms_simple-tests - pass: 18,
- ltp-fsx-tests - pass: 1,
- ltp-hugetlb-tests - pass: 20, skip: 1,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 49, skip: 23, xfail: 3
- ltp-nptl-tests - pass: 1,
- ltp-open-posix-tests - pass: 1687, skip: 47, xfail: 4
- ltp-pty-tests - pass: 4,
- ltp-sched-tests - pass: 6, skip: 4,
- ltp-securebits-tests - pass: 3,
- ltp-syscalls-tests - pass: 1101, fail: 3, skip: 75, xfail: 1
- ltp-timers-tests - pass: 12,
- spectre-meltdown-checker-test - pass: 3, xfail: 5
juno-r2 - arm64
- boot - pass: 14,
- kselftest - pass: 57, fail: 3, skip: 18, xfail: 56
- libhugetlbfs - pass: 90, skip: 1,
- ltp-cap_bounds-tests - pass: 1,
- ltp-containers-tests - pass: 43, skip: 36, xfail: 1
- ltp-cpuhotplug-tests - pass: 5, skip: 1,
- ltp-cve-tests - pass: 28, skip: 10,
- ltp-fcntl-locktests-tests - pass: 1,
- ltp-filecaps-tests - pass: 1,
- ltp-fs-tests - pass: 59, skip: 5, xfail: 1
- ltp-fs_bind-tests - pass: 1,
- ltp-fs_perms_simple-tests - pass: 18,
- ltp-fsx-tests - pass: 1,
- ltp-hugetlb-tests - pass: 21,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 57, skip: 17, xfail: 1
- ltp-nptl-tests - pass: 1,
- ltp-open-posix-tests - pass: 1693, skip: 42, xfail: 4
- ltp-pty-tests - pass: 4,
- ltp-sched-tests - pass: 6, skip: 4,
- ltp-securebits-tests - pass: 3,
- ltp-syscalls-tests - pass: 1024, fail: 4, skip: 153, xfail: 2
- ltp-timers-tests - pass: 12,
- spectre-meltdown-checker-test - pass: 4, fail: 1, skip: 1, xfail: 2
qemu_arm
- boot - pass: 12,
- kselftest - pass: 52, fail: 4, skip: 18, xfail: 61
- libhugetlbfs - pass: 87, skip: 1,
- ltp-containers-tests - pass: 79, xfail: 1
- ltp-cve-tests - pass: 28, skip: 10,
- ltp-fs-tests - pass: 60, skip: 5,
- ltp-hugetlb-tests - pass: 20, skip: 1,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 49, fail: 1, skip: 22, xfail: 3
- ltp-sched-tests - pass: 4, skip: 6,
- ltp-syscalls-tests - pass: 1073, fail: 4, skip: 105, xfail: 1
- spectre-meltdown-checker-test - pass: 8,
qemu_i386
- boot - pass: 13,
- kselftest - pass: 72, fail: 5, skip: 11, xfail: 62
- libhugetlbfs - pass: 87, skip: 1,
- ltp-cap_bounds-tests - pass: 1,
- ltp-containers-tests - pass: 79, xfail: 1
- ltp-cpuhotplug-tests - pass: 5, skip: 1,
- ltp-cve-tests - pass: 32, skip: 5, xfail: 1
- ltp-fcntl-locktests-tests - pass: 1,
- ltp-filecaps-tests - pass: 1,
- ltp-fs-tests - pass: 60, skip: 5,
- ltp-hugetlb-tests - pass: 20, skip: 1,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 48, fail: 1, skip: 23, xfail: 3
- ltp-sched-tests - pass: 10,
- ltp-syscalls-tests - pass: 1080, fail: 3, skip: 100,
- ltp-timers-tests - pass: 12,
- spectre-meltdown-checker-test - pass: 8,
qemu_x86_64
- boot - pass: 12,
- kselftest - pass: 53, fail: 5, skip: 21, xfail: 48
- libhugetlbfs - pass: 90, skip: 1,
- ltp-cap_bounds-tests - pass: 1,
- ltp-containers-tests - pass: 79, xfail: 1
- ltp-cve-tests - pass: 31, fail: 1, skip: 5, xfail: 1
- ltp-fs-tests - pass: 60, skip: 5,
- ltp-hugetlb-tests - pass: 21,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 53, fail: 1, skip: 18, xfail: 3
- ltp-sched-tests - pass: 10,
- ltp-syscalls-tests - pass: 986, fail: 33, skip: 164,
- spectre-meltdown-checker-test - pass: 8,
x15 - arm
- boot - pass: 11,
- install-android-platform-tools-r2600 - pass: 22,
- kselftest - pass: 40, fail: 4, skip: 14, xfail: 57
- ltp-cap_bounds-tests - pass: 1,
- ltp-cpuhotplug-tests - pass: 5, skip: 1,
- ltp-fcntl-locktests-tests - pass: 1,
- ltp-filecaps-tests - pass: 1,
- ltp-fs-tests - pass: 60, skip: 5,
- ltp-fs_bind-tests - pass: 1,
- ltp-fs_perms_simple-tests - pass: 18,
- ltp-fsx-tests - pass: 1,
- ltp-hugetlb-tests - pass: 19, skip: 2,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 50, skip: 22, xfail: 3
- ltp-nptl-tests - pass: 1,
- ltp-open-posix-tests - pass: 1694, skip: 41, xfail: 4
- ltp-pty-tests - pass: 4,
- ltp-sched-tests - pass: 10,
- ltp-securebits-tests - pass: 3,
- ltp-syscalls-tests - pass: 1087, fail: 3, skip: 90, xfail: 3
- ltp-timers-tests - pass: 12,
x86_64
- boot - pass: 16,
- kselftest - pass: 69, fail: 5, skip: 20, xfail: 54
- kselftest-vsyscall-mode-native - pass: 67, fail: 17, skip: 18, xfail: 42
- kselftest-vsyscall-mode-none - pass: 68, fail: 16, skip: 20, xfail: 43
- libhugetlbfs - pass: 90, skip: 1,
- ltp-cap_bounds-tests - pass: 1,
- ltp-containers-tests - pass: 79, xfail: 1
- ltp-cpuhotplug-tests - pass: 5, skip: 1,
- ltp-cve-tests - pass: 33, skip: 5,
- ltp-fcntl-locktests-tests - pass: 1,
- ltp-filecaps-tests - pass: 1,
- ltp-fs-tests - pass: 60, skip: 5,
- ltp-fs_bind-tests - pass: 1,
- ltp-fs_perms_simple-tests - pass: 18,
- ltp-fsx-tests - pass: 1,
- ltp-hugetlb-tests - pass: 21,
- ltp-io-tests - pass: 2,
- ltp-ipc-tests - pass: 8,
- ltp-math-tests - pass: 10,
- ltp-mm-tests - pass: 54, skip: 18, xfail: 3
- ltp-nptl-tests - pass: 1,
- ltp-open-posix-tests - pass: 1690, skip: 45, xfail: 4
- ltp-pty-tests - pass: 4,
- ltp-sched-tests - pass: 6, skip: 4,
- ltp-securebits-tests - pass: 3,
- ltp-syscalls-tests - pass: 1045, fail: 3, skip: 134, xfail: 1
- ltp-timers-tests - pass: 12,
- spectre-meltdown-checker-test - pass: 5, xfail: 3
-- Linaro QA (BETA) https://qa-reports.linaro.org