Summary ------------------------------------------------------------------------
kernel: 4.18.0-rc7 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git git branch: master git commit: f390b7bffdfef1ff552632cad41134e67b2b5684 git describe: v4.18-rc7-106-gf390b7bffdfe Test details: https://qa-reports.linaro.org/lkft/linux-mainline-oe/build/v4.18-rc7-106-gf3...
Regressions (compared to build v4.18-rc7-90-gc1d61e7fe376) ------------------------------------------------------------------------
dragonboard-410c - arm64: kselftest: * bpf_test_sock_addr.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_arm64: kselftest: * timers_rtcpie
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
x15 - arm: ltp-open-posix-tests: * clock_settime_8-1
* test src: git://github.com/linux-test-project/ltp.git
Boards, architectures and test suites: -------------------------------------
dragonboard-410c - arm64 * boot - pass: 19 * kselftest - skip: 33, fail: 16, pass: 66 * libhugetlbfs - skip: 1, fail: 2, pass: 88 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - skip: 17, pass: 64 * ltp-cve-tests - skip: 8, pass: 27 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 6, pass: 60 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - skip: 1, pass: 21 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - pass: 14 * ltp-securebits-tests - pass: 4
hi6220-hikey - arm64 * boot - pass: 1 * ltp-cap_bounds-tests - pass: 2
qemu_arm * boot - pass: 21 * kselftest - skip: 31, fail: 13, pass: 50 * libhugetlbfs - skip: 1, fail: 1, pass: 86 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - skip: 18, pass: 63 * ltp-cve-tests - skip: 12, pass: 23 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 5, pass: 61 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - skip: 1, pass: 21 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - skip: 6, pass: 8 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 99, pass: 1050 * ltp-timers-tests - pass: 13
qemu_arm64 * boot - pass: 21 * kselftest - skip: 37, fail: 16, pass: 64 * libhugetlbfs - skip: 1, fail: 1, pass: 89 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - skip: 17, pass: 64 * ltp-cve-tests - skip: 10, pass: 25 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 6, pass: 60 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - skip: 6, pass: 8 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 157, pass: 992 * ltp-timers-tests - pass: 13
qemu_x86_64 * boot - pass: 21 * kselftest - skip: 38, fail: 7, pass: 83 * libhugetlbfs - skip: 1, fail: 1, pass: 89 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - skip: 17, pass: 64 * ltp-cve-tests - skip: 6, pass: 29 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 6, pass: 60 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - pass: 14 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 156, pass: 993 * ltp-timers-tests - pass: 13
x15 - arm * boot - pass: 22 * kselftest - skip: 27, fail: 12, pass: 53 * libhugetlbfs - skip: 1, fail: 1, pass: 86 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - skip: 18, pass: 63 * ltp-cve-tests - skip: 10, pass: 25 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 5, pass: 61 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - skip: 2, pass: 20 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-open-posix-tests - skip: 40, fail: 5, pass: 1690 * ltp-pty-tests - pass: 4 * ltp-sched-tests - pass: 14 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 78, pass: 1071 * ltp-timers-tests - pass: 13
x86_64 * boot - pass: 24 * kselftest - skip: 32, fail: 7, pass: 92 * kselftest-vsyscall-mode-native - skip: 33, fail: 7, pass: 92 * kselftest-vsyscall-mode-none - skip: 31, fail: 7, pass: 92 * libhugetlbfs - skip: 1, fail: 1, pass: 89 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - skip: 17, pass: 64 * ltp-cve-tests - skip: 5, pass: 30 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 5, pass: 61 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-open-posix-tests - skip: 41, fail: 5, pass: 1688 * ltp-pty-tests - pass: 4 * ltp-sched-tests - skip: 4, pass: 10 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 118, pass: 1031 * ltp-timers-tests - pass: 13
On Thu, Aug 02, 2018 at 04:53:30AM +0000, Linaro QA wrote:
qemu_arm64: kselftest: * timers_rtcpie
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
This one is about RTC tests using userland. It is broken for 64Hz. It is close to the 1ms timeslice limit (even for weighted vruntime) of CFS. Same as:
https://bugs.linaro.org/show_bug.cgi?id=3402
My last comment: https://bugs.linaro.org/show_bug.cgi?id=3402#c12
Summarizes the issue. I'm thinking in proposing a change to upstream: ignore 64 Hz tests for virtual machines and/or systems with less than 4 CPUs. At the end, it does not make much sense to check RTC deviations using userland. Another possibility would be to test this using a simple module to be loaded just for the test, when no scheduler limits would apply for the IRQ handlers.
PS: Having KVM VMs, using virtio realtime clock implementations, will help for this BUT won't remove the min 1ms timeslice of CFS (that makes this test also fail in boards with less cores, like x15).
On Thu, Aug 02, 2018 at 10:29:52AM -0300, Rafael David Tinoco wrote:
On Thu, Aug 02, 2018 at 04:53:30AM +0000, Linaro QA wrote:
qemu_arm64: kselftest: * timers_rtcpie
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.gitThis one is about RTC tests using userland. It is broken for 64Hz. It is close to the 1ms timeslice limit (even for weighted vruntime) of CFS. Same as:
https://bugs.linaro.org/show_bug.cgi?id=3402
My last comment: https://bugs.linaro.org/show_bug.cgi?id=3402#c12
Summarizes the issue. I'm thinking in proposing a change to upstream: ignore 64 Hz tests for virtual machines and/or systems with less than 4 CPUs. At the end, it does not make much sense to check RTC deviations using userland. Another possibility would be to test this using a simple module to be loaded just for the test, when no scheduler limits would apply for the IRQ handlers.
PS: Having KVM VMs, using virtio realtime clock implementations, will help for this BUT won't remove the min 1ms timeslice of CFS (that makes this test also fail in boards with less cores, like x15).
+1 on an upstream fix. A flaky test is pointless and expensive.
Dan
-
Dan Rue -
Linaro QA -
Rafael David Tinoco