Summary ------------------------------------------------------------------------
kernel: 4.19.76-rc1 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.19.y git commit: b52c75f7b9785d0d0e6bf145787ed2fc99f5483c git describe: v4.19.75-64-gb52c75f7b978 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.19-oe/build/v4.19.75-64...
No regressions (compared to build v4.19.75-64-g808a1dbca6b4)
Fixes (compared to build v4.19.75-64-g808a1dbca6b4) ------------------------------------------------------------------------
x15 - arm: perf: * Object-code-reading
juno-r2 - arm64: kvm-unit-tests: * timer
Boards, architectures and test suites: -------------------------------------
dragonboard-410c - arm64 * build - pass: 1, * install-android-platform-tools-r2600 - pass: 36, * kselftest - fail: 22, pass: 31, skip: 11, xfail: 36 * libhugetlbfs - pass: 89, skip: 1, xfail: 1 * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 29, skip: 11, * ltp-dio-tests - pass: 10, skip: 20, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 19, skip: 2, * ltp-io-tests - pass: 2, * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - fail: 1, pass: 53, skip: 19, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 10, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1068, skip: 144, xfail: 5 * ltp-timers-tests - pass: 8, * perf - fail: 10, pass: 45, skip: 10, * spectre-meltdown-checker-test - pass: 12, * v4l2-compliance - pass: 42, xfail: 2
hi6220-hikey - arm64 * build - pass: 1, * install-android-platform-tools-r2600 - pass: 36, * kselftest - fail: 23, pass: 36, skip: 10, xfail: 33 * libhugetlbfs - pass: 90, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 26, skip: 14, xfail: 1 * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 29, skip: 11, * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 59, skip: 7, xfail: 1 * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 20, skip: 1, * ltp-io-tests - pass: 2, * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 56, skip: 18, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 6, skip: 4, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1069, skip: 143, xfail: 5 * network-basic-tests - pass: 10, skip: 1, * perf - fail: 10, pass: 42, skip: 13, * spectre-meltdown-checker-test - pass: 12, * v4l2-compliance - pass: 42, xfail: 2
i386 * build - pass: 1, * kselftest - fail: 28, pass: 107, skip: 17, xfail: 55 * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 32, skip: 6, xfail: 2 * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 62, skip: 5, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 20, skip: 1, * ltp-io-tests - pass: 2, * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 51, skip: 23, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-open-posix-tests - pass: 1692, skip: 41, xfail: 4 * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 6, skip: 4, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1147, skip: 67, xfail: 1 * ltp-timers-tests - pass: 8, * network-basic-tests - pass: 10, skip: 1, * perf - fail: 9, pass: 49, skip: 10, * spectre-meltdown-checker-test - fail: 4, pass: 3, xfail: 5 * v4l2-compliance - pass: 42, xfail: 2
juno-r2 - arm64 * build - pass: 1, * kselftest - fail: 21, pass: 32, skip: 11, xfail: 34 * kvm-unit-tests - pass: 13, skip: 3, * libhugetlbfs - pass: 90, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 29, skip: 11, * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 59, skip: 7, xfail: 1 * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 21, * ltp-io-tests - pass: 2, * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 56, skip: 18, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-open-posix-tests - pass: 1693, skip: 42, xfail: 4 * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 6, skip: 4, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1071, skip: 141, xfail: 5 * ltp-timers-tests - pass: 8, * network-basic-tests - pass: 10, skip: 1, * spectre-meltdown-checker-test - pass: 9, skip: 1, xfail: 2 * v4l2-compliance - pass: 42, xfail: 2
qemu_arm * kselftest - fail: 21, pass: 29, skip: 11, xfail: 39 * libhugetlbfs - pass: 87, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 30, skip: 10, * ltp-dio-tests - pass: 18, skip: 11, xfail: 1 * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 60, skip: 7, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 20, skip: 1, * ltp-io-tests - pass: 1, xfail: 1 * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 52, skip: 22, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 4, skip: 6, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1118, skip: 96, xfail: 3 * ltp-timers-tests - pass: 8, * perf - fail: 9, pass: 40, skip: 13, * spectre-meltdown-checker-test - pass: 12, * v4l2-compliance - pass: 42, xfail: 2
qemu_arm64 * kselftest - fail: 23, pass: 31, skip: 11, xfail: 36 * libhugetlbfs - pass: 90, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 29, skip: 11, * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 59, skip: 7, xfail: 1 * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 21, * ltp-io-tests - pass: 1, xfail: 1 * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 56, skip: 18, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 4, skip: 6, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - fail: 1, pass: 1055, skip: 157, xfail: 4 * ltp-timers-tests - pass: 8, * perf - fail: 10, pass: 45, skip: 10, * spectre-meltdown-checker-test - pass: 12, * v4l2-compliance - pass: 42, xfail: 2
qemu_i386 * kselftest - fail: 29, pass: 105, skip: 17, xfail: 58 * libhugetlbfs - pass: 87, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 33, skip: 6, xfail: 1 * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 62, skip: 5, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 20, skip: 1, * ltp-io-tests - pass: 1, xfail: 1 * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 51, skip: 23, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 10, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1124, skip: 92, xfail: 1 * ltp-timers-tests - pass: 8, * perf - fail: 9, pass: 49, skip: 10, * spectre-meltdown-checker-test - pass: 12, * v4l2-compliance - pass: 42, xfail: 2
qemu_x86_64 * kselftest - fail: 20, pass: 36, skip: 17, xfail: 34 * libhugetlbfs - pass: 90, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 34, skip: 6, * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 62, skip: 5, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 21, * ltp-io-tests - pass: 1, xfail: 1 * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 56, skip: 18, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 10, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1054, skip: 163, * ltp-timers-tests - pass: 8, * perf - fail: 7, pass: 52, skip: 10, * spectre-meltdown-checker-test - pass: 12, * v4l2-compliance - pass: 42, xfail: 2
x15 - arm * build - pass: 1, * install-android-platform-tools-r2600 - pass: 42, * kselftest - fail: 19, pass: 29, skip: 11, xfail: 34 * libhugetlbfs - pass: 87, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 30, skip: 10, * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 60, skip: 7, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 18, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 19, skip: 2, * ltp-io-tests - pass: 2, * ltp-ipc-tests - pass: 8, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 52, skip: 22, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-open-posix-tests - pass: 1693, skip: 42, xfail: 4 * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 10, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1134, skip: 80, xfail: 3 * ltp-timers-tests - pass: 8, * network-basic-tests - pass: 10, skip: 1, * perf - fail: 8, pass: 44, skip: 10, * spectre-meltdown-checker-test - pass: 10, xfail: 2 * ssuite - fail: 4, * v4l2-compliance - pass: 42, xfail: 2
x86_64 * build - pass: 1, * kselftest - fail: 20, pass: 37, skip: 17, xfail: 33 * kselftest-vsyscall-mode-native - fail: 27, pass: 38, skip: 17, xfail: 26 * kselftest-vsyscall-mode-none - fail: 27, pass: 37, skip: 17, xfail: 26 * kvm-unit-tests - pass: 43, skip: 13, * libhugetlbfs - pass: 90, skip: 1, * ltp-cap_bounds-tests - pass: 1, * ltp-commands-tests - pass: 27, skip: 14, * ltp-containers-tests - pass: 80, * ltp-cpuhotplug-tests - pass: 5, skip: 1, * ltp-cve-tests - pass: 34, skip: 6, * ltp-dio-tests - pass: 19, skip: 11, * ltp-fcntl-locktests-tests - pass: 1, * ltp-filecaps-tests - pass: 1, * ltp-fs-tests - pass: 62, skip: 5, * ltp-fs_bind-tests - pass: 1, * ltp-fs_perms_simple-tests - pass: 17, * ltp-fsx-tests - pass: 1, * ltp-hugetlb-tests - pass: 21, * ltp-io-tests - pass: 2, * ltp-ipc-tests - pass: 7, * ltp-math-tests - pass: 10, * ltp-mm-tests - pass: 55, skip: 18, xfail: 1 * ltp-nptl-tests - pass: 1, * ltp-open-posix-tests - pass: 1693, skip: 42, xfail: 4 * ltp-pty-tests - pass: 4, * ltp-sched-tests - pass: 6, skip: 4, * ltp-securebits-tests - pass: 3, * ltp-syscalls-tests - pass: 1084, skip: 132, xfail: 1 * ltp-timers-tests - pass: 8, * network-basic-tests - pass: 10, skip: 1, * perf - fail: 7, pass: 52, skip: 10, * spectre-meltdown-checker-test - fail: 4, pass: 8, * ssuite - fail: 6, * v4l2-compliance - pass: 41, xfail: 2
Hello!
I've checked all listed failures, and they were all passing on kselftests 5.1.21 and started failing as soon as we upgraded to 5.3.1.
They all passed on v4.19.75-13-g98afa0de4567 (ksft 5.1.21) and started failing on v4.19.75-27-g8ea7c3038cf9 (ksft 5.3.1). I guess it's safe to assume that the kernel is not at fault, but the failures are due to the upgrade of kselftests.
Greetings!
Daniel Díaz
Thanks Daniel - results sent as "no regressions".
On Mon, Sep 30, 2019 at 07:09:08PM -0500, Daniel Díaz wrote:
Hello!
I've checked all listed failures, and they were all passing on kselftests 5.1.21 and started failing as soon as we upgraded to 5.3.1.
They all passed on v4.19.75-13-g98afa0de4567 (ksft 5.1.21) and started failing on v4.19.75-27-g8ea7c3038cf9 (ksft 5.3.1). I guess it's safe to assume that the kernel is not at fault, but the failures are due to the upgrade of kselftests.
Greetings!
Daniel Díaz
-- Results from Linaro’s test farm. Regressions detected.
Summary
kernel: 4.19.76-rc1 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.19.y git commit: b52c75f7b9785d0d0e6bf145787ed2fc99f5483c git describe: v4.19.75-64-gb52c75f7b978 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.19-oe/build/v4.19.75-64...
Regressions (compared to build v4.19.75)
qemu_arm: kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_printf.sh
i386: kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
x15 - arm: kselftest: * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_printf.sh
juno-r2 - arm64: kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
x86_64: kselftest-vsyscall-mode-native: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
kselftest-vsyscall-mode-none: * bpf_test_dev_cgroup * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
qemu_i386: kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
qemu_arm64: kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
qemu_x86_64: kselftest: * bpf_test_dev_cgroup * bpf_test_libbpf.sh * bpf_test_tunnel.sh * lib_bitmap.sh * lib_printf.sh
Fixes (compared to build v4.19.75)
hi6220-hikey - arm64: build: * build_process
dragonboard-410c - arm64: build: * build_process
i386: build: * build_process
kselftest: * net_fib_rule_tests.sh
x15 - arm: build: * build_process
juno-r2 - arm64: build: * build_process
kvm-unit-tests: * timer
x86_64: build: * build_process
qemu_i386: kselftest: * net_fib_rule_tests.sh
Ran 20406 total tests in the following environments and test suites.
Environments
- dragonboard-410c - arm64
- hi6220-hikey - arm64
- i386
- juno-r2 - arm64
- qemu_arm
- qemu_arm64
- qemu_i386
- qemu_x86_64
- x15 - arm
- x86_64
Test Suites
- build
- kselftest
- ltp-cap_bounds-tests
- ltp-commands-tests
- ltp-containers-tests
- ltp-cpuhotplug-tests
- ltp-cve-tests
- ltp-dio-tests
- ltp-fcntl-locktests-tests
- ltp-filecaps-tests
- ltp-fs-tests
- ltp-fs_bind-tests
- ltp-fs_perms_simple-tests
- ltp-fsx-tests
- ltp-hugetlb-tests
- ltp-io-tests
- ltp-ipc-tests
- ltp-math-tests
- ltp-mm-tests
- ltp-nptl-tests
- ltp-open-posix-tests
- ltp-pty-tests
- ltp-sched-tests
- ltp-securebits-tests
- ltp-syscalls-tests
- ltp-timers-tests
- network-basic-tests
- perf
- spectre-meltdown-checker-test
- v4l2-compliance
- kvm-unit-tests
- libhugetlbfs
- install-android-platform-tools-r2600
- ssuite
- kselftest-vsyscall-mode-native
- kselftest-vsyscall-mode-none
-- Linaro LKFT https://lkft.linaro.org
On Tue, 1 Oct 2019 at 05:39, Daniel Díaz daniel.diaz@linaro.org wrote:
Hello!
I've checked all listed failures, and they were all passing on kselftests 5.1.21 and started failing as soon as we upgraded to 5.3.1.
They all passed on v4.19.75-13-g98afa0de4567 (ksft 5.1.21) and started failing on v4.19.75-27-g8ea7c3038cf9 (ksft 5.3.1). I guess it's safe to assume that the kernel is not at fault, but the failures are due to the upgrade of kselftests.
Thanks Daniel, for the failures investigation and adding summary here.
Thanks Dan, for sending reports out.
- Naresh