Re: mainline 5.0.0-rc4/4aa9fc2a435a: regressions detected in project mainline on OE

On Tue, 29 Jan 2019 at 05:32, Linaro QA qa-reports@linaro.org wrote:

Summary

kernel: 5.0.0-rc4 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git git branch: master git commit: 4aa9fc2a435abe95a1e8d7f8c7b3d6356514b37a git describe: v5.0-rc4-1-g4aa9fc2a435a Test details: https://qa-reports.linaro.org/lkft/linux-mainline-oe/build/v5.0-rc4-1-g4aa9f...

Regressions (compared to build v5.0-rc4)

hi6220-hikey - arm64: ltp-mm-tests: * mtest06

* test src: git://github.com/linux-test-project/ltp.git

x15 - arm: ltp-syscalls-tests: * readahead02

readahead02 is new failure due to test case update coming from LTP 20190115.

* test src: git://github.com/linux-test-project/ltp.git

Fixes (compared to build v5.0-rc4)

i386: ltp-syscalls-tests: * keyctl05

keyctl05 fix is coming from LTP updagrade to 20190115.

* test src: git://github.com/linux-test-project/ltp.git

juno-r2 - arm64: kselftest: * bpf_test_skb_cgroup_id.sh * proc_read

* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git

ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

qemu_arm: ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

qemu_arm64: ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

qemu_i386: ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

qemu_x86_64: ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

x15 - arm: ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

x86_64: ltp-syscalls-tests: * keyctl05

* test src: git://github.com/linux-test-project/ltp.git

Boards, architectures and test suites:

dragonboard-410c - arm64

• boot - fail: 13
• install-android-platform-tools-r2600 - pass: 26,

hi6220-hikey - arm64

• boot - pass: 13,
• install-android-platform-tools-r2600 - pass: 26,
• kselftest - pass: 16, xfail: 4, fail: 1
• libhugetlbfs - pass: 90, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-cpuhotplug-tests - pass: 4, skip: 1, xfail: 1,
• ltp-hugetlb-tests - pass: 20, skip: 1,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 56, skip: 17, xfail: 1, fail: 1
• ltp-sched-tests - pass: 6, skip: 4,
• ltp-timers-tests - pass: 12,

i386

• boot - pass: 14,
• kselftest - pass: 29, skip: 7, xfail: 12, fail: 5
• libhugetlbfs - pass: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 80,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-cve-tests - pass: 29, skip: 6, xfail: 1, fail: 2
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 59, skip: 6,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 20, skip: 1,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 49, skip: 23, xfail: 3,
• ltp-nptl-tests - pass: 1,
• ltp-open-posix-tests - pass: 1694, skip: 41, xfail: 4,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 6, skip: 4,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1110, skip: 71, xfail: 1, fail: 1
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 3, fail: 5

juno-r2 - arm64

• boot - pass: 14,
• kselftest - pass: 96, skip: 15, xfail: 24, fail: 4
• libhugetlbfs - pass: 90, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 80,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-cve-tests - pass: 27, skip: 11,
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 59, skip: 6,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 21,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 57, skip: 17, xfail: 1,
• ltp-nptl-tests - pass: 1,
• ltp-open-posix-tests - pass: 1693, skip: 42, xfail: 4,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 6, skip: 4,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1040, skip: 141, xfail: 2,
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 5, skip: 1, fail: 2

qemu_arm

• boot - pass: 5,
• ltp-cap_bounds-tests - pass: 1,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-math-tests - pass: 10,
• ltp-nptl-tests - pass: 1,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 4, skip: 6,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1070, skip: 112, fail: 1
• ltp-timers-tests - pass: 12,

qemu_arm64

• boot - pass: 13,
• kselftest - pass: 101, skip: 18, xfail: 27, fail: 5
• libhugetlbfs - pass: 90, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 80,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-cve-tests - pass: 26, skip: 12,
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 59, skip: 6,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 21,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 57, skip: 17, xfail: 1,
• ltp-nptl-tests - pass: 1,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 4, skip: 6,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1015, skip: 167, xfail: 1,
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 8,

qemu_i386

• boot - pass: 13,
• kselftest - pass: 86, skip: 13, xfail: 30, fail: 7
• libhugetlbfs - pass: 87, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 80,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-cve-tests - pass: 30, skip: 7, fail: 1
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 59, skip: 6,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 20, skip: 1,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 49, skip: 23, xfail: 3,
• ltp-nptl-tests - pass: 1,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 10,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1077, skip: 105, fail: 1
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 4, fail: 4

qemu_x86_64

• boot - pass: 13,
• kselftest - pass: 97, skip: 21, xfail: 14, fail: 5
• libhugetlbfs - pass: 90, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 80,
• ltp-cpuhotplug-tests - pass: 4, skip: 1, xfail: 1,
• ltp-cve-tests - pass: 31, skip: 7,
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 59, skip: 6,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 21,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 54, skip: 18, xfail: 3,
• ltp-nptl-tests - pass: 1,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 10,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1014, skip: 168, fail: 1
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 8,

x15 - arm

• boot - pass: 14,
• install-android-platform-tools-r2600 - pass: 28,
• kselftest - pass: 92, skip: 16, xfail: 30, fail: 7
• libhugetlbfs - pass: 87, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 79, skip: 1,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-cve-tests - pass: 27, skip: 11,
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 60, skip: 5,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 19, skip: 2,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 50, skip: 22, xfail: 3,
• ltp-nptl-tests - pass: 1,
• ltp-open-posix-tests - pass: 1694, skip: 41, xfail: 4,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 10,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1093, skip: 88, fail: 2
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 6, fail: 2

x86_64

• boot - pass: 16,
• kselftest - pass: 121, skip: 21, xfail: 15, fail: 3
• kselftest-vsyscall-mode-native - pass: 121, skip: 21, xfail: 14, fail: 6
• kselftest-vsyscall-mode-none - pass: 118, skip: 19, xfail: 13, fail: 5
• libhugetlbfs - pass: 90, skip: 1,
• ltp-cap_bounds-tests - pass: 1,
• ltp-containers-tests - pass: 80,
• ltp-cpuhotplug-tests - pass: 5, skip: 1,
• ltp-cve-tests - pass: 31, skip: 7,
• ltp-fcntl-locktests-tests - pass: 1,
• ltp-filecaps-tests - pass: 1,
• ltp-fs-tests - pass: 60, skip: 5,
• ltp-fs_bind-tests - pass: 1,
• ltp-fs_perms_simple-tests - pass: 18,
• ltp-fsx-tests - pass: 1,
• ltp-hugetlb-tests - pass: 21,
• ltp-io-tests - pass: 2,
• ltp-ipc-tests - pass: 8,
• ltp-math-tests - pass: 10,
• ltp-mm-tests - pass: 54, skip: 18, xfail: 3,
• ltp-nptl-tests - pass: 1,
• ltp-open-posix-tests - pass: 1693, skip: 42, xfail: 4,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 6, skip: 4,
• ltp-securebits-tests - pass: 3,
• ltp-syscalls-tests - pass: 1052, skip: 129, xfail: 1, fail: 1
• ltp-timers-tests - pass: 12,
• spectre-meltdown-checker-test - pass: 5, fail: 3

-- Linaro QA (BETA) https://qa-reports.linaro.org