kselftest rtnetlink.sh test case failure is not a regression on 4.16, 4.14 and 4.9 builds. Because it used to skip due to missing tc tool.

Now the ''tc' tool added to Open Embedded build and test running and reported failed. This is not a regression.

Old output ============ SKIP: Could not run test without the tc tool selftests: rtnetlink.sh [PASS] https://lkft.validation.linaro.org/scheduler/job/225015#L2255

New output ============= RTNETLINK answers: Operation not supported Cannot find device "test-dummy0" FAIL: cannot add dummy interface selftests: rtnetlink.sh [FAIL] https://lkft.validation.linaro.org/scheduler/job/226352#L3375

- Naresh

On 22 May 2018 at 13:14, Naresh Kamboju naresh.kamboju@linaro.org wrote:

kselftest rtnetlink.sh test case failed on all device. This test case use to PASS on all devices. https://qa-reports.linaro.org/lkft/linux-stable-rc-4.16-oe/tests/kselftest/r...

• Naresh

On 22 May 2018 at 08:50, Linaro QA qa-reports@linaro.org wrote:

...

Summary

kernel: 4.16.11-rc1 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.16.y git commit: 663daea64d0bbd800ae507d08f35706d169c6883 git describe: v4.16.10-111-g663daea64d0b Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.16-oe/build/v4.16.10-11...

Regressions (compared to build v4.16.10-62-g473d9b275b2a)

dragonboard-410c - arm64: kselftest: * rtnetlink.sh

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.16.tar.xz

juno-r2 - arm64: kselftest: * rtnetlink.sh

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.16.tar.xz

qemu_arm: kselftest: * rtnetlink.sh

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.16.tar.xz

ltp-syscalls-tests: * fcntl36

* test src: git://github.com/linux-test-project/ltp.git

qemu_x86_64: kselftest: * rtnetlink.sh

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.16.tar.xz

x15 - arm: kselftest: * rtnetlink.sh

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.16.tar.xz

x86_64: kselftest-vsyscall-mode-native: * rtnetlink.sh

* test src: not informed

kselftest-vsyscall-mode-none: * rtnetlink.sh

* test src: not informed

kselftest: * rtnetlink.sh

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.16.tar.xz

Boards, architectures and test suites:

dragonboard-410c - arm64

• boot - fail: 5, pass: 15
• kselftest - fail: 2, skip: 26, pass: 40
• libhugetlbfs - skip: 1, pass: 90
• ltp-cap_bounds-tests - pass: 2
• ltp-containers-tests - skip: 17, pass: 64
• ltp-fcntl-locktests-tests - pass: 2
• ltp-filecaps-tests - pass: 2
• ltp-fsx-tests - pass: 2
• ltp-hugetlb-tests - skip: 1, pass: 21
• ltp-ipc-tests - pass: 9
• ltp-math-tests - pass: 11
• ltp-nptl-tests - pass: 2
• ltp-pty-tests - pass: 4
• ltp-sched-tests - pass: 14
• ltp-securebits-tests - pass: 4
• ltp-timers-tests - pass: 13

juno-r2 - arm64

• boot - pass: 20
• kselftest - fail: 1, skip: 24, pass: 43
• libhugetlbfs - skip: 1, pass: 90
• ltp-cap_bounds-tests - pass: 2
• ltp-containers-tests - skip: 17, pass: 64
• ltp-fcntl-locktests-tests - pass: 2
• ltp-filecaps-tests - pass: 2
• ltp-fs-tests - skip: 6, pass: 57
• ltp-fs_bind-tests - pass: 2
• ltp-fs_perms_simple-tests - pass: 19
• ltp-fsx-tests - pass: 2
• ltp-hugetlb-tests - pass: 22
• ltp-io-tests - pass: 3
• ltp-ipc-tests - pass: 9
• ltp-math-tests - pass: 11
• ltp-nptl-tests - pass: 2
• ltp-pty-tests - pass: 4
• ltp-sched-tests - skip: 4, pass: 10
• ltp-securebits-tests - pass: 4
• ltp-syscalls-tests - skip: 133, pass: 1017
• ltp-timers-tests - pass: 13

qemu_arm

• boot - pass: 20
• kselftest - fail: 1, skip: 31, pass: 36
• libhugetlbfs - pass: 1
• ltp-cap_bounds-tests - pass: 2
• ltp-containers-tests - skip: 18, pass: 63
• ltp-fcntl-locktests-tests - pass: 2
• ltp-filecaps-tests - pass: 2
• ltp-fs-tests - skip: 5, pass: 58
• ltp-fs_bind-tests - pass: 2
• ltp-fs_perms_simple-tests - pass: 19
• ltp-fsx-tests - pass: 2
• ltp-hugetlb-tests - skip: 1, pass: 21
• ltp-io-tests - pass: 3
• ltp-ipc-tests - pass: 9
• ltp-math-tests - pass: 11
• ltp-nptl-tests - pass: 2
• ltp-pty-tests - pass: 4
• ltp-sched-tests - skip: 7, pass: 7
• ltp-securebits-tests - pass: 4
• ltp-syscalls-tests - fail: 4, skip: 92, pass: 1054
• ltp-timers-tests - pass: 13

qemu_x86_64

• boot - pass: 20
• kselftest - fail: 1, skip: 29, pass: 52
• libhugetlbfs - skip: 1, pass: 90
• ltp-cap_bounds-tests - pass: 2
• ltp-containers-tests - skip: 17, pass: 64
• ltp-fcntl-locktests-tests - pass: 2
• ltp-filecaps-tests - pass: 2
• ltp-fs-tests - skip: 6, pass: 57
• ltp-fs_bind-tests - pass: 2
• ltp-fs_perms_simple-tests - pass: 19
• ltp-fsx-tests - pass: 2
• ltp-hugetlb-tests - pass: 22
• ltp-io-tests - pass: 3
• ltp-ipc-tests - pass: 9
• ltp-math-tests - pass: 11
• ltp-nptl-tests - pass: 2
• ltp-pty-tests - pass: 4
• ltp-sched-tests - skip: 1, pass: 13
• ltp-securebits-tests - pass: 4
• ltp-syscalls-tests - skip: 153, pass: 997
• ltp-timers-tests - pass: 13

x15 - arm

• boot - pass: 20
• kselftest - fail: 1, skip: 28, pass: 38
• libhugetlbfs - skip: 1, pass: 87
• ltp-cap_bounds-tests - pass: 2
• ltp-containers-tests - skip: 18, pass: 63
• ltp-fcntl-locktests-tests - pass: 2
• ltp-filecaps-tests - pass: 2
• ltp-fs-tests - skip: 5, pass: 58
• ltp-fs_bind-tests - pass: 2
• ltp-fs_perms_simple-tests - pass: 19
• ltp-fsx-tests - pass: 2
• ltp-hugetlb-tests - skip: 2, pass: 20
• ltp-io-tests - pass: 3
• ltp-ipc-tests - pass: 9
• ltp-math-tests - pass: 11
• ltp-nptl-tests - pass: 2
• ltp-pty-tests - pass: 4
• ltp-sched-tests - skip: 1, pass: 13
• ltp-securebits-tests - pass: 4
• ltp-syscalls-tests - skip: 75, pass: 1075
• ltp-timers-tests - pass: 13

x86_64

• boot - pass: 22
• kselftest - fail: 1, skip: 21, pass: 52
• kselftest-vsyscall-mode-native - fail: 1, skip: 20, pass: 52
• kselftest-vsyscall-mode-none - fail: 1, skip: 20, pass: 53
• libhugetlbfs - skip: 1, pass: 90
• ltp-cap_bounds-tests - pass: 2
• ltp-containers-tests - skip: 17, pass: 64
• ltp-fcntl-locktests-tests - pass: 2
• ltp-filecaps-tests - pass: 2
• ltp-fs-tests - skip: 5, pass: 58
• ltp-fs_bind-tests - pass: 2
• ltp-fs_perms_simple-tests - pass: 19
• ltp-fsx-tests - pass: 2
• ltp-hugetlb-tests - pass: 22
• ltp-io-tests - pass: 3
• ltp-ipc-tests - pass: 9
• ltp-math-tests - pass: 11
• ltp-nptl-tests - pass: 2
• ltp-pty-tests - pass: 4
• ltp-sched-tests - skip: 5, pass: 9
• ltp-securebits-tests - pass: 4
• ltp-syscalls-tests - skip: 116, pass: 1034
• ltp-timers-tests - pass: 13

-- Linaro QA (BETA) https://qa-reports.linaro.org _______________________________________________ Lkft-triage mailing list Lkft-triage@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lkft-triage