Hi Dan,

On 13 December 2017 at 08:07, Dan Rue dan.rue@linaro.org wrote:

I believe these results are complete. We had some build problems and ended up building and submitting most jobs twice.

On Tue, Dec 12, 2017 at 11:47:35PM +0000, Linaro QA wrote:

...

Summary

kernel: 4.9.69-rc1 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.9.y git commit: ae5cfc67087cf771ca5d1ba4da22f6ddcd960426 git describe: v4.9.68-149-gae5cfc67087c Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/build/v4.9.68-149-...

Regressions (compared to build v4.9.68-50-gb06970f8c916)

x86_64: kselftest: * reuseport_bpf

This seems to be NOT a kernel failures. Not blocker for this stable-rc. Test case bug or the execution procedure might be wrong or x86 setup etc. However we will investigate that reason in detail and in parallel i will check with test author.

The independent test execution results as reuseport_bpf PASS on 4.15.0-rc3+, 4.14.6-rc1+ and LTS-4.9.69-rc1+.

Test output: ------------ cd /opt/kselftests/mainline/net ./reuseport_bpf ---- IPv4 UDP ---- Testing EBPF mod 10... <snippet> SUCCESS reuseport_bpf:PASS

Detailed test log on 4.15.0-rc3+, https://lkft.validation.linaro.org/scheduler/job/76122#L979

Detailed test log on 4.14.6-rc1+ https://lkft.validation.linaro.org/scheduler/job/76119#L977

Detailed test log on LTS-4.9.69-rc1+. https://lkft.validation.linaro.org/scheduler/job/76117#L962

This looks like a legitimate issue worth reporting, but it looks a little inconsistent. It failed on v4.9.68 (but not the rc), and now it is failing on 4.9.69-rc. It has been failing consistently on mainline since November 21st.

There is a commit in this RC that is bpf related, but I don't think it is to blame because it was passing on mainline with this commit, and 4.9.68 passed without the commit.

5b9f0538ad08 - bpf: fix lockdep splat (13 hours ago) <Eric Dumazet>

Here's the history of the test on mainline: https://qa-reports.linaro.org/lkft/linux-mainline-oe/tests/kselftest/reusepo... Here's the history of the test on 4.9-rc: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/tests/kselftest/re... Here's the history of the test on 4.9: https://qa-reports.linaro.org/lkft/linux-stable-4.9-oe/tests/kselftest/reuse... bug report: https://bugs.linaro.org/show_bug.cgi?id=3502

I suggest we report this to the test author and add it to the skiplist.

Add it to skip list for x86.

...

* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.14.tar.xz

Boards, architectures and test suites:

hi6220-hikey - arm64

• boot - pass: 20,
• kselftest - pass: 40, skip: 23
• libhugetlbfs - pass: 90, skip: 1
• ltp-cap_bounds-tests - pass: 2,
• ltp-containers-tests - pass: 64,
• ltp-fcntl-locktests-tests - pass: 2,
• ltp-filecaps-tests - pass: 2,
• ltp-fs-tests - pass: 60,
• ltp-fs_bind-tests - pass: 2,
• ltp-fs_perms_simple-tests - pass: 19,
• ltp-fsx-tests - pass: 2,
• ltp-hugetlb-tests - pass: 21, skip: 1
• ltp-io-tests - pass: 3,
• ltp-ipc-tests - pass: 9,
• ltp-math-tests - pass: 11,
• ltp-nptl-tests - pass: 2,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 14,
• ltp-securebits-tests - pass: 4,
• ltp-syscalls-tests - pass: 983, skip: 121
• ltp-timers-tests - pass: 12,

juno-r2 - arm64

• boot - pass: 20,
• kselftest - pass: 40, skip: 23
• libhugetlbfs - pass: 90, skip: 1
• ltp-cap_bounds-tests - pass: 2,
• ltp-containers-tests - pass: 64,
• ltp-fcntl-locktests-tests - pass: 2,
• ltp-filecaps-tests - pass: 2,
• ltp-fs-tests - pass: 60,
• ltp-fs_bind-tests - pass: 2,
• ltp-fs_perms_simple-tests - pass: 19,
• ltp-fsx-tests - pass: 2,
• ltp-hugetlb-tests - pass: 22,
• ltp-io-tests - pass: 3,
• ltp-ipc-tests - pass: 9,
• ltp-math-tests - pass: 11,
• ltp-nptl-tests - pass: 2,
• ltp-pty-tests - pass: 4,
• ltp-sched-tests - pass: 14,
• ltp-securebits-tests - pass: 4,
• ltp-syscalls-tests - pass: 985, skip: 121
• ltp-timers-tests - pass: 12,

x15 - arm

• boot - pass: 40,
• kselftest - pass: 74, skip: 50
• libhugetlbfs - pass: 174, skip: 2
• ltp-cap_bounds-tests - pass: 4,
• ltp-containers-tests - pass: 128,
• ltp-fcntl-locktests-tests - pass: 4,
• ltp-filecaps-tests - pass: 4,
• ltp-fs-tests - pass: 120,
• ltp-fs_bind-tests - pass: 4,
• ltp-fs_perms_simple-tests - pass: 38,
• ltp-fsx-tests - pass: 4,
• ltp-hugetlb-tests - pass: 40, skip: 4
• ltp-io-tests - pass: 6,
• ltp-ipc-tests - pass: 18,
• ltp-math-tests - pass: 22,
• ltp-nptl-tests - pass: 4,
• ltp-pty-tests - pass: 8,
• ltp-sched-tests - pass: 26, skip: 2
• ltp-securebits-tests - pass: 8,
• ltp-syscalls-tests - pass: 2072, skip: 132
• ltp-timers-tests - pass: 24,

x86_64

• boot - pass: 40,
• kselftest - fail: 2, pass: 107, skip: 45
• libhugetlbfs - pass: 180, skip: 2
• ltp-cap_bounds-tests - pass: 2,
• ltp-containers-tests - pass: 127,
• ltp-fcntl-locktests-tests - pass: 4,
• ltp-filecaps-tests - pass: 4,
• ltp-fs-tests - pass: 122,
• ltp-fs_bind-tests - pass: 4,
• ltp-fs_perms_simple-tests - pass: 38,
• ltp-fsx-tests - pass: 3,
• ltp-hugetlb-tests - pass: 43,
• ltp-io-tests - pass: 6,
• ltp-ipc-tests - pass: 18,
• ltp-math-tests - pass: 22,
• ltp-nptl-tests - pass: 4,
• ltp-pty-tests - pass: 7,
• ltp-sched-tests - pass: 18, skip: 2
• ltp-securebits-tests - pass: 7,
• ltp-syscalls-tests - pass: 1914, skip: 326

Most of the jobs are re-submitted and the count is doubled in all cases. For example Wrong one: * ltp-syscalls-tests - pass: 1914, skip: 326 Right one: * ltp-syscalls-tests - pass: 957 , skip: 163

- Naresh

...

• ltp-timers-tests - pass: 24,

Documentation - https://collaborate.linaro.org/display/LKFT/Email+Reports

-- Linaro QA (beta) https://qa-reports.linaro.org _______________________________________________ Lkft-triage mailing list Lkft-triage@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lkft-triage

---

Lkft-triage mailing list Lkft-triage@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lkft-triage