Summary ------------------------------------------------------------------------
kernel: 4.4.96 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git git branch: linux-4.4.y git commit: 27e68f1bca91a7f69808c8641f03c66cca2bb365 git describe: v4.4.96 Test details: https://qa-reports.linaro.org/lkft/linux-stable-4.4-oe/build/v4.4.96
Regressions (compared to build v4.4.95) ------------------------------------------------------------------------
juno-r2 - arm64: ltp-timers-tests: * leapsec_timer * runltp_timers
* test src: git://github.com/linux-test-project/ltp.git
x15 - arm: kselftest: * rtctest
* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.13.tar.xz ltp-syscalls-tests: * getrandom02 * perf_event_open02
* test src: git://github.com/linux-test-project/ltp.git
Boards, architectures and test suites: -------------------------------------
juno-r2 - arm64 * boot - pass: 20 * kselftest - fail: 14, skip: 7, pass: 32 * libhugetlbfs - skip: 1, pass: 90 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - fail: 13, skip: 36, pass: 27 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - pass: 60 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - pass: 10 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - fail: 3, skip: 159, pass: 938 * ltp-timers-tests - fail: 2, pass: 11
x15 - arm * boot - pass: 20 * kselftest - fail: 13, skip: 11, pass: 29 * libhugetlbfs - skip: 1, * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - pass: 64 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - pass: 60 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - fail: 22, * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - skip: 1, pass: 13 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - fail: 5, skip: 68, pass: 1034 * ltp-timers-tests - pass: 12
dell-poweredge-r200 - x86_64 * boot - pass: 20 * kselftest - fail: 16, skip: 8, pass: 44 * libhugetlbfs - skip: 1, pass: 76 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - pass: 64 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 1, pass: 61 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - skip: 1, pass: 9 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - fail: 3, skip: 164, pass: 959 * ltp-timers-tests - pass: 13
Documentation - https://collaborate.linaro.org/display/LKFT/Email+Reports
On Thu, Nov 02, 2017 at 12:54:55PM +0000, Linaro QA wrote:
Summary
kernel: 4.4.96 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git git branch: linux-4.4.y git commit: 27e68f1bca91a7f69808c8641f03c66cca2bb365 git describe: v4.4.96 Test details: https://qa-reports.linaro.org/lkft/linux-stable-4.4-oe/build/v4.4.96
Regressions (compared to build v4.4.95)
Is this real?
On 2 November 2017 at 18:19, Greg KH gregkh@google.com wrote:
On Thu, Nov 02, 2017 at 12:54:55PM +0000, Linaro QA wrote:
Summary
kernel: 4.4.96 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git git branch: linux-4.4.y git commit: 27e68f1bca91a7f69808c8641f03c66cca2bb365 git describe: v4.4.96 Test details: https://qa-reports.linaro.org/lkft/linux-stable-4.4-oe/build/v4.4.96
Regressions (compared to build v4.4.95)
Is this real?
On the first look they're nothing to worry about. All look like timing issue due to poorer than expected performance. On the other hand, they didn't show up before (getrandom02, perf_event_open02). I know Naresh did some research on getrandom02 and it doesn't fail always: https://bugs.linaro.org/show_bug.cgi?id=3401#c1. I suspect it's the same for other x15 cases.
The leapsec_timer case is most likely the setup issue - some other process than the test updates the clock.
milosz
Hi Greg,
On Thu, Nov 02, 2017 at 07:19:39PM +0100, Greg KH wrote:
On Thu, Nov 02, 2017 at 12:54:55PM +0000, Linaro QA wrote:
Summary
kernel: 4.4.96 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git git branch: linux-4.4.y git commit: 27e68f1bca91a7f69808c8641f03c66cca2bb365 git describe: v4.4.96 Test details: https://qa-reports.linaro.org/lkft/linux-stable-4.4-oe/build/v4.4.96
Regressions (compared to build v4.4.95)
Is this real?
You snipped too much :)
(combining 4.4 and 4.9 emails: )
Regressions (compared to build v4.4.95)
juno-r2 - arm64: ltp-timers-tests: * leapsec_timer * runltp_timers
* test src: git://github.com/linux-test-project/ltp.git
x15 - arm: kselftest: * rtctest
* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.13.tar.xz
ltp-syscalls-tests: * getrandom02 * perf_event_open02
* test src: git://github.com/linux-test-project/ltp.git
Regressions (compared to build v4.9.58)
hi6220-hikey - arm64: kselftest: * rtctest
* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.13.tar.xz
juno-r2 - arm64: kselftest: * raw_skew
* test src: https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.13.tar.xz
ltp-timers-tests: * leapsec_timer * runltp_timers
* test src: git://github.com/linux-test-project/ltp.git
These are all timing-related tests that fail periodically. We are still investigating their root causes and then they will be added to the skip list or fixed.
Adding Sumit, Yongqin, Naresh - Is there any evidence in any of these tests that we have an actual kernel problem, rather than a test/timing problem? - leapsec_timer: https://bugs.linaro.org/show_bug.cgi?id=3335 - rtctest: https://bugs.linaro.org/show_bug.cgi?id=3402 - raw_skew: https://bugs.linaro.org/show_bug.cgi?id=3376 - getrandom02: https://bugs.linaro.org/show_bug.cgi?id=3401
Thanks, Dan