Summary ------------------------------------------------------------------------
kernel: 4.9.58 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.9.y git commit: 4d4a6a3f8a12602ce8dc800123715fe7b5c1c3a1 git describe: v4.9.58 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/build/v4.9.58
Regressions (compared to build v4.9.57-52-gf7dffe80de67) ------------------------------------------------------------------------
dell-poweredge-r200 - x86_64: ltp-syscalls-tests: * perf_event_open02
* test src: git://github.com/linux-test-project/ltp.git
x15 - arm: ltp-syscalls-tests: * fcntl36
* test src: git://github.com/linux-test-project/ltp.git
Boards, architectures and test suites: -------------------------------------
hi6220-hikey - arm64 * boot - pass: 20 * kselftest - skip: 7, fail: 6, pass: 32 * libhugetlbfs - skip: 1, pass: 90 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - fail: 2, pass: 79 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - fail: 2, pass: 59 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - skip: 1, pass: 21 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - pass: 14 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 122, pass: 986 * ltp-timers-tests - pass: 13
juno-r2 - arm64 * boot - pass: 20 * kselftest - skip: 6, fail: 7, pass: 37 * libhugetlbfs - skip: 1, pass: 90 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - fail: 2, pass: 79 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - fail: 2, pass: 59 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - pass: 10 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 156, fail: 2, pass: 943 * ltp-timers-tests - pass: 13
x15 - arm * boot - pass: 20 * kselftest - skip: 1, fail: 16, pass: 36 * libhugetlbfs - skip: 1, * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - fail: 18, pass: 63 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - pass: 60 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 2 * ltp-hugetlb-tests - fail: 22, * ltp-io-tests - pass: 3 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 2 * ltp-pty-tests - pass: 4 * ltp-sched-tests - skip: 1, pass: 13 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 67, fail: 2, pass: 1039 * ltp-timers-tests - pass: 13
dell-poweredge-r200 - x86_64 * boot - pass: 20 * kselftest - fail: 15, pass: 52 * libhugetlbfs - skip: 1, pass: 76 * ltp-cap_bounds-tests - pass: 2 * ltp-containers-tests - fail: 18, pass: 63 * ltp-fcntl-locktests-tests - pass: 2 * ltp-filecaps-tests - pass: 2 * ltp-fs-tests - skip: 1, pass: 61 * ltp-fs_bind-tests - pass: 2 * ltp-fs_perms_simple-tests - pass: 19 * ltp-fsx-tests - pass: 1 * ltp-hugetlb-tests - pass: 22 * ltp-io-tests - pass: 2 * ltp-ipc-tests - pass: 9 * ltp-math-tests - pass: 11 * ltp-nptl-tests - pass: 1 * ltp-pty-tests - pass: 4 * ltp-securebits-tests - pass: 4 * ltp-syscalls-tests - skip: 163, fail: 12, pass: 962 * ltp-timers-tests - pass: 13
Documentation - https://collaborate.linaro.org/display/LKFT/Email+Reports
On 24 October 2017 at 08:14, Linaro QA qa-reports@linaro.org wrote:
Summary
kernel: 4.9.58 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.9.y git commit: 4d4a6a3f8a12602ce8dc800123715fe7b5c1c3a1 git describe: v4.9.58 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/build/v4.9.58
Regressions (compared to build v4.9.57-52-gf7dffe80de67)
dell-poweredge-r200 - x86_64: ltp-syscalls-tests: * perf_event_open02
* test src: git://github.com/linux-test-project/ltp.git
It's the first time this test failed ever. Here is the log:
perf_event_open02 0 TINFO : overall task clock: 42794146 perf_event_open02 0 TINFO : hw sum: 903650031, task clock sum: 128422221 perf_event_open02 0 TINFO : ratio: 3.000930 perf_event_open02 1 TFAIL : perf_event_open02.c:333: test failed (ratio was greater than )
Source here: https://github.com/linux-test-project/ltp/blob/20170929/testcases/kernel/sys...
milosz
x15 - arm: ltp-syscalls-tests: * fcntl36
* test src: git://github.com/linux-test-project/ltp.gitBoards, architectures and test suites:
hi6220-hikey - arm64
- boot - pass: 20
- kselftest - skip: 7, fail: 6, pass: 32
- libhugetlbfs - skip: 1, pass: 90
- ltp-cap_bounds-tests - pass: 2
- ltp-containers-tests - fail: 2, pass: 79
- ltp-fcntl-locktests-tests - pass: 2
- ltp-filecaps-tests - pass: 2
- ltp-fs-tests - fail: 2, pass: 59
- ltp-fs_bind-tests - pass: 2
- ltp-fs_perms_simple-tests - pass: 19
- ltp-fsx-tests - pass: 2
- ltp-hugetlb-tests - skip: 1, pass: 21
- ltp-io-tests - pass: 3
- ltp-ipc-tests - pass: 9
- ltp-math-tests - pass: 11
- ltp-nptl-tests - pass: 2
- ltp-pty-tests - pass: 4
- ltp-sched-tests - pass: 14
- ltp-securebits-tests - pass: 4
- ltp-syscalls-tests - skip: 122, pass: 986
- ltp-timers-tests - pass: 13
juno-r2 - arm64
- boot - pass: 20
- kselftest - skip: 6, fail: 7, pass: 37
- libhugetlbfs - skip: 1, pass: 90
- ltp-cap_bounds-tests - pass: 2
- ltp-containers-tests - fail: 2, pass: 79
- ltp-fcntl-locktests-tests - pass: 2
- ltp-filecaps-tests - pass: 2
- ltp-fs-tests - fail: 2, pass: 59
- ltp-fs_bind-tests - pass: 2
- ltp-fs_perms_simple-tests - pass: 19
- ltp-fsx-tests - pass: 2
- ltp-hugetlb-tests - pass: 22
- ltp-io-tests - pass: 3
- ltp-ipc-tests - pass: 9
- ltp-math-tests - pass: 11
- ltp-nptl-tests - pass: 2
- ltp-pty-tests - pass: 4
- ltp-sched-tests - pass: 10
- ltp-securebits-tests - pass: 4
- ltp-syscalls-tests - skip: 156, fail: 2, pass: 943
- ltp-timers-tests - pass: 13
x15 - arm
- boot - pass: 20
- kselftest - skip: 1, fail: 16, pass: 36
- libhugetlbfs - skip: 1,
- ltp-cap_bounds-tests - pass: 2
- ltp-containers-tests - fail: 18, pass: 63
- ltp-fcntl-locktests-tests - pass: 2
- ltp-filecaps-tests - pass: 2
- ltp-fs-tests - pass: 60
- ltp-fs_bind-tests - pass: 2
- ltp-fs_perms_simple-tests - pass: 19
- ltp-fsx-tests - pass: 2
- ltp-hugetlb-tests - fail: 22,
- ltp-io-tests - pass: 3
- ltp-ipc-tests - pass: 9
- ltp-math-tests - pass: 11
- ltp-nptl-tests - pass: 2
- ltp-pty-tests - pass: 4
- ltp-sched-tests - skip: 1, pass: 13
- ltp-securebits-tests - pass: 4
- ltp-syscalls-tests - skip: 67, fail: 2, pass: 1039
- ltp-timers-tests - pass: 13
dell-poweredge-r200 - x86_64
- boot - pass: 20
- kselftest - fail: 15, pass: 52
- libhugetlbfs - skip: 1, pass: 76
- ltp-cap_bounds-tests - pass: 2
- ltp-containers-tests - fail: 18, pass: 63
- ltp-fcntl-locktests-tests - pass: 2
- ltp-filecaps-tests - pass: 2
- ltp-fs-tests - skip: 1, pass: 61
- ltp-fs_bind-tests - pass: 2
- ltp-fs_perms_simple-tests - pass: 19
- ltp-fsx-tests - pass: 1
- ltp-hugetlb-tests - pass: 22
- ltp-io-tests - pass: 2
- ltp-ipc-tests - pass: 9
- ltp-math-tests - pass: 11
- ltp-nptl-tests - pass: 1
- ltp-pty-tests - pass: 4
- ltp-securebits-tests - pass: 4
- ltp-syscalls-tests - skip: 163, fail: 12, pass: 962
- ltp-timers-tests - pass: 13
Documentation - https://collaborate.linaro.org/display/LKFT/Email+Reports
-- Linaro QA (beta) https://qa-reports.linaro.org
On Tue, Oct 24, 2017 at 08:18:48AM +0100, Milosz Wasilewski wrote:
On 24 October 2017 at 08:14, Linaro QA qa-reports@linaro.org wrote:
Summary
kernel: 4.9.58 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.9.y git commit: 4d4a6a3f8a12602ce8dc800123715fe7b5c1c3a1 git describe: v4.9.58 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/build/v4.9.58
Regressions (compared to build v4.9.57-52-gf7dffe80de67)
dell-poweredge-r200 - x86_64: ltp-syscalls-tests: * perf_event_open02
* test src: git://github.com/linux-test-project/ltp.gitIt's the first time this test failed ever. Here is the log:
perf_event_open02 0 TINFO : overall task clock: 42794146 perf_event_open02 0 TINFO : hw sum: 903650031, task clock sum: 128422221 perf_event_open02 0 TINFO : ratio: 3.000930 perf_event_open02 1 TFAIL : perf_event_open02.c:333: test failed (ratio was greater than )
Source here: https://github.com/linux-test-project/ltp/blob/20170929/testcases/kernel/sys...
So what does this mean? Did a patch in this release break something? If so, what patch, and why isn't it showing up in 4.13 stable and 4.14-rc?
thanks,
greg k-h
On Oct 25, 2017, at 5:31 AM, Greg KH gregkh@google.com wrote:
On Tue, Oct 24, 2017 at 08:18:48AM +0100, Milosz Wasilewski wrote:
On 24 October 2017 at 08:14, Linaro QA qa-reports@linaro.org wrote:
Summary
kernel: 4.9.58 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git git branch: linux-4.9.y git commit: 4d4a6a3f8a12602ce8dc800123715fe7b5c1c3a1 git describe: v4.9.58 Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/build/v4.9.58
Regressions (compared to build v4.9.57-52-gf7dffe80de67)
dell-poweredge-r200 - x86_64: ltp-syscalls-tests:
perf_event_open02
test src: git://github.com/linux-test-project/ltp.git
It's the first time this test failed ever. Here is the log:
perf_event_open02 0 TINFO : overall task clock: 42794146 perf_event_open02 0 TINFO : hw sum: 903650031, task clock sum: 128422221 perf_event_open02 0 TINFO : ratio: 3.000930 perf_event_open02 1 TFAIL : perf_event_open02.c:333: test failed (ratio was greater than )
Source here: https://github.com/linux-test-project/ltp/blob/20170929/testcases/kernel/sys...
So what does this mean? Did a patch in this release break something? If so, what patch, and why isn't it showing up in 4.13 stable and 4.14-rc?
Looking at mainline historical data (which includes 4.13 if you scroll down far enough) : https://qa-reports.linaro.org/lkft/linux-mainline-oe/tests/ltp-syscalls-test...
Seems this one occasionally fails.
Looking at 4.9 : https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/tests/ltp-syscalls...
Only one failure in the history recorded thus far.
In summary I don’t think we’re looking at a regression. I do think we’re looking at something worth a deeper look tho especially given it’s failing across architectures. How reproducible that might be… that’ll be the fun part.
thanks,
greg k-h _______________________________________________ Lts-dev mailing list Lts-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lts-dev
On Wed, Oct 25, 2017 at 9:05 PM, Tom Gall tom.gall@linaro.org wrote:
On Oct 25, 2017, at 5:31 AM, Greg KH gregkh@google.com wrote:
On Tue, Oct 24, 2017 at 08:18:48AM +0100, Milosz Wasilewski wrote:
On 24 October 2017 at 08:14, Linaro QA qa-reports@linaro.org wrote:
\
It's the first time this test failed ever. Here is the log:
perf_event_open02 0 TINFO : overall task clock: 42794146 perf_event_open02 0 TINFO : hw sum: 903650031, task clock sum: 128422221 perf_event_open02 0 TINFO : ratio: 3.000930 perf_event_open02 1 TFAIL : perf_event_open02.c:333: test failed (ratio was greater than )
Source here: https://github.com/linux-test-project/ltp/blob/20170929/testcases/kernel/sys...
So what does this mean? Did a patch in this release break something? If so, what patch, and why isn't it showing up in 4.13 stable and 4.14-rc?
Looking at mainline historical data (which includes 4.13 if you scroll down far enough) : https://qa-reports.linaro.org/lkft/linux-mainline-oe/tests/ltp-syscalls-test...
Seems this one occasionally fails.
Looking at 4.9 : https://qa-reports.linaro.org/lkft/linux-stable-rc-4.9-oe/tests/ltp-syscalls...
Only one failure in the history recorded thus far.
In summary I don’t think we’re looking at a regression. I do think we’re looking at something worth a deeper look tho especially given it’s failing across architectures. How reproducible that might be… that’ll be the fun part.
I looked at the source code and we are not hitting the failure that this is testing for, as that should be 100% reproducible. The test tries to see if the time measured by the performance counters matches the time as observed by the task timers.
The ratio reported above is 3.000930, the successful case would be 'n', while the failure would be 'n + 4', where 'n' is the number of performance counter registers in the CPU (which I don't know for hikey). We report failure for anything larger than 'n + 0.0001', so presumably is n is '3' here and we differ from that by 0.00093, which is significantly outside of the expected range.
This could be the result of
a) hardware specifics in the performance counters, b) problems in the scheduler (e.g. with EAS) c) problems with the timekeeping d) statistical inaccuracies e) fundamental problems with the test case
It would be helpful to run the perf_event_open02 test in verbose mode in a loop to get a little more statistical information (maximum, average, standard deviation) for that ratio number to figure out whether we need to look for an actual bug in one of the above areas or should just change the test case to allow a somewhat wider margin of error. This is probably a low priority compared to other failures we saw, so we could also ignore the result for now.
Arnd
-
Arnd Bergmann -
Greg KH -
Linaro QA -
Milosz Wasilewski -
Tom Gall