Hi Dan,
Thanks for doing this.
On Oct 30, 2018, at 2:15 PM, Dan Rue dan.rue@linaro.org wrote:
Based on Daniel's suggestion, here's 4.18 release vs 4.19 release.
4.18 test count: Ran 16730 total tests in the following environments and test suites.
4.19: Ran 19938 total tests in the following environments and test suites.
I believe the difference in test count is due to i386 being added since 4.18.
Below is the 4.19 release report when compared to 4.18 release.
p.s. what do you all think about dropping 'test src'? I don't think it has the value that was intended.
For the Android reports we don’t even have links to src, so yes I’m all for getting rid of that, it’s noise.
So a list of environments and test suites seems good enough.
p.p.s. below report generated with 'generate_lts_report.py 5.0 --build 10501 --baseline 8685' from lkft-tools (and requires the pending pull request).
Results from Linaro’s test farm. No regressions on arm64, arm, x86_64, and i386.
Summary
kernel: 4.19.0 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git git branch: master git commit: 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d git describe: v4.19 Test details: https://qa-reports.linaro.org/lkft/linux-mainline-oe/build/v4.19
No regressions (compared to build v4.18)
Fixes (compared to build v4.18)
dragonboard-410c - arm64: kselftest:
net_pmtu.sh
test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
juno-r2 - arm64: kselftest:
net_pmtu.sh
test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_arm: kselftest:
net_pmtu.sh
test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_arm64: boot:
qemu
test src: not informed
kselftest:
net_pmtu.sh
test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_x86_64: kselftest:
net_pmtu.sh
test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
x86_64: kselftest-vsyscall-mode-native:
net_pmtu.sh
test src: not informed
kselftest-vsyscall-mode-none:
net_pmtu.sh
test src: not informed
kselftest:
net_pmtu.sh
test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
Ran 19938 total tests in the following environments and test suites.
Environments
- dragonboard-410c - arm64
- hi6220-hikey - arm64
- i386
- juno-r2 - arm64
- qemu_arm
- qemu_arm64
- qemu_i386
- qemu_x86_64
- x15 - arm
- x86_64
Test Suites
- boot
- kselftest
- libhugetlbfs
- ltp-cap_bounds-tests
- ltp-containers-tests
- ltp-cve-tests
- ltp-fcntl-locktests-tests
- ltp-filecaps-tests
- ltp-fs-tests
- ltp-fs_bind-tests
- ltp-fs_perms_simple-tests
- ltp-fsx-tests
- ltp-hugetlb-tests
- ltp-io-tests
- ltp-ipc-tests
- ltp-math-tests
- ltp-nptl-tests
- ltp-pty-tests
- ltp-sched-tests
- ltp-securebits-tests
- ltp-syscalls-tests
- ltp-timers-tests
- ltp-open-posix-tests
- kselftest-vsyscall-mode-native
- kselftest-vsyscall-mode-none
-- Linaro LKFT https://lkft.linaro.org