Based on Daniel's suggestion, here's 4.18 release vs 4.19 release.
4.18 test count: Ran 16730 total tests in the following environments and test suites.
4.19: Ran 19938 total tests in the following environments and test suites.
I believe the difference in test count is due to i386 being added since 4.18.
Below is the 4.19 release report when compared to 4.18 release.
p.s. what do you all think about dropping 'test src'? I don't think it has the value that was intended.
p.p.s. below report generated with 'generate_lts_report.py 5.0 --build 10501 --baseline 8685' from lkft-tools (and requires the pending pull request).
Results from Linaro’s test farm. No regressions on arm64, arm, x86_64, and i386.
Summary ------------------------------------------------------------------------
kernel: 4.19.0 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git git branch: master git commit: 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d git describe: v4.19 Test details: https://qa-reports.linaro.org/lkft/linux-mainline-oe/build/v4.19
No regressions (compared to build v4.18)
Fixes (compared to build v4.18) ------------------------------------------------------------------------
dragonboard-410c - arm64: kselftest: * net_pmtu.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
juno-r2 - arm64: kselftest: * net_pmtu.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_arm: kselftest: * net_pmtu.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_arm64: boot: * qemu
* test src: not informed kselftest: * net_pmtu.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
qemu_x86_64: kselftest: * net_pmtu.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
x86_64: kselftest-vsyscall-mode-native: * net_pmtu.sh
* test src: not informed kselftest-vsyscall-mode-none: * net_pmtu.sh
* test src: not informed kselftest: * net_pmtu.sh
* test src: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
Ran 19938 total tests in the following environments and test suites.
Environments -------------- - dragonboard-410c - arm64 - hi6220-hikey - arm64 - i386 - juno-r2 - arm64 - qemu_arm - qemu_arm64 - qemu_i386 - qemu_x86_64 - x15 - arm - x86_64
Test Suites ----------- * boot * kselftest * libhugetlbfs * ltp-cap_bounds-tests * ltp-containers-tests * ltp-cve-tests * ltp-fcntl-locktests-tests * ltp-filecaps-tests * ltp-fs-tests * ltp-fs_bind-tests * ltp-fs_perms_simple-tests * ltp-fsx-tests * ltp-hugetlb-tests * ltp-io-tests * ltp-ipc-tests * ltp-math-tests * ltp-nptl-tests * ltp-pty-tests * ltp-sched-tests * ltp-securebits-tests * ltp-syscalls-tests * ltp-timers-tests * ltp-open-posix-tests * kselftest-vsyscall-mode-native * kselftest-vsyscall-mode-none