Tom,

It might be a side effect of our attempt to report on "broken" projects (with deprecated environments etc.). I'll check why that happened. My best guess is that the first timeout in the project is too short.

milosz On Mon, 15 Oct 2018 at 14:44, Tom Gall tom.gall@linaro.org wrote:

Hi Milosz,

I’ve noticed there seems to be a double send on some results. This email is an example. It was sent at first 2:50am and then again at 9:27am.

I think the results reported as the same but I’ve not done a byte by byte comparison.

Any thoughts? Tom

Begin forwarded message:

From: Linaro QA (BETA) qa-reports@linaro.org Subject: [Lkft-maintainers] aosp-master-tracking [' 116f873fc8d2' , ' 649c5d17ca3e' , ' 6b6dffe8abee' ]/982: regressions detected in project android-lkft/aosp-master-tracking Date: October 11, 2018 at 9:27:39 AM CDT To: lkft-maintainers@lists.linaro.org

Summary

git repo: hikey-linaro git branch: ['android-hikey-linaro-4.14-116f873fc8d2', 'android-hikey-linaro-4.4-6b6dffe8abee', 'android-hikey-linaro-4.9-649c5d17ca3e'] git commit: 982 git describe: ['116f873fc8d2', '649c5d17ca3e', '6b6dffe8abee'] Test details: https://qa-reports.linaro.org/android-lkft/aosp-master-tracking/build/982

Regressions (compared to build 980)

hi6220-hikey_4.14: cts-lkft-arm64-v8a/arm64-v8a.CtsWebkitTestCases:

• android.webkit.cts.WebChromeClientTest.testOnJsBeforeUnloadIsCalled

• test src: not informed

vts-test/arm64-v8a.VtsKernelLtp:

• VtsKernelLtp.syscalls.ptrace05_64bit

• test src: not informed

vts-test/armeabi-v7a.VtsKernelLtp:

• VtsKernelLtp.syscalls.ptrace05_32bit

• VtsKernelLtp.syscalls.rt_sigsuspend01_32bit

• test src: not informed

hi6220-hikey_4.4: vts-test/arm64-v8a.VtsKernelLtp:

• VtsKernelLtp.syscalls.ptrace05_64bit

• test src: not informed

vts-test/armeabi-v7a.VtsKernelLtp:

• VtsKernelLtp.syscalls.ptrace05_32bit

• VtsKernelLtp.syscalls.rt_sigsuspend01_32bit

• test src: not informed

hi6220-hikey_4.9: cts-lkft-arm64-v8a/arm64-v8a.CtsWebkitTestCases:

• android.webkit.cts.WebChromeClientTest.testOnJsBeforeUnloadIsCalled

• test src: not informed

vts-test/arm64-v8a.VtsKernelLtp:

• VtsKernelLtp.syscalls.ptrace05_64bit

• test src: not informed

vts-test/armeabi-v7a.VtsKernelLtp:

• VtsKernelLtp.syscalls.ptrace05_32bit

• VtsKernelLtp.syscalls.rt_sigsuspend01_32bit

• test src: not informed

Fixes (compared to build 980)

hi6220-hikey_4.14: vts-test/arm64-v8a.VtsKernelQtaguidTest:

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CheckStatsInvalidSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetNumExceedFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetTest_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoTagNoUid_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoUidTag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange2_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameTagTwoSocket_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameUidTwoSocket_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagAnotherSocket_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagInvalidSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagClosedSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagInvalidSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidFirsttag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTagWithAcctTagChange_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidUntag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataStatsDeleteTest_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataTransmitTest_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.invalidSockfdFail_64bit

• test src: not informed

vts-test/armeabi-v7a.VtsKernelQtaguidTest:

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CheckStatsInvalidSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetNumExceedFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetTest_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoTagNoUid_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoUidTag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange2_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameTagTwoSocket_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameUidTwoSocket_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagAnotherSocket_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagInvalidSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagClosedSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagInvalidSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidFirsttag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTagWithAcctTagChange_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidUntag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataStatsDeleteTest_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataTransmitTest_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.invalidSockfdFail_32bit

• test src: not informed

hi6220-hikey_4.9: cts-lkft-armeabi-v7a/armeabi-v7a.CtsGraphicsTestCases:

• android.graphics.drawable.cts.AnimatedImageDrawableTest.testStop

• test src: not informed

vts-test/arm64-v8a.VtsKernelLtp:

• VtsKernelLtp.syscalls.epoll_wait02_64bit

• VtsKernelLtp.syscalls.nanosleep01_64bit

• test src: not informed

vts-test/arm64-v8a.VtsKernelQtaguidTest:

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CheckStatsInvalidSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetNumExceedFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetTest_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoTagNoUid_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoUidTag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange2_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameTagTwoSocket_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameUidTwoSocket_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagAnotherSocket_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagInvalidSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagClosedSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagInvalidSocketFail_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidFirsttag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTagWithAcctTagChange_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidUntag_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataStatsDeleteTest_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataTransmitTest_64bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.invalidSockfdFail_64bit

• test src: not informed

vts-test/armeabi-v7a.VtsKernelLtp:

• VtsKernelLtp.syscalls.clock_nanosleep02_32bit

• VtsKernelLtp.syscalls.epoll_wait02_32bit

• VtsKernelLtp.syscalls.poll02_32bit

• test src: not informed

vts-test/armeabi-v7a.VtsKernelQtaguidTest:

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CheckStatsInvalidSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetNumExceedFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.CounterSetTest_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoTagNoUid_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.NoUidTag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange2_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ReTagWithUidChange_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameTagTwoSocket_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.SameUidTwoSocket_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagAnotherSocket_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.TagInvalidSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagClosedSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.UntagInvalidSocketFail_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidFirsttag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTagWithAcctTagChange_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidReTag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.ValidUntag_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataStatsDeleteTest_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.dataTransmitTest_32bit

• VtsKernelQtaguidTest.SocketTagUsrSpaceTest.invalidSockfdFail_32bit

• test src: not informed

Boards, architectures and test suites:

hi6220-hikey_4.14

• android-boot - fail: 7,
• boot - pass: 8,
• boottime-test - pass: 3,
• cts-lkft-arm64-v8a - pass: 2,
• cts-lkft-arm64-v8a/arm64-v8a.CtsAslrMallocTestCases - pass: 1,
• cts-lkft-arm64-v8a/arm64-v8a.CtsBionicTestCases - pass: 2784,
• cts-lkft-arm64-v8a/arm64-v8a.CtsBluetoothTestCases - pass: 42, fail: 2,
• cts-lkft-arm64-v8a/arm64-v8a.CtsCameraTestCases - pass: 252,
• cts-lkft-arm64-v8a/arm64-v8a.CtsDrmTestCases - pass: 42,
• cts-lkft-arm64-v8a/arm64-v8a.CtsGraphicsTestCases - pass: 1681,
• cts-lkft-arm64-v8a/arm64-v8a.CtsHardwareTestCases - pass: 15,
• cts-lkft-arm64-v8a/arm64-v8a.CtsJankDeviceTestCases - pass: 1,
• cts-lkft-arm64-v8a/arm64-v8a.CtsJniTestCases - pass: 65,
• cts-lkft-arm64-v8a/arm64-v8a.CtsLibcoreLegacy22TestCases - pass: 5,
• cts-lkft-arm64-v8a/arm64-v8a.CtsLibcoreTestCases - pass: 18991,
• cts-lkft-arm64-v8a/arm64-v8a.CtsMonkeyTestCases - pass: 10,
• cts-lkft-arm64-v8a/arm64-v8a.CtsOsTestCases - pass: 498, fail: 4,
• cts-lkft-arm64-v8a/arm64-v8a.CtsSystemUiTestCases - pass: 3, fail: 2,
• cts-lkft-arm64-v8a/arm64-v8a.CtsUsbTests - fail: 1,
• cts-lkft-arm64-v8a/arm64-v8a.CtsWebkitTestCases - pass: 237, fail: 1,
• cts-lkft-armeabi-v7a - pass: 4,
• cts-lkft-armeabi-v7a/arm64-v8a.CtsDisplayTestCases - pass: 13,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsAslrMallocTestCases - pass: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsBionicTestCases - pass: 2789,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsBluetoothTestCases - pass: 42, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsCameraTestCases - pass: 252,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsDisplayTestCases - pass: 13,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsDrmTestCases - pass: 42,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsGraphicsTestCases - pass: 1681,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsHardwareTestCases - pass: 15,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsJankDeviceTestCases - pass: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsJniTestCases - pass: 65,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsLibcoreLegacy22TestCases - pass: 5,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsLibcoreTestCases - pass: 18991,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsMonkeyTestCases - pass: 10,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsOsTestCases - pass: 498, fail: 4,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsSystemUiTestCases - pass: 3, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsUsbTests - fail: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsWebkitTestCases - pass: 237, fail: 1,
• vts-test - pass: 8,
• vts-test/arm64-v8a.VtsKernelApiSysfsTest - pass: 11,
• vts-test/arm64-v8a.VtsKernelBinderTest - pass: 55,
• vts-test/arm64-v8a.VtsKernelConfig - fail: 1,
• vts-test/arm64-v8a.VtsKernelDeviceTreeEarlyMount - pass: 1,
• vts-test/arm64-v8a.VtsKernelHwBinder - pass: 1,
• vts-test/arm64-v8a.VtsKernelLibcutilsTest - pass: 6,
• vts-test/arm64-v8a.VtsKernelLinuxKselftest - pass: 23,
• vts-test/arm64-v8a.VtsKernelLtp - pass: 997, fail: 2,
• vts-test/arm64-v8a.VtsKernelNetBpfTest - pass: 1,
• vts-test/arm64-v8a.VtsKernelNetTest - pass: 1,
• vts-test/arm64-v8a.VtsKernelProcFileApi - pass: 60, fail: 3,
• vts-test/arm64-v8a.VtsKernelQtaguidTest - pass: 20,
• vts-test/arm64-v8a.VtsKernelSelinuxFileApi - pass: 3,
• vts-test/arm64-v8a.VtsKernelSyscallExistence - pass: 3,
• vts-test/arm64-v8a.VtsKernelSystemAsRoot - pass: 1, fail: 1,
• vts-test/arm64-v8a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.BasicRead - pass: 2,
• vts-test/arm64-v8a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.OpenAndClose - pass: 2,
• vts-test/arm64-v8a.VtsKernelVersion - pass: 1,
• vts-test/armeabi-v7a.VtsKernelApiSysfsTest - pass: 11,
• vts-test/armeabi-v7a.VtsKernelBinderTest - pass: 55,
• vts-test/armeabi-v7a.VtsKernelConfig - fail: 1,
• vts-test/armeabi-v7a.VtsKernelDeviceTreeEarlyMount - pass: 1,
• vts-test/armeabi-v7a.VtsKernelHwBinder - pass: 1,
• vts-test/armeabi-v7a.VtsKernelLibcutilsTest - pass: 6,
• vts-test/armeabi-v7a.VtsKernelLinuxKselftest - pass: 19,
• vts-test/armeabi-v7a.VtsKernelLtp - pass: 1061, fail: 3,
• vts-test/armeabi-v7a.VtsKernelNetBpfTest - pass: 1,
• vts-test/armeabi-v7a.VtsKernelNetTest - pass: 1,
• vts-test/armeabi-v7a.VtsKernelProcFileApi - pass: 60, fail: 3,
• vts-test/armeabi-v7a.VtsKernelQtaguidTest - pass: 20,
• vts-test/armeabi-v7a.VtsKernelSelinuxFileApi - pass: 3,
• vts-test/armeabi-v7a.VtsKernelSyscallExistence - pass: 3,
• vts-test/armeabi-v7a.VtsKernelSystemAsRoot - pass: 1, fail: 1,
• vts-test/armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.BasicRead - pass: 2,
• vts-test/armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.OpenAndClose - pass: 2,
• vts-test/armeabi-v7a.VtsKernelVersion - pass: 1,

hi6220-hikey_4.4

• android-boot - fail: 6,
• boot - pass: 7,
• boottime-test - pass: 3,
• cts-lkft-armeabi-v7a - pass: 4,
• cts-lkft-armeabi-v7a/arm64-v8a.CtsDisplayTestCases - pass: 13,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsAslrMallocTestCases - pass: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsBionicTestCases - pass: 2789,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsBluetoothTestCases - pass: 42, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsCameraTestCases - pass: 252,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsDisplayTestCases - pass: 13,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsDrmTestCases - pass: 42,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsGraphicsTestCases - pass: 1680, fail: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsHardwareTestCases - pass: 15,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsJankDeviceTestCases - pass: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsJniTestCases - pass: 65,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsLibcoreLegacy22TestCases - pass: 5,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsLibcoreTestCases - pass: 18991,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsMonkeyTestCases - pass: 10,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsOsTestCases - pass: 500, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsSystemUiTestCases - pass: 3, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsUsbTests - fail: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsWebkitTestCases - pass: 238,
• vts-test - pass: 8,
• vts-test/arm64-v8a.VtsKernelApiSysfsTest - pass: 11,
• vts-test/arm64-v8a.VtsKernelBinderTest - pass: 55,
• vts-test/arm64-v8a.VtsKernelConfig - pass: 1,
• vts-test/arm64-v8a.VtsKernelDeviceTreeEarlyMount - pass: 1,
• vts-test/arm64-v8a.VtsKernelHwBinder - pass: 1,
• vts-test/arm64-v8a.VtsKernelLibcutilsTest - pass: 6,
• vts-test/arm64-v8a.VtsKernelLinuxKselftest - pass: 23,
• vts-test/arm64-v8a.VtsKernelLtp - pass: 999, fail: 2,
• vts-test/arm64-v8a.VtsKernelNetBpfTest - pass: 1,
• vts-test/arm64-v8a.VtsKernelNetTest - pass: 1,
• vts-test/arm64-v8a.VtsKernelProcFileApi - pass: 63, fail: 2,
• vts-test/arm64-v8a.VtsKernelQtaguidTest - pass: 20,
• vts-test/arm64-v8a.VtsKernelSelinuxFileApi - pass: 3,
• vts-test/arm64-v8a.VtsKernelSyscallExistence - pass: 3,
• vts-test/arm64-v8a.VtsKernelSystemAsRoot - pass: 1, fail: 1,
• vts-test/arm64-v8a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.BasicRead - pass: 2,
• vts-test/arm64-v8a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.OpenAndClose - pass: 2,
• vts-test/arm64-v8a.VtsKernelVersion - pass: 1,
• vts-test/armeabi-v7a.VtsKernelApiSysfsTest - pass: 11,
• vts-test/armeabi-v7a.VtsKernelBinderTest - pass: 55,
• vts-test/armeabi-v7a.VtsKernelConfig - pass: 1,
• vts-test/armeabi-v7a.VtsKernelDeviceTreeEarlyMount - pass: 1,
• vts-test/armeabi-v7a.VtsKernelHwBinder - pass: 1,
• vts-test/armeabi-v7a.VtsKernelLibcutilsTest - pass: 6,
• vts-test/armeabi-v7a.VtsKernelLinuxKselftest - pass: 19,
• vts-test/armeabi-v7a.VtsKernelLtp - pass: 1063, fail: 3,
• vts-test/armeabi-v7a.VtsKernelNetBpfTest - pass: 1,
• vts-test/armeabi-v7a.VtsKernelNetTest - pass: 1,
• vts-test/armeabi-v7a.VtsKernelProcFileApi - pass: 63, fail: 2,
• vts-test/armeabi-v7a.VtsKernelQtaguidTest - pass: 20,
• vts-test/armeabi-v7a.VtsKernelSelinuxFileApi - pass: 3,
• vts-test/armeabi-v7a.VtsKernelSyscallExistence - pass: 3,
• vts-test/armeabi-v7a.VtsKernelSystemAsRoot - pass: 1, fail: 1,
• vts-test/armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.BasicRead - pass: 2,
• vts-test/armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.OpenAndClose - pass: 2,
• vts-test/armeabi-v7a.VtsKernelVersion - pass: 1,

hi6220-hikey_4.9

• android-boot - fail: 6,
• boot - pass: 7,
• boottime-test - pass: 3,
• cts-lkft-arm64-v8a - pass: 2,
• cts-lkft-arm64-v8a/arm64-v8a.CtsAslrMallocTestCases - pass: 1,
• cts-lkft-arm64-v8a/arm64-v8a.CtsBionicTestCases - pass: 2784,
• cts-lkft-arm64-v8a/arm64-v8a.CtsBluetoothTestCases - pass: 42, fail: 2,
• cts-lkft-arm64-v8a/arm64-v8a.CtsCameraTestCases - pass: 252,
• cts-lkft-arm64-v8a/arm64-v8a.CtsDrmTestCases - pass: 42,
• cts-lkft-arm64-v8a/arm64-v8a.CtsGraphicsTestCases - pass: 1681,
• cts-lkft-arm64-v8a/arm64-v8a.CtsHardwareTestCases - pass: 15,
• cts-lkft-arm64-v8a/arm64-v8a.CtsJankDeviceTestCases - pass: 1,
• cts-lkft-arm64-v8a/arm64-v8a.CtsJniTestCases - pass: 65,
• cts-lkft-arm64-v8a/arm64-v8a.CtsLibcoreLegacy22TestCases - pass: 5,
• cts-lkft-arm64-v8a/arm64-v8a.CtsLibcoreTestCases - pass: 18991,
• cts-lkft-arm64-v8a/arm64-v8a.CtsMonkeyTestCases - pass: 10,
• cts-lkft-arm64-v8a/arm64-v8a.CtsOsTestCases - pass: 498, fail: 4,
• cts-lkft-arm64-v8a/arm64-v8a.CtsSystemUiTestCases - pass: 3, fail: 2,
• cts-lkft-arm64-v8a/arm64-v8a.CtsUsbTests - fail: 1,
• cts-lkft-arm64-v8a/arm64-v8a.CtsWebkitTestCases - pass: 237, fail: 1,
• cts-lkft-armeabi-v7a - pass: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsAslrMallocTestCases - pass: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsBionicTestCases - pass: 2789,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsBluetoothTestCases - pass: 42, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsCameraTestCases - pass: 252,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsDrmTestCases - pass: 42,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsGraphicsTestCases - pass: 1681,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsHardwareTestCases - pass: 15,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsJankDeviceTestCases - pass: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsJniTestCases - pass: 65,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsLibcoreLegacy22TestCases - pass: 5,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsLibcoreTestCases - pass: 18991,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsMonkeyTestCases - pass: 10,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsOsTestCases - pass: 498, fail: 4,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsSystemUiTestCases - pass: 3, fail: 2,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsUsbTests - fail: 1,
• cts-lkft-armeabi-v7a/armeabi-v7a.CtsWebkitTestCases - pass: 238,
• vts-test - pass: 8,
• vts-test/arm64-v8a.VtsKernelApiSysfsTest - pass: 11,
• vts-test/arm64-v8a.VtsKernelBinderTest - pass: 55,
• vts-test/arm64-v8a.VtsKernelConfig - fail: 1,
• vts-test/arm64-v8a.VtsKernelDeviceTreeEarlyMount - pass: 1,
• vts-test/arm64-v8a.VtsKernelHwBinder - pass: 1,
• vts-test/arm64-v8a.VtsKernelLibcutilsTest - pass: 6,
• vts-test/arm64-v8a.VtsKernelLinuxKselftest - pass: 23,
• vts-test/arm64-v8a.VtsKernelLtp - pass: 999, fail: 2,
• vts-test/arm64-v8a.VtsKernelNetBpfTest - pass: 1,
• vts-test/arm64-v8a.VtsKernelNetTest - pass: 1,
• vts-test/arm64-v8a.VtsKernelProcFileApi - pass: 62, fail: 3,
• vts-test/arm64-v8a.VtsKernelQtaguidTest - pass: 20,
• vts-test/arm64-v8a.VtsKernelSelinuxFileApi - pass: 3,
• vts-test/arm64-v8a.VtsKernelSyscallExistence - pass: 3,
• vts-test/arm64-v8a.VtsKernelSystemAsRoot - pass: 1, fail: 1,
• vts-test/arm64-v8a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.BasicRead - pass: 2,
• vts-test/arm64-v8a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.OpenAndClose - pass: 2,
• vts-test/arm64-v8a.VtsKernelVersion - pass: 1,
• vts-test/armeabi-v7a.VtsKernelApiSysfsTest - pass: 11,
• vts-test/armeabi-v7a.VtsKernelBinderTest - pass: 55,
• vts-test/armeabi-v7a.VtsKernelConfig - fail: 1,
• vts-test/armeabi-v7a.VtsKernelDeviceTreeEarlyMount - pass: 1,
• vts-test/armeabi-v7a.VtsKernelHwBinder - pass: 1,
• vts-test/armeabi-v7a.VtsKernelLibcutilsTest - pass: 6,
• vts-test/armeabi-v7a.VtsKernelLinuxKselftest - pass: 19,
• vts-test/armeabi-v7a.VtsKernelLtp - pass: 1063, fail: 3,
• vts-test/armeabi-v7a.VtsKernelNetBpfTest - pass: 1,
• vts-test/armeabi-v7a.VtsKernelNetTest - pass: 1,
• vts-test/armeabi-v7a.VtsKernelProcFileApi - pass: 62, fail: 3,
• vts-test/armeabi-v7a.VtsKernelQtaguidTest - pass: 20,
• vts-test/armeabi-v7a.VtsKernelSelinuxFileApi - pass: 3,
• vts-test/armeabi-v7a.VtsKernelSyscallExistence - pass: 3,
• vts-test/armeabi-v7a.VtsKernelSystemAsRoot - pass: 1, fail: 1,
• vts-test/armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.BasicRead - pass: 2,
• vts-test/armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.Basic/VtsKernelTunTest.OpenAndClose - pass: 2,
• vts-test/armeabi-v7a.VtsKernelVersion - pass: 1,

-- Linaro QA (BETA) https://qa-reports.linaro.org _______________________________________________ Lkft-maintainers mailing list Lkft-maintainers@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lkft-maintainers