Hi Todd,

I have updated to AOSP master locally and tests are passing for me as well. I am fixing the vts package built in our CI setup which is having the problem. I'll validate the same and update the LKFT reference image and VTS package.

Regards,
Vishal

On 16 January 2018 at 22:58, Todd Kjos <tkjos@google.com> wrote:
A bunch of those failures are "no test case found or generated" in "setup_class" test... is this a vts test framework issue?

VtsKernelBinderTest#setup_class
VtsKernelLibcutilsTest#setup_class
GtestBinaryTest#setup_class
GtestBinaryTest#setup_class
GtestBinaryTest#setup_class

Steve- any idea what causes there in LKFT? I don't see them if I run the tests.


On Sat, Jan 13, 2018 at 12:27 AM, Vishal Bhoj <vishal.bhoj@linaro.org> wrote:
Hi Todd,

It is not an infrastructure failure. May be I am not running the tests, the way you are running. Here are the links to the logs and VTS results from the failing job:

I see few tests failing with AOSP master from today. I have run vts-kernel plan for arm64-v8a and armeabi-v7a architecture separately:

Please have a look at the logs and let me know if there I am doing anything wrong.

Regards,
Vishal
On 13 January 2018 at 00:09, Todd Kjos <tkjos@google.com> wrote:
I don't see any of these failures using AOSP master. Is the test infra ok?

On Thu, Jan 11, 2018 at 4:18 PM, Linaro QA <qa-reports@linaro.org> wrote:

> Summary
> ------------------------------------------------------------------------
>
> git repo: https://android.googlesource.com/kernel/hikey-linaro
> git branch: android-hikey-linaro-4.9
> git commit: d347af269c9d8a068202d10bf44f03e4e0dcabb9
> git describe: v4.9.76-638814-gd347af269c9d
> Test details: https://qa-reports.linaro.org/lkft/android-hikey-linaro-4.9-
> aosp/build/v4.9.76-638814-gd347af269c9d
>
>
> No regressions (compared to build v4.9.75-638807-gf5fb343ca10a)
>
> Boards, architectures and test suites:
> -------------------------------------
>
> hi6220-hikey - arm64 (AOSP master)
> * boot - pass: 5,
> * boottime-test - pass: 3,
> * vts-test - pass: 6,
> * vts-test/arm64-v8a.KernelProcFileApiTest - pass: 24,
> * vts-test/arm64-v8a.SyscallExistenceTest - pass: 1, fail: 2
> * vts-test/arm64-v8a.VtsKernelApiSysfsTest - pass: 3,
> * vts-test/arm64-v8a.VtsKernelBinderTest - fail: 1
> * vts-test/arm64-v8a.VtsKernelConfig - pass: 1,
> * vts-test/arm64-v8a.VtsKernelHwBinder - pass: 1,
> * vts-test/arm64-v8a.VtsKernelLibcutilsTest - fail: 1
> * vts-test/arm64-v8a.VtsKernelLtp - pass: 776,
> * vts-test/arm64-v8a.VtsKernelNetdTest - fail: 1
> * vts-test/arm64-v8a.VtsKernelSelinuxFileApi - pass: 3,
> * vts-test/arm64-v8a.VtsKernelTunTest - fail: 1
> * vts-test/arm64-v8a.VtsQtaguidTest - fail: 1
> * vts-test/armeabi-v7a.KernelProcFileApiTest - pass: 24,
> * vts-test/armeabi-v7a.SyscallExistenceTest - pass: 1, fail: 2
> * vts-test/armeabi-v7a.VtsKernelApiSysfsTest - pass: 3,
> * vts-test/armeabi-v7a.VtsKernelBinderTest - pass: 45, fail: 8
> * vts-test/armeabi-v7a.VtsKernelConfig - pass: 1,
> * vts-test/armeabi-v7a.VtsKernelHwBinder - pass: 1,
> * vts-test/armeabi-v7a.VtsKernelLibcutilsTest - pass: 6,
> * vts-test/armeabi-v7a.VtsKernelLinuxKselftest - pass: 19,
> * vts-test/armeabi-v7a.VtsKernelNetdTest - pass: 32,
> * vts-test/armeabi-v7a.VtsKernelSelinuxFileApi - pass: 3,
> * vts-test/armeabi-v7a.VtsKernelTunTest/GtestBinaryTest.Basic/VtsKernelTunTest.BasicRead
> - pass: 2,
> * vts-test/armeabi-v7a.VtsKernelTunTest/GtestBinaryTest.Basic/VtsKernelTunTest.OpenAndClose
> - pass: 2,
> * vts-test/armeabi-v7a.VtsQtaguidTest - pass: 20,
>
>
>
> Documentation - https://collaborate.linaro.org/display/LKFT/Email+Reports
>
> --
> Linaro QA (beta)
> https://qa-reports.linaro.org
> _______________________________________________
> Lts-dev mailing list
> Lts-dev@lists.linaro.org
> https://lists.linaro.org/mailman/listinfo/lts-dev
>
_______________________________________________
Lkft-maintainers mailing list
Lkft-maintainers@lists.linaro.org
https://lists.linaro.org/mailman/listinfo/lkft-maintainers