A bunch of those failures are "no test case found or generated" in "setup_class" test... is this a vts test framework issue?

VtsKernelBinderTest#setup_class
VtsKernelLibcutilsTest#setup_class
GtestBinaryTest#setup_class
GtestBinaryTest#setup_class
GtestBinaryTest#setup_class

Steve- any idea what causes there in LKFT? I don't see them if I run the tests.


On Sat, Jan 13, 2018 at 12:27 AM, Vishal Bhoj <vishal.bhoj@linaro.org> wrote:
Hi Todd,

It is not an infrastructure failure. May be I am not running the tests, the way you are running. Here are the links to the logs and VTS results from the failing job:

I see few tests failing with AOSP master from today. I have run vts-kernel plan forĀ arm64-v8a and armeabi-v7a architecture separately:

Please have a look at the logs and let me know if there I am doing anything wrong.

Regards,
Vishal
On 13 January 2018 at 00:09, Todd Kjos <tkjos@google.com> wrote:
I don't see any of these failures using AOSP master. Is the test infra ok?

On Thu, Jan 11, 2018 at 4:18 PM, Linaro QA <qa-reports@linaro.org> wrote:

> Summary
> ------------------------------------------------------------------------
>
> git repo: https://android.googlesource.com/kernel/hikey-linaro
> git branch: android-hikey-linaro-4.9
> git commit: d347af269c9d8a068202d10bf44f03e4e0dcabb9
> git describe: v4.9.76-638814-gd347af269c9d
> Test details: https://qa-reports.linaro.org/lkft/android-hikey-linaro-4.9-
> aosp/build/v4.9.76-638814-gd347af269c9d
>
>
> No regressions (compared to build v4.9.75-638807-gf5fb343ca10a)
>
> Boards, architectures and test suites:
> -------------------------------------
>
> hi6220-hikey - arm64 (AOSP master)
> * boot - pass: 5,
> * boottime-test - pass: 3,
> * vts-test - pass: 6,
> * vts-test/arm64-v8a.KernelProcFileApiTest - pass: 24,
> * vts-test/arm64-v8a.SyscallExistenceTest - pass: 1, fail: 2
> * vts-test/arm64-v8a.VtsKernelApiSysfsTest - pass: 3,
> * vts-test/arm64-v8a.VtsKernelBinderTest - fail: 1
> * vts-test/arm64-v8a.VtsKernelConfig - pass: 1,
> * vts-test/arm64-v8a.VtsKernelHwBinder - pass: 1,
> * vts-test/arm64-v8a.VtsKernelLibcutilsTest - fail: 1
> * vts-test/arm64-v8a.VtsKernelLtp - pass: 776,
> * vts-test/arm64-v8a.VtsKernelNetdTest - fail: 1
> * vts-test/arm64-v8a.VtsKernelSelinuxFileApi - pass: 3,
> * vts-test/arm64-v8a.VtsKernelTunTest - fail: 1
> * vts-test/arm64-v8a.VtsQtaguidTest - fail: 1
> * vts-test/armeabi-v7a.KernelProcFileApiTest - pass: 24,
> * vts-test/armeabi-v7a.SyscallExistenceTest - pass: 1, fail: 2
> * vts-test/armeabi-v7a.VtsKernelApiSysfsTest - pass: 3,
> * vts-test/armeabi-v7a.VtsKernelBinderTest - pass: 45, fail: 8
> * vts-test/armeabi-v7a.VtsKernelConfig - pass: 1,
> * vts-test/armeabi-v7a.VtsKernelHwBinder - pass: 1,
> * vts-test/armeabi-v7a.VtsKernelLibcutilsTest - pass: 6,
> * vts-test/armeabi-v7a.VtsKernelLinuxKselftest - pass: 19,
> * vts-test/armeabi-v7a.VtsKernelNetdTest - pass: 32,
> * vts-test/armeabi-v7a.VtsKernelSelinuxFileApi - pass: 3,
> * vts-test/armeabi-v7a.VtsKernelTunTest/GtestBinaryTest.Basic/VtsKernelTunTest.BasicRead
> - pass: 2,
> * vts-test/armeabi-v7a.VtsKernelTunTest/GtestBinaryTest.Basic/VtsKernelTunTest.OpenAndClose
> - pass: 2,
> * vts-test/armeabi-v7a.VtsQtaguidTest - pass: 20,
>
>
>
> Documentation - https://collaborate.linaro.org/display/LKFT/Email+Reports
>
> --
> Linaro QA (beta)
> https://qa-reports.linaro.org
> _______________________________________________
> Lts-dev mailing list
> Lts-dev@lists.linaro.org
> https://lists.linaro.org/mailman/listinfo/lts-dev
>
_______________________________________________
Lkft-maintainers mailing list
Lkft-maintainers@lists.linaro.org
https://lists.linaro.org/mailman/listinfo/lkft-maintainers