Hi Todd,
I have updated the VTS package and AOSP master image. All the tests should now pass from next build onwards. Here are the results from our CI for the new package: https://qa-reports.linaro.org/staging-lkft/aosp-master-vts-tracking/build/66...
Regards, Vishal
On 16 January 2018 at 23:41, Vishal Bhoj vishal.bhoj@linaro.org wrote:
Hi Todd,
I have updated to AOSP master locally and tests are passing for me as well. I am fixing the vts package built in our CI setup which is having the problem. I'll validate the same and update the LKFT reference image and VTS package.
Regards, Vishal
On 16 January 2018 at 22:58, Todd Kjos tkjos@google.com wrote:
A bunch of those failures are "no test case found or generated" in "setup_class" test... is this a vts test framework issue?
VtsKernelBinderTest#setup_class VtsKernelLibcutilsTest#setup_class GtestBinaryTest#setup_class GtestBinaryTest#setup_class GtestBinaryTest#setup_class
Steve- any idea what causes there in LKFT? I don't see them if I run the tests.
On Sat, Jan 13, 2018 at 12:27 AM, Vishal Bhoj vishal.bhoj@linaro.org wrote:
Hi Todd,
It is not an infrastructure failure. May be I am not running the tests, the way you are running. Here are the links to the logs and VTS results from the failing job: http://archive.validation.linaro.org/artifacts/team/qa/2018/ 01/11/20/49/tradefed-output-20180111210505.tar.xz
I see few tests failing with AOSP master from today. I have run vts-kernel plan for arm64-v8a and armeabi-v7a architecture separately: http://archive.validation.linaro.org/artifacts/team/qa/2018/ 01/13/07/12/tradefed-output-20180113072820.tar.xz http://archive.validation.linaro.org/artifacts/team/qa/2018/ 01/13/07/08/tradefed-output-20180113072322.tar.xz
Please have a look at the logs and let me know if there I am doing anything wrong.
Regards, Vishal On 13 January 2018 at 00:09, Todd Kjos tkjos@google.com wrote:
I don't see any of these failures using AOSP master. Is the test infra ok?
On Thu, Jan 11, 2018 at 4:18 PM, Linaro QA qa-reports@linaro.org wrote:
Summary
git repo: https://android.googlesource.com/kernel/hikey-linaro git branch: android-hikey-linaro-4.9 git commit: d347af269c9d8a068202d10bf44f03e4e0dcabb9 git describe: v4.9.76-638814-gd347af269c9d Test details: https://qa-reports.linaro.org/
lkft/android-hikey-linaro-4.9-
aosp/build/v4.9.76-638814-gd347af269c9d
No regressions (compared to build v4.9.75-638807-gf5fb343ca10a)
Boards, architectures and test suites:
hi6220-hikey - arm64 (AOSP master)
- boot - pass: 5,
- boottime-test - pass: 3,
- vts-test - pass: 6,
- vts-test/arm64-v8a.KernelProcFileApiTest - pass: 24,
- vts-test/arm64-v8a.SyscallExistenceTest - pass: 1, fail: 2
- vts-test/arm64-v8a.VtsKernelApiSysfsTest - pass: 3,
- vts-test/arm64-v8a.VtsKernelBinderTest - fail: 1
- vts-test/arm64-v8a.VtsKernelConfig - pass: 1,
- vts-test/arm64-v8a.VtsKernelHwBinder - pass: 1,
- vts-test/arm64-v8a.VtsKernelLibcutilsTest - fail: 1
- vts-test/arm64-v8a.VtsKernelLtp - pass: 776,
- vts-test/arm64-v8a.VtsKernelNetdTest - fail: 1
- vts-test/arm64-v8a.VtsKernelSelinuxFileApi - pass: 3,
- vts-test/arm64-v8a.VtsKernelTunTest - fail: 1
- vts-test/arm64-v8a.VtsQtaguidTest - fail: 1
- vts-test/armeabi-v7a.KernelProcFileApiTest - pass: 24,
- vts-test/armeabi-v7a.SyscallExistenceTest - pass: 1, fail: 2
- vts-test/armeabi-v7a.VtsKernelApiSysfsTest - pass: 3,
- vts-test/armeabi-v7a.VtsKernelBinderTest - pass: 45, fail: 8
- vts-test/armeabi-v7a.VtsKernelConfig - pass: 1,
- vts-test/armeabi-v7a.VtsKernelHwBinder - pass: 1,
- vts-test/armeabi-v7a.VtsKernelLibcutilsTest - pass: 6,
- vts-test/armeabi-v7a.VtsKernelLinuxKselftest - pass: 19,
- vts-test/armeabi-v7a.VtsKernelNetdTest - pass: 32,
- vts-test/armeabi-v7a.VtsKernelSelinuxFileApi - pass: 3,
- vts-test/armeabi-v7a.VtsKernelTunTest/GtestBinaryTest.Basic/
VtsKernelTunTest.BasicRead
- pass: 2,
- vts-test/armeabi-v7a.VtsKernelTunTest/GtestBinaryTest.Basic/
VtsKernelTunTest.OpenAndClose
- pass: 2,
- vts-test/armeabi-v7a.VtsQtaguidTest - pass: 20,
Documentation - https://collaborate.linaro.org
/display/LKFT/Email+Reports
-- Linaro QA (beta) https://qa-reports.linaro.org _______________________________________________ Lts-dev mailing list Lts-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lts-dev
Lkft-maintainers mailing list Lkft-maintainers@lists.linaro.org https://lists.linaro.org/mailman/listinfo/lkft-maintainers