On 17 Oct 2017, at 13:35, Milosz Wasilewski <milosz.wasilewski@linaro.org> wrote:

On 17 October 2017 at 12:32, Greg KH <gregkh@google.com> wrote:

On Tue, Oct 17, 2017 at 12:22:40PM +0100, Milosz Wasilewski wrote:

On 17 October 2017 at 12:15, Greg KH <gregkh@google.com> wrote:

On Tue, Oct 17, 2017 at 12:12:10PM +0100, Milosz Wasilewski wrote:

On 16 October 2017 at 23:41, Tom Gall <tom.gall@linaro.org> wrote:

Hi All,

I’m looking at the 4.14-rc5 results. I think it’s important that we establish clear green baselines so we can detect regressions.

Universally I think we want to get stuff on skip lists and then get after those skip lists working on fixes. As that happens, we basically get those fixes back ported to 4.9 and 4.4.


I haven’t captured everything since this requires manual c/n/p:  (Being able to do command line queries would be really awesome)

With the triage meeting tomorrow I’d like to focus down in these areas.


x86_64
ltp-syscalls-tests - How much of this caused by NFS? Why are we still using NFS?
linkat01
open12
openat02
renameat201
renameat202
sendfile09
sendfile09_64
utime01
utime02
utime06
utimes01

I think all are due to NFS. We're waiting for quotes for new HW. With
old HW there is no other option than NFS.

Really?  You can't run off of a sdcard?  some other networked filessytem
that actually works?  cifs?  nfsv4?  lustre? :)

this is old crappy server that already boots from USB stick to load
the kernel and mount nfs. There are hard drives but had to be
disconnected to allow for loading kernels. And we just have one of it.
So I'd rather get the new HW in place than patch this already broken
setup.

Oh wait, this is x86?  Come on, you can't just get a new Dell server
send to you within days to resolve this issue?  NFS should not be an
issue here :(

What's the status on the new hardware?

Dave?

kselftest
breakpoint_test_arm64
ftracetest
pstore_tests
run_fuse_test.sh
run.sh
run_vmtests
seccomp_bpf
test_align
test_kmod.sh
test_maps
test_progs
test_verifier

bpf is going to be blacklisted today unless someone objects:
https://review.linaro.org/#/c/21838/

Why would it be failing on 4.14-rc?

And don't blacklist the whole thing on older kernels please, if at all
possible just don't run the ones that we "know" will fail as the feature
is not present.

it's just BPF from kselftests:
test_verifier
test_tag
test_maps
test_lru_map
test_lpm_map
test_progs
test_align
test_kmod.sh

They fail on 4.4 and 4.9 kernels. Other failures don't fall in this
category. Remaining kselftests will be still executed. Is that what
you ask for?

This email thread was about getting everything "green" on mainline (i.e.
4.14-rc), and was not about 4.4 or 4.9, so I'm a bit confused why you
would be saying it is going to be disabled on 4.14-rc...

I take it back. It's only going to be disabled on 4.4 and 4.9 for now.
I checked again on my local board as I suspected the old version of
test causes the failures on more recent kernel. Unfortunately
kselftests from the same commit fail as well as tests from -next.

Results with 4.15-rc5 kselftests:

Running tests in bpf
========================================
selftests: test_verifier [FAIL] - file missing
selftests: test_tag [PASS]
selftests: test_maps [FAIL]
selftests: test_lru_map [PASS]
selftests: test_lpm_map [PASS]
[  741.106598] audit: type=1701 audit(1507803522.407:6):
auid=4294967295 uid=0 gid=0 ses=4294967295 pid=3493 comm="test_progs"
exe="/opt/kselftests/default-in-kernel/bpf/test_progs" sig=6 res=1
./run_kselftest.sh: line 12:  3493 Aborted                 (core
dumped) ./test_progs > /tmp/test_progs 2>&1
selftests: test_progs [FAIL] - missing object files that the test expects
selftests: test_align [FAIL] - file missing
selftests: test_kmod.sh [FAIL]
selftests: test_xdp_redirect.sh [PASS]


Results with linux-next kselftests (I'm not 100% sure, but I think
it's version next-20171013)

Running tests in bpf
========================================
selftests: test_verifier [FAIL] - file missing
selftests: test_tag [PASS]
selftests: test_maps [FAIL]
selftests: test_lru_map [PASS]
[  304.806974] audit: type=1701 audit(1507803081.379:4):
auid=4294967295 uid=0 gid=0 ses=4294967295 pid=2899
comm="test_lpm_map" exe="/opt/kselftests/next/bpf/test_lpm_map" sig=6
res=1
./run_kselftest.sh: line 11:  2899 Aborted                 (core
dumped) ./test_lpm_map > /tmp/test_lpm_map 2>&1
selftests: test_lpm_map [FAIL]
[  304.838407] audit: type=1701 audit(1507803081.411:5):
auid=4294967295 uid=0 gid=0 ses=4294967295 pid=2902 comm="test_progs"
exe="/opt/kselftests/next/bpf/test_progs" sig=6 res=1
./run_kselftest.sh: line 12:  2902 Aborted                 (core
dumped) ./test_progs > /tmp/test_progs 2>&1
selftests: test_progs [FAIL] - missing object files that the test expects
selftests: test_align [FAIL] - file missing
selftests: test_verifier_log [PASS]
selftests: test_kmod.sh [FAIL]
selftests: test_xdp_redirect.sh [PASS]
selftests: test_xdp_meta.sh [PASS]

So it looks like sth is wrong with building the tests.

milosz