Linaro test farm is validating each stable rc releases and reporting results to upstream. kvm-unit-tests also included in Linux Kernel Functional test plan and we see below results so please comment on reason for test failures and skip and suggest Kconfig or any userland tools for improve test coverage.
kvm unit tests results summary. PASS 23 SKIP 18 FAIL 14
Test results output log, -------------------------------- FAIL apic-split (timeout; duration=90s) PASS ioapic-split (19 tests) FAIL apic (timeout; duration=30) PASS ioapic (19 tests) PASS smptest (1 tests) PASS smptest3 (1 tests) PASS vmexit_cpuid FAIL vmexit_vmcall PASS vmexit_mov_from_cr8 PASS vmexit_mov_to_cr8 PASS vmexit_inl_pmtimer PASS vmexit_ipi PASS vmexit_ipi_halt PASS vmexit_ple_round_robin PASS vmexit_tscdeadline PASS vmexit_tscdeadline_immed SKIP access (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP smap (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP pku (qemu-system-x86_64: CPU model 'host' requires KVM) FAIL emulator (timeout; duration=90s) PASS eventinj (13 tests) FAIL hypercall (timeout; duration=90s) FAIL idt_test (timeout; duration=90s) SKIP memory (qemu-system-x86_64: CPU model 'host' requires KVM) PASS msr (12 tests) cat: /proc/sys/kernel/nmi_watchdog: No such file or directory SKIP pmu (/proc/sys/kernel/nmi_watchdog not equal to 0) FAIL vmware_backdoors PASS port80 FAIL realmode FAIL s3 PASS sieve PASS syscall (2 tests) PASS tsc (3 tests) SKIP tsc_adjust (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP xsave (qemu-system-x86_64: CPU model 'host' requires KVM) PASS rmap_chain FAIL svm (timeout; duration=90s) SKIP taskswitch (i386 only) SKIP taskswitch2 (i386 only) FAIL kvmclock_test FAIL pcid (3 tests, 1 unexpected failures) PASS umip (11 tests) SKIP vmx (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP ept (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_eoi_bitmap_ioapic_scan (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_hlt_with_rvi_test (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_apicv_test (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_apic_passthrough_thread (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_vmcs_shadow_test (qemu-system-x86_64: CPU model 'host' requires KVM) FAIL debug SKIP hyperv_synic SKIP hyperv_connections (1 tests, 1 skipped) PASS hyperv_stimer (1 tests) FAIL hyperv_clock (timeout; duration=90s) PASS intel_iommu (11 tests)
Kernel version, 5.0.11-rc1
x86_64 kernel config, http://snapshots.linaro.org/openembedded/lkft/lkft/sumo/intel-corei7-64/lkft...
Test full results log, https://lkft.validation.linaro.org/scheduler/job/696689#L1415
Reference link for all test plans running on x86_64, i386, arm and arm64. https://qa-reports.linaro.org/lkft/linux-stable-rc-5.0-oe/
Best regards Naresh Kamboju
On Thu, May 02, 2019 at 12:54:14PM +0530, Naresh Kamboju wrote:
Linaro test farm is validating each stable rc releases and reporting results to upstream. kvm-unit-tests also included in Linux Kernel Functional test plan and we see below results so please comment on reason for test failures and skip and suggest Kconfig or any userland tools for improve test coverage.
The test environment needs to load a KVM module, e.g. kvm_intel or kvm_amd. The unit tests don't require KVM to be loaded and will happily test Qemu emulation when possible (not sure if this is a bug or feature).
Lack of KVM is why you see
SKIP ... (qemu-system-x86_64: CPU model 'host' requires KVM)
and is likely why other tests are failing, e.g. apic timeouts.
kvm unit tests results summary. PASS 23 SKIP 18 FAIL 14
Test results output log,
FAIL apic-split (timeout; duration=90s) PASS ioapic-split (19 tests) FAIL apic (timeout; duration=30) PASS ioapic (19 tests) PASS smptest (1 tests) PASS smptest3 (1 tests) PASS vmexit_cpuid FAIL vmexit_vmcall PASS vmexit_mov_from_cr8 PASS vmexit_mov_to_cr8 PASS vmexit_inl_pmtimer PASS vmexit_ipi PASS vmexit_ipi_halt PASS vmexit_ple_round_robin PASS vmexit_tscdeadline PASS vmexit_tscdeadline_immed SKIP access (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP smap (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP pku (qemu-system-x86_64: CPU model 'host' requires KVM) FAIL emulator (timeout; duration=90s) PASS eventinj (13 tests) FAIL hypercall (timeout; duration=90s) FAIL idt_test (timeout; duration=90s) SKIP memory (qemu-system-x86_64: CPU model 'host' requires KVM) PASS msr (12 tests) cat: /proc/sys/kernel/nmi_watchdog: No such file or directory SKIP pmu (/proc/sys/kernel/nmi_watchdog not equal to 0) FAIL vmware_backdoors PASS port80 FAIL realmode FAIL s3 PASS sieve PASS syscall (2 tests) PASS tsc (3 tests) SKIP tsc_adjust (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP xsave (qemu-system-x86_64: CPU model 'host' requires KVM) PASS rmap_chain FAIL svm (timeout; duration=90s) SKIP taskswitch (i386 only) SKIP taskswitch2 (i386 only) FAIL kvmclock_test FAIL pcid (3 tests, 1 unexpected failures) PASS umip (11 tests) SKIP vmx (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP ept (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_eoi_bitmap_ioapic_scan (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_hlt_with_rvi_test (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_apicv_test (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_apic_passthrough_thread (qemu-system-x86_64: CPU model 'host' requires KVM) SKIP vmx_vmcs_shadow_test (qemu-system-x86_64: CPU model 'host' requires KVM) FAIL debug SKIP hyperv_synic SKIP hyperv_connections (1 tests, 1 skipped) PASS hyperv_stimer (1 tests) FAIL hyperv_clock (timeout; duration=90s) PASS intel_iommu (11 tests)
Kernel version, 5.0.11-rc1
x86_64 kernel config, http://snapshots.linaro.org/openembedded/lkft/lkft/sumo/intel-corei7-64/lkft...
Test full results log, https://lkft.validation.linaro.org/scheduler/job/696689#L1415
Reference link for all test plans running on x86_64, i386, arm and arm64. https://qa-reports.linaro.org/lkft/linux-stable-rc-5.0-oe/
Best regards Naresh Kamboju
-
Naresh Kamboju -
Sean Christopherson