March 2020 - Linux-kselftest-mirror

by Dmitry Vyukov

Hi Shuah, We discussed collecting and uploading all syzkaller reproducers somewhere. You wanted to see how they look. I've uploaded all current reproducers here: https://github.com/dvyukov/syzkaller-repros Minimalistic build/run scripts are included. +some testing mailing lists too as this can be used as a test suite If you have any potential uses for this, you are welcome to use it. But then we probably need to find some more official and shared place for them than my private github. The test programs can also be bulk updated if necessary, because all of this is auto-generated. Thanks

4 years, 9 months

5
24
0 0

[PATCH] kunit/kunit_kernel: Rebuild .config if .kunitconfig is modified

by sj38.park＠gmail.com

From: SeongJae Park <sjpark(a)amazon.de> Deletions of configs in the '.kunitconfig' is not applied because kunit rebuilds '.config' only if the '.config' is not a subset of the '.kunitconfig'. To allow the deletions to applied, this commit modifies the '.config' rebuild condition to addtionally check the modified times of those files. Signed-off-by: SeongJae Park <sjpark(a)amazon.de> --- tools/testing/kunit/kunit_kernel.py | 17 +++++++++++------ 1 file changed, 11 insertions(+), 6 deletions(-) diff --git a/tools/testing/kunit/kunit_kernel.py b/tools/testing/kunit/kunit_kernel.py index cc5d844ecca1..a3a5d6c7e66d 100644 --- a/tools/testing/kunit/kunit_kernel.py +++ b/tools/testing/kunit/kunit_kernel.py @@ -111,17 +111,22 @@ class LinuxSourceTree(object): return True def build_reconfig(self, build_dir): - """Creates a new .config if it is not a subset of the .kunitconfig.""" + """Creates a new .config if it is not a subset of, or older than the .kunitconfig.""" kconfig_path = get_kconfig_path(build_dir) if os.path.exists(kconfig_path): existing_kconfig = kunit_config.Kconfig() existing_kconfig.read_from_file(kconfig_path) - if not self._kconfig.is_subset_of(existing_kconfig): - print('Regenerating .config ...') - os.remove(kconfig_path) - return self.build_config(build_dir) - else: + subset = self._kconfig.is_subset_of(existing_kconfig) + + kunitconfig_mtime = os.path.getmtime(kunitconfig_path) + kconfig_mtime = os.path.getmtime(kconfig_path) + older = kconfig_mtime < kunitconfig_mtime + + if subset and not older: return True + print('Regenerating .config ...') + os.remove(kconfig_path) + return self.build_config(build_dir) else: print('Generating .config ...') return self.build_config(build_dir) -- 2.17.1

4 years, 9 months

8
12
0 0

[RFC PATCH kunit-next 0/2] kunit: extend kunit resources API

by Alan Maguire

A recent RFC patch set [1] suggests some additional functionality may be needed around kunit resources. It seems to require 1. support for resources without allocation 2. support for lookup of such resources 3. support for access to resources across multiple kernel threads The proposed changes here are designed to address these needs. The idea is we first generalize the API to support adding resources with static data; then from there we support named resources. The latter support is needed because if we are in a different thread context and only have the "struct kunit *" to work with, we need a way to identify a resource in lookup. [1] https://lkml.org/lkml/2020/2/26/1286 Alan Maguire (2): kunit: generalize kunit_resource API beyond allocated resources kunit: add support for named resources include/kunit/test.h | 145 ++++++++++++++++++++++------ lib/kunit/kunit-test.c | 103 ++++++++++++++++---- lib/kunit/string-stream.c | 14 ++- lib/kunit/test.c | 234 +++++++++++++++++++++++++++++++++------------- 4 files changed, 375 insertions(+), 121 deletions(-) -- 1.8.3.1

4 years, 9 months

2
4
0 0

next-20200312 kselftest results

by ci_notify＠linaro.org

Summary ------------------------------------------------------------------------ kernel: 5.6.0-rc5 git repo: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git git branch: master git commit: 407b0a62b422526e943e1261c7939b2e52ee17cb git describe: next-20200312 Test details: https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20200312 Regressions (compared to build next-20200311) ------------------------------------------------------------------------ x86: kselftest-vsyscall-mode-none: * net_fib-onlink-tests.sh kselftest-vsyscall-mode-none/net: * mptcp_mptcp_connect.sh x86: kselftest-vsyscall-mode-none: * net_fib-onlink-tests.sh kselftest-vsyscall-mode-none/net: * mptcp_mptcp_connect.sh Fixes (compared to build next-20200311) ------------------------------------------------------------------------ No fixes In total: ------------------------------------------------------------------------ Ran 838 total tests in the following environments and test suites. pass 257 fail 470 xfail 0 skip 111 Environments -------------- - dragonboard-410c - arm64 - hi6220-hikey - arm64 - i386 - juno-r2 - arm64 - qemu_i386 - qemu_x86_64 - x15 - arm - x86_64 Test Suites ----------- * kselftest * kselftest/drivers * kselftest/filesystems * kselftest/net * kselftest/networking * kselftest-vsyscall-mode-native * kselftest-vsyscall-mode-native/drivers * kselftest-vsyscall-mode-native/filesystems * kselftest-vsyscall-mode-native/net * kselftest-vsyscall-mode-native/networking * kselftest-vsyscall-mode-none * kselftest-vsyscall-mode-none/drivers * kselftest-vsyscall-mode-none/filesystems * kselftest-vsyscall-mode-none/net Failures ------------------------------------------------------------------------ qemu_x86_64: * kselftest/bpf_get_cgroup_id_user * kselftest/bpf_test_bpftool.sh * kselftest/bpf_test_dev_cgroup * kselftest/bpf_test_flow_dissector.sh * kselftest/bpf_test_lwt_ip_encap.sh * kselftest/bpf_test_lwt_seg6local.sh * kselftest/bpf_test_maps * kselftest/bpf_test_netcnt * kselftest/bpf_test_progs * kselftest/bpf_test_progs-no_alu32 * kselftest/bpf_test_skb_cgroup_id.sh * kselftest/bpf_test_sock_addr.sh * kselftest/bpf_test_socket_cookie * kselftest/bpf_test_sock_fields * kselftest/bpf_test_sockmap * kselftest/bpf_test_sysctl * kselftest/bpf_test_tc_edt.sh * kselftest/bpf_test_tcpbpf_user * kselftest/bpf_test_tcp_check_syncookie.sh * kselftest/bpf_test_tcpnotify_user * kselftest/bpf_test_tc_tunnel.sh * kselftest/bpf_test_tunnel.sh * kselftest/bpf_test_xdping.sh * kselftest/bpf_test_xdp_meta.sh * kselftest/bpf_test_xdp_redirect.sh * kselftest/bpf_test_xdp_vlan_mode_generic.sh * kselftest/bpf_test_xdp_vlan_mode_native.sh * kselftest/cpufreq_main.sh * kselftest/firmware_fw_run_tests.sh * kselftest/ftrace_ftracetest * kselftest/kvm_clear_dirty_log_test * kselftest/kvm_cr4_cpuid_sync_test * kselftest/kvm_dirty_log_test * kselftest/kvm_evmcs_test * kselftest/kvm_hyperv_cpuid * kselftest/kvm_kvm_create_max_vcpus * kselftest/kvm_platform_info_test * kselftest/kvm_set_sregs_test * kselftest/kvm_smm_test * kselftest/kvm_state_test * kselftest/kvm_svm_vmcall_test * kselftest/kvm_sync_regs_test * kselftest/kvm_xss_msr_test * kselftest/lib_printf.sh * kselftest/lkdtm_ACCESS_NULL.sh * kselftest/lkdtm_ACCESS_USERSPACE.sh * kselftest/lkdtm_BUG.sh * kselftest/lkdtm_CFI_FORWARD_PROTO.sh * kselftest/lkdtm_CORRUPT_LIST_ADD.sh * kselftest/lkdtm_CORRUPT_LIST_DEL.sh * kselftest/lkdtm_CORRUPT_USER_DS.sh * kselftest/lkdtm_EXCEPTION.sh * kselftest/lkdtm_EXEC_DATA.sh * kselftest/lkdtm_EXEC_KMALLOC.sh * kselftest/lkdtm_EXEC_NULL.sh * kselftest/lkdtm_EXEC_RODATA.sh * kselftest/lkdtm_EXEC_STACK.sh * kselftest/lkdtm_EXEC_USERSPACE.sh * kselftest/lkdtm_EXEC_VMALLOC.sh * kselftest/lkdtm_READ_AFTER_FREE.sh * kselftest/lkdtm_READ_BUDDY_AFTER_FREE.sh * kselftest/lkdtm_REFCOUNT_ADD_NOT_ZERO_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_ADD_NOT_ZERO_SATURATED.sh * kselftest/lkdtm_REFCOUNT_ADD_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_ADD_SATURATED.sh * kselftest/lkdtm_REFCOUNT_ADD_ZERO.sh * kselftest/lkdtm_REFCOUNT_DEC_AND_TEST_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_DEC_AND_TEST_SATURATED.sh * kselftest/lkdtm_REFCOUNT_DEC_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_DEC_SATURATED.sh * kselftest/lkdtm_REFCOUNT_DEC_ZERO.sh * kselftest/lkdtm_REFCOUNT_INC_NOT_ZERO_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_INC_NOT_ZERO_SATURATED.sh * kselftest/lkdtm_REFCOUNT_INC_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_INC_SATURATED.sh * kselftest/lkdtm_REFCOUNT_INC_ZERO.sh * kselftest/lkdtm_REFCOUNT_SUB_AND_TEST_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_SUB_AND_TEST_SATURATED.sh * kselftest/lkdtm_SLAB_FREE_CROSS.sh * kselftest/lkdtm_SLAB_FREE_DOUBLE.sh * kselftest/lkdtm_SLAB_FREE_PAGE.sh * kselftest/lkdtm_STACK_GUARD_PAGE_LEADING.sh * kselftest/lkdtm_STACK_GUARD_PAGE_TRAILING.sh * kselftest/lkdtm_STACKLEAK_ERASING.sh * kselftest/lkdtm_UNALIGNED_LOAD_STORE_WRITE.sh * kselftest/lkdtm_UNSET_SMEP.sh * kselftest/lkdtm_USERCOPY_HEAP_SIZE_FROM.sh * kselftest/lkdtm_USERCOPY_HEAP_SIZE_TO.sh * kselftest/lkdtm_USERCOPY_HEAP_WHITELIST_FROM.sh * kselftest/lkdtm_USERCOPY_HEAP_WHITELIST_TO.sh * kselftest/lkdtm_USERCOPY_KERNEL_DS.sh * kselftest/lkdtm_USERCOPY_KERNEL.sh * kselftest/lkdtm_USERCOPY_STACK_BEYOND.sh * kselftest/lkdtm_USERCOPY_STACK_FRAME_FROM.sh * kselftest/lkdtm_USERCOPY_STACK_FRAME_TO.sh * kselftest/lkdtm_WARNING_MESSAGE.sh * kselftest/lkdtm_WARNING.sh * kselftest/lkdtm_WRITE_KERN.sh * kselftest/lkdtm_WRITE_RO_AFTER_INIT.sh * kselftest/lkdtm_WRITE_RO.sh * kselftest/mqueue_mq_perf_tests * kselftest/net_fib-onlink-tests.sh * kselftest/net_fib_tests.sh * kselftest/netfilter_nft_concat_range.sh * kselftest/net_ip_defrag.sh * kselftest/net_l2tp.sh * kselftest/net_pmtu.sh * kselftest/net_psock_snd.sh * kselftest/net_run_netsocktests * kselftest/net_test_vxlan_under_vrf.sh * kselftest/net_udpgro_bench.sh * kselftest/net_udpgro.sh * kselftest/net_udpgso_bench.sh * kselftest/net_xfrm_policy.sh * kselftest/networking/timestamping_txtimestamp.sh x86: * kselftest-vsyscall-mode-none/bpf_get_cgroup_id_user * kselftest-vsyscall-mode-native/bpf_get_cgroup_id_user * kselftest/bpf_get_cgroup_id_user * kselftest-vsyscall-mode-native/bpf_test_bpftool.sh * kselftest-vsyscall-mode-none/bpf_test_bpftool.sh * kselftest/bpf_test_bpftool.sh * kselftest/bpf_test_dev_cgroup * kselftest-vsyscall-mode-none/bpf_test_dev_cgroup * kselftest-vsyscall-mode-native/bpf_test_dev_cgroup * kselftest-vsyscall-mode-none/bpf_test_flow_dissector.sh * kselftest-vsyscall-mode-native/bpf_test_flow_dissector.sh * kselftest/bpf_test_flow_dissector.sh * kselftest/bpf_test_lwt_ip_encap.sh * kselftest-vsyscall-mode-native/bpf_test_lwt_ip_encap.sh * kselftest-vsyscall-mode-none/bpf_test_lwt_ip_encap.sh * kselftest/bpf_test_lwt_seg6local.sh * kselftest-vsyscall-mode-none/bpf_test_lwt_seg6local.sh * kselftest-vsyscall-mode-native/bpf_test_lwt_seg6local.sh * kselftest-vsyscall-mode-none/bpf_test_maps * kselftest-vsyscall-mode-native/bpf_test_maps * kselftest/bpf_test_maps * kselftest/bpf_test_netcnt * kselftest-vsyscall-mode-none/bpf_test_netcnt * kselftest-vsyscall-mode-native/bpf_test_netcnt * kselftest-vsyscall-mode-none/bpf_test_progs * kselftest-vsyscall-mode-native/bpf_test_progs * kselftest/bpf_test_progs * kselftest/bpf_test_progs-no_alu32 * kselftest-vsyscall-mode-native/bpf_test_progs-no_alu32 * kselftest-vsyscall-mode-none/bpf_test_progs-no_alu32 * kselftest/bpf_test_skb_cgroup_id.sh * kselftest-vsyscall-mode-native/bpf_test_skb_cgroup_id.sh * kselftest-vsyscall-mode-none/bpf_test_skb_cgroup_id.sh * kselftest-vsyscall-mode-native/bpf_test_sock_addr.sh * kselftest/bpf_test_sock_addr.sh * kselftest-vsyscall-mode-none/bpf_test_sock_addr.sh * kselftest-vsyscall-mode-native/bpf_test_socket_cookie * kselftest-vsyscall-mode-none/bpf_test_socket_cookie * kselftest/bpf_test_socket_cookie * kselftest/bpf_test_sock_fields * kselftest-vsyscall-mode-native/bpf_test_sock_fields * kselftest-vsyscall-mode-none/bpf_test_sock_fields * kselftest/bpf_test_sockmap * kselftest-vsyscall-mode-none/bpf_test_sockmap * kselftest-vsyscall-mode-native/bpf_test_sockmap * kselftest/bpf_test_sysctl * kselftest-vsyscall-mode-native/bpf_test_sysctl * kselftest-vsyscall-mode-none/bpf_test_sysctl * kselftest-vsyscall-mode-native/bpf_test_tc_edt.sh * kselftest/bpf_test_tc_edt.sh * kselftest-vsyscall-mode-none/bpf_test_tc_edt.sh * kselftest/bpf_test_tcpbpf_user * kselftest-vsyscall-mode-native/bpf_test_tcpbpf_user * kselftest-vsyscall-mode-none/bpf_test_tcpbpf_user * kselftest-vsyscall-mode-none/bpf_test_tcp_check_syncookie.sh * kselftest/bpf_test_tcp_check_syncookie.sh * kselftest-vsyscall-mode-native/bpf_test_tcp_check_syncookie.sh * kselftest-vsyscall-mode-none/bpf_test_tcpnotify_user * kselftest-vsyscall-mode-native/bpf_test_tcpnotify_user * kselftest/bpf_test_tcpnotify_user * kselftest-vsyscall-mode-none/bpf_test_tc_tunnel.sh * kselftest-vsyscall-mode-native/bpf_test_tc_tunnel.sh * kselftest/bpf_test_tc_tunnel.sh * kselftest/bpf_test_tunnel.sh * kselftest-vsyscall-mode-none/bpf_test_tunnel.sh * kselftest-vsyscall-mode-native/bpf_test_tunnel.sh * kselftest/bpf_test_xdping.sh * kselftest-vsyscall-mode-native/bpf_test_xdping.sh * kselftest-vsyscall-mode-none/bpf_test_xdping.sh * kselftest-vsyscall-mode-native/bpf_test_xdp_meta.sh * kselftest/bpf_test_xdp_meta.sh * kselftest-vsyscall-mode-none/bpf_test_xdp_meta.sh * kselftest-vsyscall-mode-none/bpf_test_xdp_redirect.sh * kselftest/bpf_test_xdp_redirect.sh * kselftest-vsyscall-mode-native/bpf_test_xdp_redirect.sh * kselftest-vsyscall-mode-none/bpf_test_xdp_vlan_mode_generic.sh * kselftest/bpf_test_xdp_vlan_mode_generic.sh * kselftest-vsyscall-mode-native/bpf_test_xdp_vlan_mode_generic.sh * kselftest/bpf_test_xdp_vlan_mode_native.sh * kselftest-vsyscall-mode-native/bpf_test_xdp_vlan_mode_native.sh * kselftest/firmware_fw_run_tests.sh * kselftest-vsyscall-mode-none/firmware_fw_run_tests.sh * kselftest-vsyscall-mode-native/firmware_fw_run_tests.sh * kselftest-vsyscall-mode-none/ftrace_ftracetest * kselftest-vsyscall-mode-native/ftrace_ftracetest * kselftest/ftrace_ftracetest * kselftest-vsyscall-mode-none/intel_pstate_run.sh * kselftest/intel_pstate_run.sh * kselftest-vsyscall-mode-native/kvm_clear_dirty_log_test * kselftest/kvm_clear_dirty_log_test * kselftest-vsyscall-mode-none/kvm_clear_dirty_log_test * kselftest-vsyscall-mode-native/kvm_cr4_cpuid_sync_test * kselftest-vsyscall-mode-none/kvm_cr4_cpuid_sync_test * kselftest/kvm_cr4_cpuid_sync_test * kselftest-vsyscall-mode-native/kvm_dirty_log_test * kselftest/kvm_dirty_log_test * kselftest-vsyscall-mode-none/kvm_dirty_log_test * kselftest-vsyscall-mode-none/kvm_evmcs_test * kselftest/kvm_evmcs_test * kselftest-vsyscall-mode-native/kvm_evmcs_test * kselftest-vsyscall-mode-none/kvm_hyperv_cpuid * kselftest/kvm_hyperv_cpuid * kselftest-vsyscall-mode-native/kvm_hyperv_cpuid * kselftest-vsyscall-mode-none/kvm_kvm_create_max_vcpus * kselftest-vsyscall-mode-native/kvm_kvm_create_max_vcpus * kselftest/kvm_kvm_create_max_vcpus * kselftest-vsyscall-mode-none/kvm_platform_info_test * kselftest-vsyscall-mode-native/kvm_platform_info_test * kselftest/kvm_platform_info_test * kselftest-vsyscall-mode-none/kvm_set_sregs_test * kselftest/kvm_set_sregs_test * kselftest-vsyscall-mode-native/kvm_set_sregs_test * kselftest/kvm_smm_test * kselftest-vsyscall-mode-native/kvm_smm_test * kselftest-vsyscall-mode-none/kvm_smm_test * kselftest-vsyscall-mode-native/kvm_state_test * kselftest-vsyscall-mode-none/kvm_state_test * kselftest/kvm_state_test * kselftest/kvm_sync_regs_test * kselftest-vsyscall-mode-native/kvm_sync_regs_test * kselftest-vsyscall-mode-none/kvm_sync_regs_test * kselftest-vsyscall-mode-native/kvm_vmx_close_while_nested_test * kselftest/kvm_vmx_close_while_nested_test * kselftest-vsyscall-mode-none/kvm_vmx_close_while_nested_test * kselftest-vsyscall-mode-native/kvm_vmx_dirty_log_test * kselftest-vsyscall-mode-none/kvm_vmx_dirty_log_test * kselftest/kvm_vmx_dirty_log_test * kselftest/kvm_vmx_set_nested_state_test * kselftest-vsyscall-mode-none/kvm_vmx_set_nested_state_test * kselftest-vsyscall-mode-native/kvm_vmx_set_nested_state_test * kselftest/kvm_vmx_tsc_adjust_test * kselftest-vsyscall-mode-native/kvm_vmx_tsc_adjust_test * kselftest-vsyscall-mode-none/kvm_vmx_tsc_adjust_test * kselftest-vsyscall-mode-native/kvm_xss_msr_test * kselftest-vsyscall-mode-none/kvm_xss_msr_test * kselftest/kvm_xss_msr_test * kselftest-vsyscall-mode-native/lib_printf.sh * kselftest-vsyscall-mode-none/lib_printf.sh * kselftest/lib_printf.sh * kselftest-vsyscall-mode-none/lkdtm_ACCESS_NULL.sh * kselftest-vsyscall-mode-native/lkdtm_ACCESS_NULL.sh * kselftest/lkdtm_ACCESS_NULL.sh * kselftest-vsyscall-mode-native/lkdtm_ACCESS_USERSPACE.sh * kselftest/lkdtm_ACCESS_USERSPACE.sh * kselftest-vsyscall-mode-none/lkdtm_ACCESS_USERSPACE.sh * kselftest/lkdtm_BUG.sh * kselftest-vsyscall-mode-native/lkdtm_BUG.sh * kselftest-vsyscall-mode-none/lkdtm_BUG.sh * kselftest-vsyscall-mode-native/lkdtm_CFI_FORWARD_PROTO.sh * kselftest-vsyscall-mode-none/lkdtm_CFI_FORWARD_PROTO.sh * kselftest/lkdtm_CFI_FORWARD_PROTO.sh * kselftest-vsyscall-mode-native/lkdtm_CORRUPT_LIST_ADD.sh * kselftest/lkdtm_CORRUPT_LIST_ADD.sh * kselftest-vsyscall-mode-none/lkdtm_CORRUPT_LIST_ADD.sh * kselftest-vsyscall-mode-native/lkdtm_CORRUPT_LIST_DEL.sh * kselftest-vsyscall-mode-none/lkdtm_CORRUPT_LIST_DEL.sh * kselftest/lkdtm_CORRUPT_LIST_DEL.sh * kselftest-vsyscall-mode-none/lkdtm_CORRUPT_USER_DS.sh * kselftest/lkdtm_CORRUPT_USER_DS.sh * kselftest-vsyscall-mode-native/lkdtm_CORRUPT_USER_DS.sh * kselftest-vsyscall-mode-native/lkdtm_EXCEPTION.sh * kselftest-vsyscall-mode-none/lkdtm_EXCEPTION.sh * kselftest/lkdtm_EXCEPTION.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_DATA.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_DATA.sh * kselftest/lkdtm_EXEC_DATA.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_KMALLOC.sh * kselftest/lkdtm_EXEC_KMALLOC.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_KMALLOC.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_NULL.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_NULL.sh * kselftest/lkdtm_EXEC_NULL.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_RODATA.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_RODATA.sh * kselftest/lkdtm_EXEC_RODATA.sh * kselftest/lkdtm_EXEC_STACK.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_STACK.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_STACK.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_USERSPACE.sh * kselftest/lkdtm_EXEC_USERSPACE.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_USERSPACE.sh * kselftest-vsyscall-mode-none/lkdtm_EXEC_VMALLOC.sh * kselftest-vsyscall-mode-native/lkdtm_EXEC_VMALLOC.sh * kselftest/lkdtm_EXEC_VMALLOC.sh * kselftest/lkdtm_READ_AFTER_FREE.sh * kselftest-vsyscall-mode-none/lkdtm_READ_AFTER_FREE.sh * kselftest-vsyscall-mode-native/lkdtm_READ_AFTER_FREE.sh * kselftest/lkdtm_READ_BUDDY_AFTER_FREE.sh * kselftest-vsyscall-mode-native/lkdtm_READ_BUDDY_AFTER_FREE.sh * kselftest-vsyscall-mode-none/lkdtm_READ_BUDDY_AFTER_FREE.sh * kselftest/lkdtm_REFCOUNT_ADD_NOT_ZERO_OVERFLOW.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_ADD_NOT_ZERO_OVERFLOW.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_ADD_NOT_ZERO_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_ADD_NOT_ZERO_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_ADD_NOT_ZERO_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_ADD_NOT_ZERO_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_ADD_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_ADD_OVERFLOW.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_ADD_OVERFLOW.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_ADD_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_ADD_SATURATED.sh * kselftest/lkdtm_REFCOUNT_ADD_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_ADD_ZERO.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_ADD_ZERO.sh * kselftest/lkdtm_REFCOUNT_ADD_ZERO.sh * kselftest/lkdtm_REFCOUNT_DEC_AND_TEST_NEGATIVE.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_DEC_AND_TEST_NEGATIVE.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_DEC_AND_TEST_NEGATIVE.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_DEC_AND_TEST_SATURATED.sh * kselftest/lkdtm_REFCOUNT_DEC_AND_TEST_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_DEC_AND_TEST_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_DEC_NEGATIVE.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_DEC_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_DEC_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_DEC_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_DEC_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_DEC_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_DEC_ZERO.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_DEC_ZERO.sh * kselftest/lkdtm_REFCOUNT_DEC_ZERO.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_INC_NOT_ZERO_OVERFLOW.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_INC_NOT_ZERO_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_INC_NOT_ZERO_OVERFLOW.sh * kselftest/lkdtm_REFCOUNT_INC_NOT_ZERO_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_INC_NOT_ZERO_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_INC_NOT_ZERO_SATURATED.sh * kselftest/lkdtm_REFCOUNT_INC_OVERFLOW.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_INC_OVERFLOW.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_INC_OVERFLOW.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_INC_SATURATED.sh * kselftest/lkdtm_REFCOUNT_INC_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_INC_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_INC_ZERO.sh * kselftest/lkdtm_REFCOUNT_INC_ZERO.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_INC_ZERO.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_SUB_AND_TEST_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_SUB_AND_TEST_NEGATIVE.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_SUB_AND_TEST_NEGATIVE.sh * kselftest/lkdtm_REFCOUNT_SUB_AND_TEST_SATURATED.sh * kselftest-vsyscall-mode-native/lkdtm_REFCOUNT_SUB_AND_TEST_SATURATED.sh * kselftest-vsyscall-mode-none/lkdtm_REFCOUNT_SUB_AND_TEST_SATURATED.sh * kselftest/lkdtm_SLAB_FREE_CROSS.sh * kselftest-vsyscall-mode-native/lkdtm_SLAB_FREE_CROSS.sh * kselftest-vsyscall-mode-none/lkdtm_SLAB_FREE_CROSS.sh * kselftest/lkdtm_SLAB_FREE_DOUBLE.sh * kselftest-vsyscall-mode-none/lkdtm_SLAB_FREE_DOUBLE.sh * kselftest-vsyscall-mode-native/lkdtm_SLAB_FREE_DOUBLE.sh * kselftest-vsyscall-mode-none/lkdtm_SLAB_FREE_PAGE.sh * kselftest/lkdtm_SLAB_FREE_PAGE.sh * kselftest-vsyscall-mode-native/lkdtm_SLAB_FREE_PAGE.sh * kselftest-vsyscall-mode-native/lkdtm_STACK_GUARD_PAGE_LEADING.sh * kselftest-vsyscall-mode-none/lkdtm_STACK_GUARD_PAGE_LEADING.sh * kselftest/lkdtm_STACK_GUARD_PAGE_LEADING.sh * kselftest/lkdtm_STACK_GUARD_PAGE_TRAILING.sh * kselftest-vsyscall-mode-native/lkdtm_STACK_GUARD_PAGE_TRAILING.sh * kselftest-vsyscall-mode-none/lkdtm_STACK_GUARD_PAGE_TRAILING.sh * kselftest/lkdtm_STACKLEAK_ERASING.sh * kselftest-vsyscall-mode-none/lkdtm_STACKLEAK_ERASING.sh * kselftest-vsyscall-mode-native/lkdtm_STACKLEAK_ERASING.sh * kselftest/lkdtm_UNALIGNED_LOAD_STORE_WRITE.sh * kselftest-vsyscall-mode-native/lkdtm_UNALIGNED_LOAD_STORE_WRITE.sh * kselftest-vsyscall-mode-none/lkdtm_UNALIGNED_LOAD_STORE_WRITE.sh * kselftest-vsyscall-mode-native/lkdtm_UNSET_SMEP.sh * kselftest-vsyscall-mode-none/lkdtm_UNSET_SMEP.sh * kselftest/lkdtm_UNSET_SMEP.sh * kselftest/lkdtm_USERCOPY_HEAP_SIZE_FROM.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_HEAP_SIZE_FROM.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_HEAP_SIZE_FROM.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_HEAP_SIZE_TO.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_HEAP_SIZE_TO.sh * kselftest/lkdtm_USERCOPY_HEAP_SIZE_TO.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_HEAP_WHITELIST_FROM.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_HEAP_WHITELIST_FROM.sh * kselftest/lkdtm_USERCOPY_HEAP_WHITELIST_FROM.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_HEAP_WHITELIST_TO.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_HEAP_WHITELIST_TO.sh * kselftest/lkdtm_USERCOPY_HEAP_WHITELIST_TO.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_KERNEL_DS.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_KERNEL_DS.sh * kselftest/lkdtm_USERCOPY_KERNEL_DS.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_KERNEL.sh * kselftest/lkdtm_USERCOPY_KERNEL.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_KERNEL.sh * kselftest/lkdtm_USERCOPY_STACK_BEYOND.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_STACK_BEYOND.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_STACK_BEYOND.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_STACK_FRAME_FROM.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_STACK_FRAME_FROM.sh * kselftest/lkdtm_USERCOPY_STACK_FRAME_FROM.sh * kselftest-vsyscall-mode-native/lkdtm_USERCOPY_STACK_FRAME_TO.sh * kselftest-vsyscall-mode-none/lkdtm_USERCOPY_STACK_FRAME_TO.sh * kselftest/lkdtm_USERCOPY_STACK_FRAME_TO.sh * kselftest-vsyscall-mode-native/lkdtm_WARNING_MESSAGE.sh * kselftest-vsyscall-mode-none/lkdtm_WARNING_MESSAGE.sh * kselftest/lkdtm_WARNING_MESSAGE.sh * kselftest/lkdtm_WARNING.sh * kselftest-vsyscall-mode-none/lkdtm_WARNING.sh * kselftest-vsyscall-mode-native/lkdtm_WARNING.sh * kselftest/lkdtm_WRITE_KERN.sh * kselftest-vsyscall-mode-none/lkdtm_WRITE_KERN.sh * kselftest-vsyscall-mode-native/lkdtm_WRITE_KERN.sh * kselftest/lkdtm_WRITE_RO_AFTER_INIT.sh * kselftest-vsyscall-mode-none/lkdtm_WRITE_RO_AFTER_INIT.sh * kselftest-vsyscall-mode-native/lkdtm_WRITE_RO_AFTER_INIT.sh * kselftest-vsyscall-mode-native/lkdtm_WRITE_RO.sh * kselftest/lkdtm_WRITE_RO.sh * kselftest-vsyscall-mode-none/lkdtm_WRITE_RO.sh * kselftest-vsyscall-mode-none/net/mptcp_mptcp_connect.sh * kselftest-vsyscall-mode-native/mqueue_mq_perf_tests * kselftest/mqueue_mq_perf_tests * kselftest-vsyscall-mode-none/mqueue_mq_perf_tests * kselftest-vsyscall-mode-native/net_fib-onlink-tests.sh * kselftest-vsyscall-mode-none/net_fib-onlink-tests.sh * kselftest/net_fib-onlink-tests.sh * kselftest-vsyscall-mode-native/net_fib_tests.sh * kselftest/net_fib_tests.sh * kselftest-vsyscall-mode-none/net_fib_tests.sh * kselftest/netfilter_nft_concat_range.sh * kselftest-vsyscall-mode-native/netfilter_nft_concat_range.sh * kselftest-vsyscall-mode-none/netfilter_nft_concat_range.sh * kselftest/net_ip_defrag.sh * kselftest-vsyscall-mode-native/net_ip_defrag.sh * kselftest-vsyscall-mode-none/net_ip_defrag.sh * kselftest-vsyscall-mode-native/net_l2tp.sh * kselftest-vsyscall-mode-none/net_l2tp.sh * kselftest/net_l2tp.sh * kselftest/net_pmtu.sh * kselftest-vsyscall-mode-native/net_pmtu.sh * kselftest-vsyscall-mode-none/net_pmtu.sh * kselftest-vsyscall-mode-none/net_psock_snd.sh * kselftest-vsyscall-mode-native/net_psock_snd.sh * kselftest/net_psock_snd.sh * kselftest/net_run_netsocktests * kselftest-vsyscall-mode-native/net_run_netsocktests * kselftest-vsyscall-mode-none/net_run_netsocktests * kselftest-vsyscall-mode-none/net_test_vxlan_under_vrf.sh * kselftest-vsyscall-mode-native/net_test_vxlan_under_vrf.sh * kselftest/net_test_vxlan_under_vrf.sh * kselftest-vsyscall-mode-native/net_traceroute.sh * kselftest-vsyscall-mode-none/net_traceroute.sh * kselftest/net_traceroute.sh * kselftest-vsyscall-mode-native/net_udpgro_bench.sh * kselftest-vsyscall-mode-none/net_udpgro_bench.sh * kselftest/net_udpgro_bench.sh * kselftest/net_udpgro.sh * kselftest-vsyscall-mode-none/net_udpgro.sh * kselftest-vsyscall-mode-native/net_udpgro.sh * kselftest/net_udpgso_bench.sh * kselftest-vsyscall-mode-none/net_udpgso_bench.sh * kselftest-vsyscall-mode-native/net_udpgso_bench.sh * kselftest-vsyscall-mode-native/net_xfrm_policy.sh * kselftest/net_xfrm_policy.sh * kselftest-vsyscall-mode-none/net_xfrm_policy.sh * kselftest/networking/timestamping_txtimestamp.sh * kselftest-vsyscall-mode-native/networking/timestamping_txtimestamp.sh hi6220-hikey: qemu_i386: i386: x15: dragonboard-410c: juno-r2: Skips ------------------------------------------------------------------------ No skips -- Linaro LKFT https://lkft.linaro.org

4 years, 9 months

1
0
0 0

[PATCH] selftests/ftrace: Fix typo in trigger-multihist.tc

by Masanari Iida

This patch fix a spelling typo in trigger-multihist.tc Signed-off-by: Masanari Iida <standby24x7(a)gmail.com> --- .../selftests/ftrace/test.d/trigger/trigger-multihist.tc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tools/testing/selftests/ftrace/test.d/trigger/trigger-multihist.tc b/tools/testing/selftests/ftrace/test.d/trigger/trigger-multihist.tc index 18fdaab9f570..68ff3f45c720 100644 --- a/tools/testing/selftests/ftrace/test.d/trigger/trigger-multihist.tc +++ b/tools/testing/selftests/ftrace/test.d/trigger/trigger-multihist.tc @@ -23,7 +23,7 @@ if [ ! -f events/sched/sched_process_fork/hist ]; then exit_unsupported fi -echo "Test histogram multiple tiggers" +echo "Test histogram multiple triggers" echo 'hist:keys=parent_pid:vals=child_pid' > events/sched/sched_process_fork/trigger echo 'hist:keys=parent_comm:vals=child_pid' >> events/sched/sched_process_fork/trigger -- 2.26.0.rc0

4 years, 9 months

3
2
0 0

[PATCH v6 kunit-next 0/4] kunit: add debugfs representation to show results

by Alan Maguire

When kunit tests are run on native (i.e. non-UML) environments, the results of test execution are often intermixed with dmesg output. This patch series attempts to solve this by providing a debugfs representation of the results of the last test run, available as /sys/kernel/debug/kunit/<testsuite>/results Changes since v5: - replaced undefined behaviour use of snprintf(buf, ..., buf) in kunit_log() with a function to append string to existing log (Frank, patch 1) - added clarification on log size limitations to documentation (Frank, patch 4) Changes since v4: - added suite-level log expectations to kunit log test (Brendan, patch 2) - added log expectations (of it being NULL) for case where CONFIG_KUNIT_DEBUGFS=n to kunit log test (patch 2) - added patch 3 which replaces subtest tab indentation with 4 space indentation as per TAP 14 spec (Frank, patch 3) Changes since v3: - added CONFIG_KUNIT_DEBUGFS to support conditional compilation of debugfs representation, including string logging (Frank, patch 1) - removed unneeded NULL check for test_case in kunit_suite_for_each_test_case() (Frank, patch 1) - added kunit log test to verify logging multiple strings works (Frank, patch 2) - rephrased description of results file (Frank, patch 3) Changes since v2: - updated kunit_status2str() to kunit_status_to_string() and made it static inline in include/kunit/test.h (Brendan) - added log string to struct kunit_suite and kunit_case, with log pointer in struct kunit pointing at the case log. This allows us to collect kunit_[err|info|warning]() messages at the same time as we printk() them. This solves for the most part the sharing of log messages between test execution and debugfs since we just print the suite log (which contains the test suite preamble) and the individual test logs. The only exception is the suite-level status, which we cannot store in the suite log as it would mean we'd print the suite and its status prior to the suite's results. (Brendan, patch 1) - dropped debugfs-based kunit run patch for now so as not to cause problems with tests currently under development (Brendan) - fixed doc issues with code block (Brendan, patch 3) Changes since v1: - trimmed unneeded include files in lib/kunit/debugfs.c (Greg) - renamed global debugfs functions to be prefixed with kunit_ (Greg) - removed error checking for debugfs operations (Greg) Alan Maguire (4): kunit: add debugfs /sys/kernel/debug/kunit/<suite>/results display kunit: add log test kunit: subtests should be indented 4 spaces according to TAP kunit: update documentation to describe debugfs representation Documentation/dev-tools/kunit/usage.rst | 14 +++ include/kunit/test.h | 59 +++++++++++-- lib/kunit/Kconfig | 8 ++ lib/kunit/Makefile | 4 + lib/kunit/assert.c | 79 ++++++++--------- lib/kunit/debugfs.c | 116 +++++++++++++++++++++++++ lib/kunit/debugfs.h | 30 +++++++ lib/kunit/kunit-test.c | 45 +++++++++- lib/kunit/test.c | 147 +++++++++++++++++++++++++------- 9 files changed, 421 insertions(+), 81 deletions(-) create mode 100644 lib/kunit/debugfs.c create mode 100644 lib/kunit/debugfs.h -- 1.8.3.1

4 years, 9 months

3
6
0 0

[RFC PATCH kunit-next] kunit: kunit_tool: Separate out config/build/exec/parse

by David Gow

Add new subcommands to kunit.py to allow stages of the existing 'run' subcommand to be run independently: - 'config': Verifies that .config is a subset of .kunitconfig - 'build': Compiles a UML kernel for KUnit - 'exec': Runs the kernel, and outputs the test results. - 'parse': Parses test results from a file or stdin Most of these are not hugely useful by themselves yet, and there's room for plenty of bikeshedding on the names, but this hopefully can form a foundation for future improvements. Signed-off-by: David Gow <davidgow(a)google.com> --- As was briefly disccussed in [1], this change is part of a "separation of concerns" in kunit_tool. This should make it easier to integrate kunit_tool into other setups. Of particular intrest is probably 'kunit.py parse', which should allow KUnit results to be parsed from other sources, such as after loading a module, or from a non-UML kernel, or from debugfs when that's supported[2]. [1]: https://lkml.org/lkml/2020/2/5/552 [2]: https://patchwork.kernel.org/patch/11419901/ tools/testing/kunit/kunit.py | 236 ++++++++++++++++++++----- tools/testing/kunit/kunit_tool_test.py | 55 ++++++ 2 files changed, 242 insertions(+), 49 deletions(-) diff --git a/tools/testing/kunit/kunit.py b/tools/testing/kunit/kunit.py index 180ad1e1b04f..92a634594cf6 100755 --- a/tools/testing/kunit/kunit.py +++ b/tools/testing/kunit/kunit.py @@ -20,8 +20,12 @@ import kunit_config import kunit_kernel import kunit_parser -KunitResult = namedtuple('KunitResult', ['status','result']) +KunitResult = namedtuple('KunitResult', ['status','result','elapsed_time']) +KunitConfigRequest = namedtuple('KunitConfigRequest', ['build_dir', 'defconfig']) +KunitBuildRequest = namedtuple('KunitBuildRequest', ['jobs', 'build_dir']) +KunitExecRequest = namedtuple('KunitExecRequest', ['timeout', 'build_dir']) +KunitParseRequest = namedtuple('KunitParseRequest', ['raw_output', 'input_data']) KunitRequest = namedtuple('KunitRequest', ['raw_output','timeout', 'jobs', 'build_dir', 'defconfig']) KernelDirectoryPath = sys.argv[0].split('tools/testing/kunit/')[0] @@ -44,14 +48,25 @@ def get_kernel_root_path(): sys.exit(1) return parts[0] -def run_tests(linux: kunit_kernel.LinuxSourceTree, - request: KunitRequest) -> KunitResult: +def config_tests(linux: kunit_kernel.LinuxSourceTree, + request: KunitConfigRequest) -> KunitResult: + kunit_parser.print_with_timestamp('Configuring KUnit Kernel ...') + config_start = time.time() + if request.defconfig: + create_default_kunitconfig() success = linux.build_reconfig(request.build_dir) config_end = time.time() if not success: - return KunitResult(KunitStatus.CONFIG_FAILURE, 'could not configure kernel') + return KunitResult(KunitStatus.CONFIG_FAILURE, + 'could not configure kernel', + config_end - config_start) + return KunitResult(KunitStatus.SUCCESS, + 'configured kernel successfully', + config_end - config_start) +def build_tests(linux: kunit_kernel.LinuxSourceTree, + request: KunitBuildRequest) -> KunitResult: kunit_parser.print_with_timestamp('Building KUnit Kernel ...') build_start = time.time() @@ -59,73 +74,156 @@ def run_tests(linux: kunit_kernel.LinuxSourceTree, build_end = time.time() if not success: return KunitResult(KunitStatus.BUILD_FAILURE, 'could not build kernel') + if not success: + return KunitResult(KunitStatus.BUILD_FAILURE, + 'could not build kernel', + build_end - build_start) + return KunitResult(KunitStatus.SUCCESS, + 'built kernel successfully', + build_end - build_start) +def exec_tests(linux: kunit_kernel.LinuxSourceTree, + request: KunitExecRequest) -> KunitResult: kunit_parser.print_with_timestamp('Starting KUnit Kernel ...') test_start = time.time() + result = linux.run_kernel(timeout=request.timeout, + build_dir=request.build_dir) + test_end = time.time() + + return KunitResult(KunitStatus.SUCCESS, + result, + test_end - test_start) + +def parse_tests(request: KunitParseRequest) -> KunitResult: + parse_start = time.time() + test_result = kunit_parser.TestResult(kunit_parser.TestStatus.SUCCESS, [], 'Tests not Parsed.') if request.raw_output: - kunit_parser.raw_output( - linux.run_kernel(timeout=request.timeout, - build_dir=request.build_dir)) + kunit_parser.raw_output(request.input_data) else: - kunit_output = linux.run_kernel(timeout=request.timeout, - build_dir=request.build_dir) - test_result = kunit_parser.parse_run_tests(kunit_output) - test_end = time.time() + test_result = kunit_parser.parse_run_tests(request.input_data) + parse_end = time.time() + + if test_result.status != kunit_parser.TestStatus.SUCCESS: + return KunitResult(KunitStatus.TEST_FAILURE, test_result, + parse_end - parse_start) + + return KunitResult(KunitStatus.SUCCESS, test_result, + parse_end - parse_start) + + +def run_tests(linux: kunit_kernel.LinuxSourceTree, + request: KunitRequest) -> KunitResult: + run_start = time.time() + + config_request = KunitConfigRequest(request.build_dir, request.defconfig) + config_result = config_tests(linux, config_request) + if config_result.status != KunitStatus.SUCCESS: + return config_result + + build_request = KunitBuildRequest(request.jobs, request.build_dir) + build_result = build_tests(linux, build_request) + if build_result.status != KunitStatus.SUCCESS: + return build_result + + exec_request = KunitExecRequest(request.timeout, request.build_dir) + exec_result = exec_tests(linux, exec_request) + if exec_result.status != KunitStatus.SUCCESS: + return exec_result + + parse_request = KunitParseRequest(request.raw_output, exec_result.result) + parse_result = parse_tests(parse_request) + + run_end = time.time() kunit_parser.print_with_timestamp(( 'Elapsed time: %.3fs total, %.3fs configuring, %.3fs ' + 'building, %.3fs running\n') % ( - test_end - config_start, - config_end - config_start, - build_end - build_start, - test_end - test_start)) + run_end - run_start, + config_result.elapsed_time, + build_result.elapsed_time, + exec_result.elapsed_time)) + return parse_result + +def add_common_opts(parser): + parser.add_argument('--build_dir', + help='As in the make command, it specifies the build ' + 'directory.', + type=str, default='', metavar='build_dir') + +def add_config_opts(parser): + parser.add_argument('--defconfig', + help='Uses a default .kunitconfig.', + action='store_true') + +def add_build_opts(parser): + parser.add_argument('--jobs', + help='As in the make command, "Specifies the number of ' + 'jobs (commands) to run simultaneously."', + type=int, default=8, metavar='jobs') + +def add_exec_opts(parser): + parser.add_argument('--timeout', + help='maximum number of seconds to allow for all tests ' + 'to run. This does not include time taken to build the ' + 'tests.', + type=int, + default=300, + metavar='timeout') + +def add_parse_opts(parser): + parser.add_argument('--raw_output', help='don\'t format output from kernel', + action='store_true') - if test_result.status != kunit_parser.TestStatus.SUCCESS: - return KunitResult(KunitStatus.TEST_FAILURE, test_result) - else: - return KunitResult(KunitStatus.SUCCESS, test_result) def main(argv, linux=None): parser = argparse.ArgumentParser( description='Helps writing and running KUnit tests.') subparser = parser.add_subparsers(dest='subcommand') + # The 'run' command will config, build, exec, and parse in one go. run_parser = subparser.add_parser('run', help='Runs KUnit tests.') - run_parser.add_argument('--raw_output', help='don\'t format output from kernel', - action='store_true') + add_common_opts(run_parser) + add_config_opts(run_parser) + add_build_opts(run_parser) + add_exec_opts(run_parser) + add_parse_opts(run_parser) - run_parser.add_argument('--timeout', - help='maximum number of seconds to allow for all tests ' - 'to run. This does not include time taken to build the ' - 'tests.', - type=int, - default=300, - metavar='timeout') - - run_parser.add_argument('--jobs', - help='As in the make command, "Specifies the number of ' - 'jobs (commands) to run simultaneously."', - type=int, default=8, metavar='jobs') - - run_parser.add_argument('--build_dir', - help='As in the make command, it specifies the build ' - 'directory.', - type=str, default='', metavar='build_dir') - - run_parser.add_argument('--defconfig', - help='Uses a default .kunitconfig.', - action='store_true') + config_parser = subparser.add_parser('config', + help='Ensures that .config contains all of ' + 'the options in .kunitconfig') + add_common_opts(config_parser) + add_config_opts(config_parser) - cli_args = parser.parse_args(argv) + build_parser = subparser.add_parser('build', help='Builds a kernel with KUnit tests') + add_common_opts(build_parser) + add_build_opts(build_parser) - if cli_args.subcommand == 'run': - if get_kernel_root_path(): - os.chdir(get_kernel_root_path()) + exec_parser = subparser.add_parser('exec', help='Run a kernel with KUnit tests') + add_common_opts(exec_parser) + add_exec_opts(exec_parser) + add_parse_opts(exec_parser) + + # The 'parse' option is special, as it doesn't need the kernel source + # (therefore there is no need for a build_dir, hence no add_common_opts) + # and the '--file' argument is not relevant to 'run', so isn't in + # add_parse_opts() + parse_parser = subparser.add_parser('parse', + help='Parses KUnit results from a file, ' + 'and parses formatted results.') + add_parse_opts(parse_parser) + parse_parser.add_argument('file', + help='Specifies the file to read results from.', + type=str, default='-', metavar='input_file') + + cli_args = parser.parse_args(argv) + # Set up the build_dir and source tree for commands which use it + # (everything but 'parse') + if cli_args.subcommand != 'parse': if cli_args.build_dir: if not os.path.exists(cli_args.build_dir): os.mkdir(cli_args.build_dir) @@ -133,12 +231,11 @@ def main(argv, linux=None): cli_args.build_dir, kunit_kernel.kunitconfig_path) - if cli_args.defconfig: - create_default_kunitconfig() - if not linux: linux = kunit_kernel.LinuxSourceTree() + + if cli_args.subcommand == 'run': request = KunitRequest(cli_args.raw_output, cli_args.timeout, cli_args.jobs, @@ -147,6 +244,47 @@ def main(argv, linux=None): result = run_tests(linux, request) if result.status != KunitStatus.SUCCESS: sys.exit(1) + elif cli_args.subcommand == 'config': + request = KunitConfigRequest(cli_args.build_dir, + cli_args.defconfig) + result = config_tests(linux, request) + kunit_parser.print_with_timestamp(( + 'Elapsed time: %.3fs\n') % ( + result.elapsed_time)) + if result.status != KunitStatus.SUCCESS: + sys.exit(1) + elif cli_args.subcommand == 'build': + request = KunitBuildRequest(cli_args.jobs, + cli_args.build_dir) + result = build_tests(linux, request) + kunit_parser.print_with_timestamp(( + 'Elapsed time: %.3fs\n') % ( + result.elapsed_time)) + if result.status != KunitStatus.SUCCESS: + sys.exit(1) + elif cli_args.subcommand == 'exec': + exec_request = KunitExecRequest(cli_args.timeout, + cli_args.build_dir) + exec_result = exec_tests(linux, exec_request) + parse_request = KunitParseRequest(cli_args.raw_output, + exec_result.result) + result = parse_tests(parse_request) + kunit_parser.print_with_timestamp(( + 'Elapsed time: %.3fs\n') % ( + exec_result.elapsed_time)) + if result.status != KunitStatus.SUCCESS: + sys.exit(1) + elif cli_args.subcommand == 'parse': + if cli_args.file == '-': + kunit_output = sys.stdin + else: + with open(cli_args.file, 'r') as f: + kunit_output = f.read().splitlines() + request = KunitParseRequest(cli_args.raw_output, + kunit_output) + result = parse_tests(request) + if result.status != KunitStatus.SUCCESS: + sys.exit(1) else: parser.print_help() diff --git a/tools/testing/kunit/kunit_tool_test.py b/tools/testing/kunit/kunit_tool_test.py index cba97756ac4a..0d04425ead04 100755 --- a/tools/testing/kunit/kunit_tool_test.py +++ b/tools/testing/kunit/kunit_tool_test.py @@ -170,6 +170,24 @@ class KUnitMainTest(unittest.TestCase): self.print_patch.stop() pass + def test_config_passes_args_pass(self): + kunit.main(['config'], self.linux_source_mock) + assert self.linux_source_mock.build_reconfig.call_count == 1 + assert self.linux_source_mock.run_kernel.call_count == 0 + + def test_build_passes_args_pass(self): + kunit.main(['build'], self.linux_source_mock) + assert self.linux_source_mock.build_reconfig.call_count == 0 + self.linux_source_mock.build_um_kernel.assert_called_once_with(8, '') + assert self.linux_source_mock.run_kernel.call_count == 0 + + def test_exec_passes_args_pass(self): + kunit.main(['exec'], self.linux_source_mock) + assert self.linux_source_mock.build_reconfig.call_count == 0 + assert self.linux_source_mock.run_kernel.call_count == 1 + self.linux_source_mock.run_kernel.assert_called_once_with(build_dir='', timeout=300) + self.print_mock.assert_any_call(StrContains('Testing complete.')) + def test_run_passes_args_pass(self): kunit.main(['run'], self.linux_source_mock) assert self.linux_source_mock.build_reconfig.call_count == 1 @@ -177,6 +195,13 @@ class KUnitMainTest(unittest.TestCase): self.linux_source_mock.run_kernel.assert_called_once_with(build_dir='', timeout=300) self.print_mock.assert_any_call(StrContains('Testing complete.')) + def test_exec_passes_args_fail(self): + self.linux_source_mock.run_kernel = mock.Mock(return_value=[]) + with self.assertRaises(SystemExit) as e: + kunit.main(['exec'], self.linux_source_mock) + assert type(e.exception) == SystemExit + assert e.exception.code == 1 + def test_run_passes_args_fail(self): self.linux_source_mock.run_kernel = mock.Mock(return_value=[]) with self.assertRaises(SystemExit) as e: @@ -187,6 +212,14 @@ class KUnitMainTest(unittest.TestCase): assert self.linux_source_mock.run_kernel.call_count == 1 self.print_mock.assert_any_call(StrContains(' 0 tests run')) + def test_exec_raw_output(self): + self.linux_source_mock.run_kernel = mock.Mock(return_value=[]) + kunit.main(['exec', '--raw_output'], self.linux_source_mock) + assert self.linux_source_mock.run_kernel.call_count == 1 + for kall in self.print_mock.call_args_list: + assert kall != mock.call(StrContains('Testing complete.')) + assert kall != mock.call(StrContains(' 0 tests run')) + def test_run_raw_output(self): self.linux_source_mock.run_kernel = mock.Mock(return_value=[]) kunit.main(['run', '--raw_output'], self.linux_source_mock) @@ -196,6 +229,12 @@ class KUnitMainTest(unittest.TestCase): assert kall != mock.call(StrContains('Testing complete.')) assert kall != mock.call(StrContains(' 0 tests run')) + def test_exec_timeout(self): + timeout = 3453 + kunit.main(['exec', '--timeout', str(timeout)], self.linux_source_mock) + self.linux_source_mock.run_kernel.assert_called_once_with(build_dir='', timeout=timeout) + self.print_mock.assert_any_call(StrContains('Testing complete.')) + def test_run_timeout(self): timeout = 3453 kunit.main(['run', '--timeout', str(timeout)], self.linux_source_mock) @@ -210,5 +249,21 @@ class KUnitMainTest(unittest.TestCase): self.linux_source_mock.run_kernel.assert_called_once_with(build_dir=build_dir, timeout=300) self.print_mock.assert_any_call(StrContains('Testing complete.')) + def test_config_builddir(self): + build_dir = '.kunit' + kunit.main(['config', '--build_dir', build_dir], self.linux_source_mock) + assert self.linux_source_mock.build_reconfig.call_count == 1 + + def test_build_builddir(self): + build_dir = '.kunit' + kunit.main(['build', '--build_dir', build_dir], self.linux_source_mock) + self.linux_source_mock.build_um_kernel.assert_called_once_with(8, build_dir) + + def test_exec_builddir(self): + build_dir = '.kunit' + kunit.main(['exec', '--build_dir', build_dir], self.linux_source_mock) + self.linux_source_mock.run_kernel.assert_called_once_with(build_dir=build_dir, timeout=300) + self.print_mock.assert_any_call(StrContains('Testing complete.')) + if __name__ == '__main__': unittest.main() -- 2.25.1.481.gfbce0eb801-goog

4 years, 9 months

1
0
0 0

[PATCH V1 00/13] Miscellaneous fixes for resctrl selftests

by Sai Praneeth Prakhya

This patch set has several miscellaneous fixes to resctrl selftest tool. Some fixes are minor in nature while other are major fixes. The minor fixes are 1. Typos, comment format 2. Fix MBA feature detection 3. Fix a bug while selecting sibling cpu 4. Remove unnecessary use of variable arguments 5. Change MBM/MBA results reporting format from absolute values to percentage The major fixes are changing CAT and CQM test cases. CAT test wasn't testing CAT as it isn't using the cache it's allocated, hence, change the test case to test noisy neighbor use case. CAT guarantees a user specified amount of cache for a process or a group of processes, hence test this use case. The updated test case checks if critical process is impacted by noisy neighbor or not. If it's impacted the test fails. The present CQM test assumes that all the allocated memory (size less than LLC size) for a process will fit into cache and there won't be any overlappings. While this is mostly true, it cannot be *always* true by the nature of how cache works i.e. two addresses could index into same cache line. Hence, change CQM test such that it now uses CAT. Allocate a specific amount of cache using CAT and check if CQM reports more than what CAT has allocated. Fenghua Yu (1): selftests/resctrl: Fix missing options "-n" and "-p" Reinette Chatre (4): selftests/resctrl: Fix feature detection selftests/resctrl: Fix typo selftests/resctrl: Fix typo in help text selftests/resctrl: Ensure sibling CPU is not same as original CPU Sai Praneeth Prakhya (8): selftests/resctrl: Fix MBA/MBM results reporting format selftests/resctrl: Don't use variable argument list for setup function selftests/resctrl: Fix typos selftests/resctrl: Modularize fill_buf for new CAT test case selftests/resctrl: Change Cache Allocation Technology (CAT) test selftests/resctrl: Change Cache Quality Monitoring (CQM) test selftests/resctrl: Dynamically select buffer size for CAT test selftests/resctrl: Cleanup fill_buff after changing CAT test tools/testing/selftests/resctrl/cache.c | 179 ++++++++----- tools/testing/selftests/resctrl/cat_test.c | 322 +++++++++++++----------- tools/testing/selftests/resctrl/cqm_test.c | 210 +++++++++------- tools/testing/selftests/resctrl/fill_buf.c | 113 ++++++--- tools/testing/selftests/resctrl/mba_test.c | 32 ++- tools/testing/selftests/resctrl/mbm_test.c | 33 ++- tools/testing/selftests/resctrl/resctrl.h | 19 +- tools/testing/selftests/resctrl/resctrl_tests.c | 26 +- tools/testing/selftests/resctrl/resctrl_val.c | 22 +- tools/testing/selftests/resctrl/resctrlfs.c | 52 +++- 10 files changed, 592 insertions(+), 416 deletions(-) -- 2.7.4

4 years, 9 months

3
41
0 0

[PATCH] selftests/seccomp: Adjust test fixture counts

by Kees Cook

The seccomp selftest reported the wrong test counts since it was using slightly the wrong API for defining text fixtures. Adjust the API usage. Signed-off-by: Kees Cook <keescook(a)chromium.org> --- tools/testing/selftests/seccomp/seccomp_bpf.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/tools/testing/selftests/seccomp/seccomp_bpf.c b/tools/testing/selftests/seccomp/seccomp_bpf.c index a9ad3bd8b2ad..89fb3e0b552e 100644 --- a/tools/testing/selftests/seccomp/seccomp_bpf.c +++ b/tools/testing/selftests/seccomp/seccomp_bpf.c @@ -913,7 +913,7 @@ TEST(ERRNO_order) EXPECT_EQ(12, errno); } -FIXTURE_DATA(TRAP) { +FIXTURE(TRAP) { struct sock_fprog prog; }; @@ -1024,7 +1024,7 @@ TEST_F(TRAP, handler) EXPECT_NE(0, (unsigned long)sigsys->_call_addr); } -FIXTURE_DATA(precedence) { +FIXTURE(precedence) { struct sock_fprog allow; struct sock_fprog log; struct sock_fprog trace; @@ -1513,7 +1513,7 @@ void tracer_poke(struct __test_metadata *_metadata, pid_t tracee, int status, EXPECT_EQ(0, ret); } -FIXTURE_DATA(TRACE_poke) { +FIXTURE(TRACE_poke) { struct sock_fprog prog; pid_t tracer; long poked; @@ -1821,7 +1821,7 @@ void tracer_ptrace(struct __test_metadata *_metadata, pid_t tracee, change_syscall(_metadata, tracee, -1, -ESRCH); } -FIXTURE_DATA(TRACE_syscall) { +FIXTURE(TRACE_syscall) { struct sock_fprog prog; pid_t tracer, mytid, mypid, parent; }; @@ -2326,7 +2326,7 @@ struct tsync_sibling { } \ } while (0) -FIXTURE_DATA(TSYNC) { +FIXTURE(TSYNC) { struct sock_fprog root_prog, apply_prog; struct tsync_sibling sibling[TSYNC_SIBLINGS]; sem_t started; -- 2.20.1 -- Kees Cook

4 years, 9 months

1
0
0 0

[PATCH 5/5] bpf: sockmap, sockhash: test looking up fds

by Lorenz Bauer

Make sure that looking up an element from the map succeeds, and that the fd is valid by using it an fcntl call. Signed-off-by: Lorenz Bauer <lmb(a)cloudflare.com> --- .../selftests/bpf/prog_tests/sockmap_listen.c | 26 ++++++++++++++----- 1 file changed, 20 insertions(+), 6 deletions(-) diff --git a/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c b/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c index 52aa468bdccd..929e1e77ecc6 100644 --- a/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c +++ b/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c @@ -453,7 +453,7 @@ static void test_lookup_after_delete(int family, int sotype, int mapfd) xclose(s); } -static void test_lookup_32_bit_value(int family, int sotype, int mapfd) +static void test_lookup_fd(int family, int sotype, int mapfd) { u32 key, value32; int err, s; @@ -466,7 +466,7 @@ static void test_lookup_32_bit_value(int family, int sotype, int mapfd) sizeof(value32), 1, 0); if (mapfd < 0) { FAIL_ERRNO("map_create"); - goto close; + goto close_sock; } key = 0; @@ -475,11 +475,25 @@ static void test_lookup_32_bit_value(int family, int sotype, int mapfd) errno = 0; err = bpf_map_lookup_elem(mapfd, &key, &value32); - if (!err || errno != ENOSPC) - FAIL_ERRNO("map_lookup: expected ENOSPC"); + if (err) { + FAIL_ERRNO("map_lookup"); + goto close_map; + } + if ((int)value32 == s) { + FAIL("return value is identical"); + goto close; + } + + err = fcntl(value32, F_GETFD); + if (err == -1) + FAIL_ERRNO("fcntl"); + +close: + xclose(value32); +close_map: xclose(mapfd); -close: +close_sock: xclose(s); } @@ -1456,7 +1470,7 @@ static void test_ops(struct test_sockmap_listen *skel, struct bpf_map *map, /* lookup */ TEST(test_lookup_after_insert), TEST(test_lookup_after_delete), - TEST(test_lookup_32_bit_value), + TEST(test_lookup_fd), /* update */ TEST(test_update_existing), /* races with insert/delete */ -- 2.20.1

4 years, 9 months

2
2
0 0

2024

2023

2022

2021

2020

2019

2018

2017

Linux-kselftest-mirror March 2020