While running LTP sched on stable-rc 4.19 branch kernel on arm64 hikey device. Thermal alarm triggered and followed by kernel warnings and Internal error: Oops:
steps to reproduce: cd /opt/ltp ./runltp -f sched
Test running hackbench test case from LTP sched
Test case: hackbench 50 process 1000
Running with 50*40 (== 2000) tasks. [ 33.758553] LDO2_2V8: disabling [ 33.761846] LDO13_1V8: disabling [ 33.767592] LDO14_2V8: disabling [ 33.771918] LDO17_2V5: disabling [ 34.182704] hisi_thermal f7030700.tsensor: THERMAL ALARM: 66385 > 65000 [ 39.518923] ------------[ cut here ]------------ [ 39.525600] refcount_t: underflow; use-after-free. [ 39.532816] WARNING: CPU: 1 PID: 5624 at lib/refcount.c:187 refcount_sub_and_test_checked+0xa0/0xa8 [ 39.542099] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 39.566135] CPU: 1 PID: 5624 Comm: hackbench Not tainted 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 39.574768] Hardware name: HiKey Development Board (DT) [ 39.580122] pstate: 40000005 (nZcv daif -PAN -UAO) [ 39.585043] pc : refcount_sub_and_test_checked+0xa0/0xa8 [ 39.590491] lr : refcount_sub_and_test_checked+0xa0/0xa8 [ 39.595933] sp : ffff0000142bba60 [ 39.599331] x29: ffff0000142bba60 x28: ffff80004e20d4c8 [ 39.604771] x27: ffff800048273f28 x26: 0000000000000064 [ 39.610213] x25: ffff800048273f00 x24: 0000000000000000 [ 39.615657] x23: 0000000000000064 x22: ffff80004e20d740 [ 39.621097] x21: 0000000000000000 x20: ffff800058991944 [ 39.626538] x19: 0000000000000000 x18: 0000000000000000 [ 39.631980] x17: 0000000000000000 x16: 0000000000000000 [ 39.637418] x15: 0000000000000400 x14: 0000000000000333 [ 39.642857] x13: 0000000000000001 x12: 0000000000000000 [ 39.648295] x11: 0000000000000002 x10: 0000000000000960 [ 39.653734] x9 : ffff0000142bb7a0 x8 : ffff80004e2573c0 [ 39.659174] x7 : ffff8000757a6c00 x6 : 0000000000000010 [ 39.664612] x5 : ffff800077f1a790 x4 : ffff800077f1b0d0 [ 39.670053] x3 : ffff800077f21eb0 x2 : ffff800077f1b0d0 [ 39.675493] x1 : d13523b333b73d00 x0 : 0000000000000000 [ 39.680930] Call trace: [ 39.683455] refcount_sub_and_test_checked+0xa0/0xa8 [ 39.688550] sock_wfree+0x4c/0xa0 [ 39.691957] unix_destruct_scm+0x70/0x90 [ 39.695986] skb_release_head_state+0x5c/0xf0 [ 39.700460] skb_release_all+0x14/0x30 [ 39.704306] consume_skb+0x2c/0x58 [ 39.707801] unix_stream_read_generic+0x680/0x750 [ 39.712623] unix_stream_recvmsg+0x4c/0x70 [ 39.716829] sock_read_iter+0x94/0xe8 [ 39.720589] __vfs_read+0xf8/0x148 [ 39.724084] vfs_read+0xa8/0x160 [ 39.727400] ksys_read+0x64/0xd8 [ 39.730714] __arm64_sys_read+0x18/0x20 [ 39.734655] el0_svc_common+0x70/0x168 [ 39.738509] el0_svc_handler+0x2c/0x80 [ 39.742360] el0_svc+0x8/0xc [ 39.745321] ---[ end trace 6e44f0c23e5d9fb1 ]--- [ 44.241524] ------------[ cut here ]------------ [ 44.248838] WARNING: CPU: 0 PID: 5624 at net/unix/af_unix.c:498 unix_sock_destructor+0xf4/0x100 [ 44.257760] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 44.281801] CPU: 0 PID: 5624 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 44.291854] Hardware name: HiKey Development Board (DT) [ 44.297209] pstate: 40000005 (nZcv daif -PAN -UAO) [ 44.302126] pc : unix_sock_destructor+0xf4/0x100 [ 44.306863] lr : unix_sock_destructor+0xf4/0x100 [ 44.311593] sp : ffff0000142bb9f0 [ 44.314990] x29: ffff0000142bb9f0 x28: ffff80004e20d4c8 [ 44.320429] x27: ffff800048273f28 x26: 0000000000000064 [ 44.325869] x25: ffff800048273f00 x24: 0000000000000000 [ 44.331308] x23: 0000000000000064 x22: ffff80004e20d740 [ 44.336747] x21: ffff800058991800 x20: ffff8000589916b8 [ 44.342186] x19: ffff800058991800 x18: 0000000000000000 [ 44.347625] x17: 0000000000000000 x16: 0000000000000000 [ 44.353066] x15: 0000000000000400 x14: 0000000000000333 [ 44.358508] x13: 0000000000000001 x12: 0000000000000000 [ 44.370733] x11: 0000000000000002 x10: 0000000000000960 [ 44.382900] x9 : ffff0000142bb760 x8 : ffff80004e2573c0 [ 44.395054] x7 : ffff8000757a6a00 x6 : 0000000000000010 [ 44.406985] x5 : ffff800077f04790 x4 : ffff800077f050d0 [ 44.418678] x3 : ffff800077f0beb0 x2 : d13523b333b73d00 [ 44.430478] x1 : 0000000000000000 x0 : 0000000000000024 [ 44.442258] Call trace: [ 44.451166] unix_sock_destructor+0xf4/0x100 [ 44.461909] __sk_destruct+0x2c/0x150 [ 44.471973] sk_destruct+0x48/0x60 [ 44.481725] __sk_free+0x38/0xd0 [ 44.491237] sock_wfree+0x7c/0xa0 [ 44.500416] unix_destruct_scm+0x70/0x90 [ 44.509821] skb_release_head_state+0x5c/0xf0 [ 44.519571] skb_release_all+0x14/0x30 [ 44.528610] consume_skb+0x2c/0x58 [ 44.537257] unix_stream_read_generic+0x680/0x750 [ 44.547227] unix_stream_recvmsg+0x4c/0x70 [ 44.556616] sock_read_iter+0x94/0xe8 [ 44.565510] __vfs_read+0xf8/0x148 [ 44.574124] vfs_read+0xa8/0x160 [ 44.582578] ksys_read+0x64/0xd8 [ 44.591057] __arm64_sys_read+0x18/0x20 [ 44.600160] el0_svc_common+0x70/0x168 [ 44.609177] el0_svc_handler+0x2c/0x80 [ 44.618194] el0_svc+0x8/0xc [ 44.626370] ---[ end trace 6e44f0c23e5d9fb2 ]--- [ 44.804127] ------------[ cut here ]------------ [ 44.851402] refcount_t: addition on 0; use-after-free. [ 45.083709] ------------[ cut here ]------------ [ 45.095872] WARNING: CPU: 1 PID: 5624 at net/unix/af_unix.c:499 unix_sock_destructor+0xe0/0x100 [ 45.110316] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 45.146603] CPU: 1 PID: 5624 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 45.163052] Hardware name: HiKey Development Board (DT) [ 45.174863] pstate: 40000005 (nZcv daif -PAN -UAO) [ 45.186303] pc : unix_sock_destructor+0xe0/0x100 [ 45.197560] lr : unix_sock_destructor+0xe0/0x100 [ 45.208757] sp : ffff0000142bb9f0 [ 45.218636] x29: ffff0000142bb9f0 x28: ffff80004e20d4c8 [ 45.230537] x27: ffff800048273f28 x26: 0000000000000064 [ 45.242423] x25: ffff800048273f00 x24: 0000000000000000 [ 45.254317] x23: 0000000000000064 x22: ffff80004e20d740 [ 45.266248] x21: ffff800058991800 x20: ffff8000589916b8 [ 45.278128] x19: ffff800058991800 x18: 0000000000000000 [ 45.289964] x17: 0000000000000000 x16: 0000000000000000 [ 45.301854] x15: 0000000000000400 x14: 0000000000000333 [ 45.313691] x13: 0000000000000001 x12: 0000000000000000 [ 45.325466] x11: 0000000000000002 x10: 0000000000000960 [ 45.337205] x9 : ffff0000142bb760 x8 : ffff80004e2573c0 [ 45.349011] x7 : ffff8000757a6c00 x6 : 0000000000000010 [ 45.360826] x5 : ffff800077f1a790 x4 : ffff800077f1b0d0 [ 45.372682] x3 : ffff800077f21eb0 x2 : d13523b333b73d00 [ 45.384432] x1 : 0000000000000000 x0 : 0000000000000024 [ 45.396161] Call trace: [ 45.404576] unix_sock_destructor+0xe0/0x100 [ 45.414505] __sk_destruct+0x2c/0x150 [ 45.423673] sk_destruct+0x48/0x60 [ 45.432482] __sk_free+0x38/0xd0 [ 45.441123] sock_wfree+0x7c/0xa0 [ 45.449751] unix_destruct_scm+0x70/0x90 [ 45.459098] skb_release_head_state+0x5c/0xf0 [ 45.468851] skb_release_all+0x14/0x30 [ 45.477977] consume_skb+0x2c/0x58 [ 45.486728] unix_stream_read_generic+0x680/0x750 [ 45.496892] unix_stream_recvmsg+0x4c/0x70 [ 45.506383] sock_read_iter+0x94/0xe8 [ 45.515494] __vfs_read+0xf8/0x148 [ 45.524328] vfs_read+0xa8/0x160 [ 45.532979] ksys_read+0x64/0xd8 [ 45.541711] __arm64_sys_read+0x18/0x20 [ 45.551056] el0_svc_common+0x70/0x168 [ 45.560334] el0_svc_handler+0x2c/0x80 [ 45.569595] el0_svc+0x8/0xc [ 45.577983] ---[ end trace 6e44f0c23e5d9fb3 ]--- [ 46.230081] unix: Attempt to release alive unix socket: 00000000c16f8bab [ 46.581410] WARNING: CPU: 7 PID: 4201 at lib/refcount.c:102 refcount_add_checked+0x40/0x48 [ 46.595469] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 46.631752] CPU: 7 PID: 4201 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 46.648192] Hardware name: HiKey Development Board (DT) [ 46.660070] pstate: 40000005 (nZcv daif -PAN -UAO) [ 46.671520] pc : refcount_add_checked+0x40/0x48 [ 46.682787] lr : refcount_add_checked+0x40/0x48 [ 46.693921] sp : ffff000011653b10 [ 46.703835] x29: ffff000011653b10 x28: 0000000000000000 [ 46.715810] x27: 0000000000000003 x26: 0000000000000000 [ 46.727832] x25: 7fffffffffffffff x24: ffff000011653c74 [ 46.739766] x23: ffff0000092198c8 x22: ffff0000081187c8 [ 46.751748] x21: ffff800058991400 x20: ffff800058991800 [ 46.763739] x19: ffff80004bcad300 x18: 0000000000000000 [ 46.775673] x17: 0000000000000000 x16: 0000000000000000 [ 46.787641] x15: 0000000000000400 x14: 0000000000000333 [ 46.799574] x13: 0000000000000001 x12: 0000000000000000 [ 46.811479] x11: 0000000000000070 x10: 0000000000000960 [ 46.823383] x9 : ffff000011653850 x8 : ffff800058b43180 [ 46.835276] x7 : ffff8000757a7800 x6 : 0000000000000010 [ 46.847198] x5 : ffff800077f9e790 x4 : ffff800077f9f0d0 [ 46.859090] x3 : ffff800077fa5eb0 x2 : ffff800077f9f0d0 [ 46.870964] x1 : d13523b333b73d00 x0 : 0000000000000000 [ 46.882829] Call trace: [ 46.891741] refcount_add_checked+0x40/0x48 [ 46.902369] skb_set_owner_w+0x60/0xa8 [ 46.912144] sock_alloc_send_pskb+0x200/0x210 [ 46.922202] unix_stream_sendmsg+0x1d0/0x340 [ 46.931999] sock_sendmsg+0x18/0x30 [ 46.940976] sock_write_iter+0x8c/0xe0 [ 46.950159] __vfs_write+0xf8/0x160 [ 46.959014] vfs_write+0xa4/0x1b0 [ 46.967712] ksys_write+0x64/0xd8 [ 46.976420] __arm64_sys_write+0x18/0x20 [ 46.985743] el0_svc_common+0x70/0x168 [ 46.994915] el0_svc_handler+0x2c/0x80 [ 47.004074] el0_svc+0x8/0xc [ 47.012329] ---[ end trace 6e44f0c23e5d9fb4 ]--- [ 51.942160] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000008 [ 51.956600] Mem abort info: [ 51.964994] ESR = 0x96000046 [ 51.973658] Exception class = DABT (current EL), IL = 32 bits [ 51.985323] SET = 0, FnV = 0 [ 51.994116] EA = 0, S1PTW = 0 [ 52.002991] Data abort info: [ 52.011559] ISV = 0, ISS = 0x00000046 [ 52.021139] CM = 0, WnR = 1 [ 52.029826] user pgtable: 4k pages, 48-bit VAs, pgdp = 00000000cd136acc [ 52.042281] [0000000000000008] pgd=000000004e23d003, pud=000000004e23e003, pmd=0000000000000000 [ 52.056947] Internal error: Oops: 96000046 [#1] PREEMPT SMP [ 52.068511] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 52.105341] Process hackbench (pid: 5616, stack limit = 0x00000000a84269cf) [ 52.119153] CPU: 2 PID: 5616 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 52.136027] Hardware name: HiKey Development Board (DT) [ 52.148385] pstate: 60000085 (nZCv daIf -PAN -UAO) [ 52.160272] pc : skb_unlink+0x40/0x60 [ 52.171005] lr : skb_unlink+0x24/0x60 [ 52.181698] sp : ffff00001427bb20 [ 52.191997] x29: ffff00001427bb20 x28: ffff80004e2094c8 [ 52.204398] x27: ffff800048273528 x26: 0000000000000064 [ 52.216760] x25: ffff800048273500 x24: 0000000000000000 [ 52.229121] x23: 0000000000000064 x22: ffff80004e209740 [ 52.241486] x21: ffff80004e2094dc x20: ffff80004e2094c8 [ 52.253822] x19: ffff800048273500 x18: 0000000000000000 [ 52.266159] x17: 0000000000000000 x16: 0000000000000000 [ 52.278498] x15: 0000000000000000 x14: 00000000226300a0 [ 52.290796] x13: 00000000226300a0 x12: 00000000004012f8 [ 52.303077] x11: 00000000004014b4 x10: 0000fffff7fe03b0 [ 52.315350] x9 : 00000000226300a0 x8 : 0000000000000008 [ 52.327541] x7 : 0000000000000007 x6 : 0000000000000001 [ 52.339623] x5 : 0000000000000001 x4 : 0000000000000002 [ 52.351279] x3 : 0000000000000000 x2 : 0000000000000000 [ 52.362553] x1 : 0000000000000000 x0 : ffff80004e2094dc [ 52.373690] Call trace: [ 52.381864] skb_unlink+0x40/0x60 [ 52.390837] unix_stream_read_generic+0x678/0x750 [ 52.401221] unix_stream_recvmsg+0x4c/0x70 [ 52.411043] sock_read_iter+0x94/0xe8 [ 52.420417] __vfs_read+0xf8/0x148 [ 52.429510] vfs_read+0xa8/0x160 [ 52.438457] ksys_read+0x64/0xd8 [ 52.447370] __arm64_sys_read+0x18/0x20 [ 52.456911] el0_svc_common+0x70/0x168 [ 52.466376] el0_svc_handler+0x2c/0x80 [ 52.475801] el0_svc+0x8/0xc [ 52.484345] Code: 51000442 b9001282 a9400a63 a9007e7f (f9000462) [ 52.496245] ---[ end trace 6e44f0c23e5d9fb5 ]--- [ 52.506922] note: hackbench[5616] exited with preempt_count 1
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:41 UTC):
kernel[3032]: [ 52.056947] Internal error: Oops: 96000046 [#1] PREEMPT SMP
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:41 UTC):
kernel[3032]: [ 52.105341] Process hackbench (pid: 5616, stack limit = 0x00000000a84269cf)
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:41 UTC):
kernel[3032]: [ 52.484345] Code: 51000442 b9001282 a9400a63 a9007e7f (f9000462)
SERVER: read (error: Bad address) Running with 20*40 (== 800) tasks. [ 53.050369] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000 [ 53.065286] Mem abort info: [ 53.074084] ESR = 0x96000044 [ 53.083135] Exception class = DABT (current EL), IL = 32 bits [ 53.095174] SET = 0, FnV = 0 [ 53.104314] EA = 0, S1PTW = 0 [ 53.113497] Data abort info: [ 53.122392] ISV = 0, ISS = 0x00000044 [ 53.132261] CM = 0, WnR = 1 [ 53.141238] user pgtable: 4k pages, 48-bit VAs, pgdp = 000000005aa0b283 [ 53.153996] [0000000000000000] pgd=0000000000000000 [ 53.165047] Internal error: Oops: 96000044 [#2] PREEMPT SMP [ 53.176817] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 53.214090] Process hackbench (pid: 5624, stack limit = 0x0000000092e9188f) [ 53.228138] CPU: 7 PID: 5624 Comm: hackbench Tainted: G D W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 53.245231] Hardware name: HiKey Development Board (DT) [ 53.257701] pstate: 80000085 (Nzcv daIf -PAN -UAO) [ 53.269773] pc : skb_dequeue+0x4c/0x90 [ 53.280804] lr : skb_dequeue+0x20/0x90 [ 53.291782] sp : ffff0000142bbae0 [ 53.302190] x29: ffff0000142bbae0 x28: ffff80004e256a00 [ 53.314558] x27: 0000000000000000 x26: ffff80004e20db40 [ 53.326910] x25: 0000000000000003 x24: 0000000000000001 [ 53.339232] x23: ffff0000092198c8 x22: ffff80004e20d4c8 [ 53.351527] x21: ffff80004e20d4dc x20: ffff800048273500 [ 53.363836] x19: ffff80004e20d4c8 x18: 0000000000000333 [ 53.376137] x17: 0000000000000000 x16: 0000000000000000 [ 53.388449] x15: 0000000000000400 x14: 0000000000000333 [ 53.400697] x13: 0000000000000001 x12: 0000000000000000 [ 53.412874] x11: 0000000000000002 x10: ffff800005f0a800 [ 53.424943] x9 : 0000000000000010 x8 : ffff800077fac8e8 [ 53.436880] x7 : 0000000044040000 x6 : 0000000000000002 [ 53.448446] x5 : 0000000000000001 x4 : 0000000000000003 [ 53.459613] x3 : ffff80004e20d4dc x2 : ffff800048273c00 [ 53.470707] x1 : 0000000000000000 x0 : 0000000000000000 [ 53.481673] Call trace: [ 53.489657] skb_dequeue+0x4c/0x90 [ 53.498571] unix_release_sock+0x138/0x268 [ 53.508190] unix_release+0x20/0x38 [ 53.517203] __sock_release+0x40/0xb8 [ 53.526390] sock_close+0x14/0x20 [ 53.535243] __fput+0x88/0x1b0 [ 53.543818] ____fput+0xc/0x18 [ 53.552379] task_work_run+0x90/0xb0 [ 53.561486] do_exit+0x350/0x9a8 [ 53.570250] do_group_exit+0x34/0x98 [ 53.579335] get_signal+0xac/0x618 [ 53.588266] do_signal+0x8c/0x2a0 [ 53.597122] do_notify_resume+0xd0/0x110 [ 53.606623] work_pending+0x8/0x10 [ 53.615588] Code: b9001260 a9400282 a9007e9f f9000440 (f9000002) [ 53.627346] ---[ end trace 6e44f0c23e5d9fb6 ]--- [ 53.637660] Fixing recursive fault but reboot is needed!
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:42 UTC):
kernel[3032]: [ 53.165047] Internal error: Oops: 96000044 [#2] PREEMPT SMP
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:42 UTC):
kernel[3032]: [ 53.214090] Process hackbench (pid: 5624, stack limit = 0x0000000092e9188f)
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:42 UTC):
kernel[3032]: [ 53.615588] Code: b9001260 a9400282 a9007e9f f9000440 (f9000002)
[ 54.489871] hisi_thermal f7030700.tsensor: THERMAL ALARM stopped: 61675 < 65000 [ 74.654864] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 74.666836] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3834/3912 fqs=2623 [ 74.681934] rcu: (detected by 5, t=5252 jiffies, g=2345, q=677) [ 74.694094] Task dump for CPU 2: [ 74.703435] hackbench R running task 0 5616 1 0x0000022e [ 74.716735] Call trace: [ 74.725367] __switch_to+0xe8/0x148 [ 74.735044] (null) [ 74.744269] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [ 74.756718] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3836/3912 fqs=2623 [ 74.772141] rcu: (detected by 5, t=5273 jiffies, g=2645, q=16353) [ 74.784812] Task dump for CPU 2: [ 74.794529] hackbench R running task 0 5616 1 0x0000022e [ 74.808210] Call trace: [ 74.817173] __switch_to+0xe8/0x148 [ 74.827156] (null) [ 137.674820] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 137.687231] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3834/3912 fqs=10479 [ 137.702783] rcu: (detected by 5, t=21007 jiffies, g=2345, q=677) [ 137.715437] Task dump for CPU 2: [ 137.725159] hackbench R running task 0 5616 1 0x0000022e [ 137.738781] Call trace: [ 137.747752] __switch_to+0xe8/0x148 [ 137.757797] (null) [ 137.767359] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [ 137.780138] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3836/3912 fqs=10464 [ 137.795939] rcu: (detected by 5, t=21029 jiffies, g=2645, q=16636) [ 137.808940] Task dump for CPU 2: [ 137.818844] hackbench R running task 0 5616 1 0x0000022e [ 137.832327] Call trace: [ 137.840756] __switch_to+0xe8/0x148 [ 137.850166] (null) [ 185.305855] audit: type=1701 audit(1553455613.779:3): auid=4294967295 uid=993 gid=990 ses=4294967295 pid=2943 comm="systemd-network" exe="/lib/systemd/systemd-networkd" sig=6 res=1 [ 185.326450] dwmmc_k3 f723d000.dwmmc0: Unexpected interrupt latency [ 200.694868] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
Ref: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.19-oe/build/v4.19.122-4... https://qa-reports.linaro.org/lkft/linux-stable-rc-4.19-oe/build/v4.19.122-4...
kernel config: https://builds.tuxbuild.com/CiEjvux-yM6p2wRSLY2A0Q/kernel.config
On Wed, May 13, 2020 at 11:41:14PM +0530, Naresh Kamboju wrote:
While running LTP sched on stable-rc 4.19 branch kernel on arm64 hikey device. Thermal alarm triggered and followed by kernel warnings and Internal error: Oops:
Hi!
I just happened to see this on lkml. It looks a lot like this:
https://lore.kernel.org/lkml/0ba7cb74-507e-7fb5-6147-1d5fee34155f@kernel.dk/
(though obviously not in io_uring)
If this is reliable can you bisect to find what broke? There have been a lot of bugs found by refcount_t that have been fixed in upstream, just from fuzzing: https://syzkaller.appspot.com/upstream/fixed
-Kees
steps to reproduce: cd /opt/ltp ./runltp -f sched
Test running hackbench test case from LTP sched
Test case: hackbench 50 process 1000
Running with 50*40 (== 2000) tasks. [ 33.758553] LDO2_2V8: disabling [ 33.761846] LDO13_1V8: disabling [ 33.767592] LDO14_2V8: disabling [ 33.771918] LDO17_2V5: disabling [ 34.182704] hisi_thermal f7030700.tsensor: THERMAL ALARM: 66385 > 65000 [ 39.518923] ------------[ cut here ]------------ [ 39.525600] refcount_t: underflow; use-after-free. [ 39.532816] WARNING: CPU: 1 PID: 5624 at lib/refcount.c:187 refcount_sub_and_test_checked+0xa0/0xa8 [ 39.542099] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 39.566135] CPU: 1 PID: 5624 Comm: hackbench Not tainted 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 39.574768] Hardware name: HiKey Development Board (DT) [ 39.580122] pstate: 40000005 (nZcv daif -PAN -UAO) [ 39.585043] pc : refcount_sub_and_test_checked+0xa0/0xa8 [ 39.590491] lr : refcount_sub_and_test_checked+0xa0/0xa8 [ 39.595933] sp : ffff0000142bba60 [ 39.599331] x29: ffff0000142bba60 x28: ffff80004e20d4c8 [ 39.604771] x27: ffff800048273f28 x26: 0000000000000064 [ 39.610213] x25: ffff800048273f00 x24: 0000000000000000 [ 39.615657] x23: 0000000000000064 x22: ffff80004e20d740 [ 39.621097] x21: 0000000000000000 x20: ffff800058991944 [ 39.626538] x19: 0000000000000000 x18: 0000000000000000 [ 39.631980] x17: 0000000000000000 x16: 0000000000000000 [ 39.637418] x15: 0000000000000400 x14: 0000000000000333 [ 39.642857] x13: 0000000000000001 x12: 0000000000000000 [ 39.648295] x11: 0000000000000002 x10: 0000000000000960 [ 39.653734] x9 : ffff0000142bb7a0 x8 : ffff80004e2573c0 [ 39.659174] x7 : ffff8000757a6c00 x6 : 0000000000000010 [ 39.664612] x5 : ffff800077f1a790 x4 : ffff800077f1b0d0 [ 39.670053] x3 : ffff800077f21eb0 x2 : ffff800077f1b0d0 [ 39.675493] x1 : d13523b333b73d00 x0 : 0000000000000000 [ 39.680930] Call trace: [ 39.683455] refcount_sub_and_test_checked+0xa0/0xa8 [ 39.688550] sock_wfree+0x4c/0xa0 [ 39.691957] unix_destruct_scm+0x70/0x90 [ 39.695986] skb_release_head_state+0x5c/0xf0 [ 39.700460] skb_release_all+0x14/0x30 [ 39.704306] consume_skb+0x2c/0x58 [ 39.707801] unix_stream_read_generic+0x680/0x750 [ 39.712623] unix_stream_recvmsg+0x4c/0x70 [ 39.716829] sock_read_iter+0x94/0xe8 [ 39.720589] __vfs_read+0xf8/0x148 [ 39.724084] vfs_read+0xa8/0x160 [ 39.727400] ksys_read+0x64/0xd8 [ 39.730714] __arm64_sys_read+0x18/0x20 [ 39.734655] el0_svc_common+0x70/0x168 [ 39.738509] el0_svc_handler+0x2c/0x80 [ 39.742360] el0_svc+0x8/0xc [ 39.745321] ---[ end trace 6e44f0c23e5d9fb1 ]--- [ 44.241524] ------------[ cut here ]------------ [ 44.248838] WARNING: CPU: 0 PID: 5624 at net/unix/af_unix.c:498 unix_sock_destructor+0xf4/0x100 [ 44.257760] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 44.281801] CPU: 0 PID: 5624 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 44.291854] Hardware name: HiKey Development Board (DT) [ 44.297209] pstate: 40000005 (nZcv daif -PAN -UAO) [ 44.302126] pc : unix_sock_destructor+0xf4/0x100 [ 44.306863] lr : unix_sock_destructor+0xf4/0x100 [ 44.311593] sp : ffff0000142bb9f0 [ 44.314990] x29: ffff0000142bb9f0 x28: ffff80004e20d4c8 [ 44.320429] x27: ffff800048273f28 x26: 0000000000000064 [ 44.325869] x25: ffff800048273f00 x24: 0000000000000000 [ 44.331308] x23: 0000000000000064 x22: ffff80004e20d740 [ 44.336747] x21: ffff800058991800 x20: ffff8000589916b8 [ 44.342186] x19: ffff800058991800 x18: 0000000000000000 [ 44.347625] x17: 0000000000000000 x16: 0000000000000000 [ 44.353066] x15: 0000000000000400 x14: 0000000000000333 [ 44.358508] x13: 0000000000000001 x12: 0000000000000000 [ 44.370733] x11: 0000000000000002 x10: 0000000000000960 [ 44.382900] x9 : ffff0000142bb760 x8 : ffff80004e2573c0 [ 44.395054] x7 : ffff8000757a6a00 x6 : 0000000000000010 [ 44.406985] x5 : ffff800077f04790 x4 : ffff800077f050d0 [ 44.418678] x3 : ffff800077f0beb0 x2 : d13523b333b73d00 [ 44.430478] x1 : 0000000000000000 x0 : 0000000000000024 [ 44.442258] Call trace: [ 44.451166] unix_sock_destructor+0xf4/0x100 [ 44.461909] __sk_destruct+0x2c/0x150 [ 44.471973] sk_destruct+0x48/0x60 [ 44.481725] __sk_free+0x38/0xd0 [ 44.491237] sock_wfree+0x7c/0xa0 [ 44.500416] unix_destruct_scm+0x70/0x90 [ 44.509821] skb_release_head_state+0x5c/0xf0 [ 44.519571] skb_release_all+0x14/0x30 [ 44.528610] consume_skb+0x2c/0x58 [ 44.537257] unix_stream_read_generic+0x680/0x750 [ 44.547227] unix_stream_recvmsg+0x4c/0x70 [ 44.556616] sock_read_iter+0x94/0xe8 [ 44.565510] __vfs_read+0xf8/0x148 [ 44.574124] vfs_read+0xa8/0x160 [ 44.582578] ksys_read+0x64/0xd8 [ 44.591057] __arm64_sys_read+0x18/0x20 [ 44.600160] el0_svc_common+0x70/0x168 [ 44.609177] el0_svc_handler+0x2c/0x80 [ 44.618194] el0_svc+0x8/0xc [ 44.626370] ---[ end trace 6e44f0c23e5d9fb2 ]--- [ 44.804127] ------------[ cut here ]------------ [ 44.851402] refcount_t: addition on 0; use-after-free. [ 45.083709] ------------[ cut here ]------------ [ 45.095872] WARNING: CPU: 1 PID: 5624 at net/unix/af_unix.c:499 unix_sock_destructor+0xe0/0x100 [ 45.110316] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 45.146603] CPU: 1 PID: 5624 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 45.163052] Hardware name: HiKey Development Board (DT) [ 45.174863] pstate: 40000005 (nZcv daif -PAN -UAO) [ 45.186303] pc : unix_sock_destructor+0xe0/0x100 [ 45.197560] lr : unix_sock_destructor+0xe0/0x100 [ 45.208757] sp : ffff0000142bb9f0 [ 45.218636] x29: ffff0000142bb9f0 x28: ffff80004e20d4c8 [ 45.230537] x27: ffff800048273f28 x26: 0000000000000064 [ 45.242423] x25: ffff800048273f00 x24: 0000000000000000 [ 45.254317] x23: 0000000000000064 x22: ffff80004e20d740 [ 45.266248] x21: ffff800058991800 x20: ffff8000589916b8 [ 45.278128] x19: ffff800058991800 x18: 0000000000000000 [ 45.289964] x17: 0000000000000000 x16: 0000000000000000 [ 45.301854] x15: 0000000000000400 x14: 0000000000000333 [ 45.313691] x13: 0000000000000001 x12: 0000000000000000 [ 45.325466] x11: 0000000000000002 x10: 0000000000000960 [ 45.337205] x9 : ffff0000142bb760 x8 : ffff80004e2573c0 [ 45.349011] x7 : ffff8000757a6c00 x6 : 0000000000000010 [ 45.360826] x5 : ffff800077f1a790 x4 : ffff800077f1b0d0 [ 45.372682] x3 : ffff800077f21eb0 x2 : d13523b333b73d00 [ 45.384432] x1 : 0000000000000000 x0 : 0000000000000024 [ 45.396161] Call trace: [ 45.404576] unix_sock_destructor+0xe0/0x100 [ 45.414505] __sk_destruct+0x2c/0x150 [ 45.423673] sk_destruct+0x48/0x60 [ 45.432482] __sk_free+0x38/0xd0 [ 45.441123] sock_wfree+0x7c/0xa0 [ 45.449751] unix_destruct_scm+0x70/0x90 [ 45.459098] skb_release_head_state+0x5c/0xf0 [ 45.468851] skb_release_all+0x14/0x30 [ 45.477977] consume_skb+0x2c/0x58 [ 45.486728] unix_stream_read_generic+0x680/0x750 [ 45.496892] unix_stream_recvmsg+0x4c/0x70 [ 45.506383] sock_read_iter+0x94/0xe8 [ 45.515494] __vfs_read+0xf8/0x148 [ 45.524328] vfs_read+0xa8/0x160 [ 45.532979] ksys_read+0x64/0xd8 [ 45.541711] __arm64_sys_read+0x18/0x20 [ 45.551056] el0_svc_common+0x70/0x168 [ 45.560334] el0_svc_handler+0x2c/0x80 [ 45.569595] el0_svc+0x8/0xc [ 45.577983] ---[ end trace 6e44f0c23e5d9fb3 ]--- [ 46.230081] unix: Attempt to release alive unix socket: 00000000c16f8bab [ 46.581410] WARNING: CPU: 7 PID: 4201 at lib/refcount.c:102 refcount_add_checked+0x40/0x48 [ 46.595469] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 46.631752] CPU: 7 PID: 4201 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 46.648192] Hardware name: HiKey Development Board (DT) [ 46.660070] pstate: 40000005 (nZcv daif -PAN -UAO) [ 46.671520] pc : refcount_add_checked+0x40/0x48 [ 46.682787] lr : refcount_add_checked+0x40/0x48 [ 46.693921] sp : ffff000011653b10 [ 46.703835] x29: ffff000011653b10 x28: 0000000000000000 [ 46.715810] x27: 0000000000000003 x26: 0000000000000000 [ 46.727832] x25: 7fffffffffffffff x24: ffff000011653c74 [ 46.739766] x23: ffff0000092198c8 x22: ffff0000081187c8 [ 46.751748] x21: ffff800058991400 x20: ffff800058991800 [ 46.763739] x19: ffff80004bcad300 x18: 0000000000000000 [ 46.775673] x17: 0000000000000000 x16: 0000000000000000 [ 46.787641] x15: 0000000000000400 x14: 0000000000000333 [ 46.799574] x13: 0000000000000001 x12: 0000000000000000 [ 46.811479] x11: 0000000000000070 x10: 0000000000000960 [ 46.823383] x9 : ffff000011653850 x8 : ffff800058b43180 [ 46.835276] x7 : ffff8000757a7800 x6 : 0000000000000010 [ 46.847198] x5 : ffff800077f9e790 x4 : ffff800077f9f0d0 [ 46.859090] x3 : ffff800077fa5eb0 x2 : ffff800077f9f0d0 [ 46.870964] x1 : d13523b333b73d00 x0 : 0000000000000000 [ 46.882829] Call trace: [ 46.891741] refcount_add_checked+0x40/0x48 [ 46.902369] skb_set_owner_w+0x60/0xa8 [ 46.912144] sock_alloc_send_pskb+0x200/0x210 [ 46.922202] unix_stream_sendmsg+0x1d0/0x340 [ 46.931999] sock_sendmsg+0x18/0x30 [ 46.940976] sock_write_iter+0x8c/0xe0 [ 46.950159] __vfs_write+0xf8/0x160 [ 46.959014] vfs_write+0xa4/0x1b0 [ 46.967712] ksys_write+0x64/0xd8 [ 46.976420] __arm64_sys_write+0x18/0x20 [ 46.985743] el0_svc_common+0x70/0x168 [ 46.994915] el0_svc_handler+0x2c/0x80 [ 47.004074] el0_svc+0x8/0xc [ 47.012329] ---[ end trace 6e44f0c23e5d9fb4 ]--- [ 51.942160] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000008 [ 51.956600] Mem abort info: [ 51.964994] ESR = 0x96000046 [ 51.973658] Exception class = DABT (current EL), IL = 32 bits [ 51.985323] SET = 0, FnV = 0 [ 51.994116] EA = 0, S1PTW = 0 [ 52.002991] Data abort info: [ 52.011559] ISV = 0, ISS = 0x00000046 [ 52.021139] CM = 0, WnR = 1 [ 52.029826] user pgtable: 4k pages, 48-bit VAs, pgdp = 00000000cd136acc [ 52.042281] [0000000000000008] pgd=000000004e23d003, pud=000000004e23e003, pmd=0000000000000000 [ 52.056947] Internal error: Oops: 96000046 [#1] PREEMPT SMP [ 52.068511] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 52.105341] Process hackbench (pid: 5616, stack limit = 0x00000000a84269cf) [ 52.119153] CPU: 2 PID: 5616 Comm: hackbench Tainted: G W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 52.136027] Hardware name: HiKey Development Board (DT) [ 52.148385] pstate: 60000085 (nZCv daIf -PAN -UAO) [ 52.160272] pc : skb_unlink+0x40/0x60 [ 52.171005] lr : skb_unlink+0x24/0x60 [ 52.181698] sp : ffff00001427bb20 [ 52.191997] x29: ffff00001427bb20 x28: ffff80004e2094c8 [ 52.204398] x27: ffff800048273528 x26: 0000000000000064 [ 52.216760] x25: ffff800048273500 x24: 0000000000000000 [ 52.229121] x23: 0000000000000064 x22: ffff80004e209740 [ 52.241486] x21: ffff80004e2094dc x20: ffff80004e2094c8 [ 52.253822] x19: ffff800048273500 x18: 0000000000000000 [ 52.266159] x17: 0000000000000000 x16: 0000000000000000 [ 52.278498] x15: 0000000000000000 x14: 00000000226300a0 [ 52.290796] x13: 00000000226300a0 x12: 00000000004012f8 [ 52.303077] x11: 00000000004014b4 x10: 0000fffff7fe03b0 [ 52.315350] x9 : 00000000226300a0 x8 : 0000000000000008 [ 52.327541] x7 : 0000000000000007 x6 : 0000000000000001 [ 52.339623] x5 : 0000000000000001 x4 : 0000000000000002 [ 52.351279] x3 : 0000000000000000 x2 : 0000000000000000 [ 52.362553] x1 : 0000000000000000 x0 : ffff80004e2094dc [ 52.373690] Call trace: [ 52.381864] skb_unlink+0x40/0x60 [ 52.390837] unix_stream_read_generic+0x678/0x750 [ 52.401221] unix_stream_recvmsg+0x4c/0x70 [ 52.411043] sock_read_iter+0x94/0xe8 [ 52.420417] __vfs_read+0xf8/0x148 [ 52.429510] vfs_read+0xa8/0x160 [ 52.438457] ksys_read+0x64/0xd8 [ 52.447370] __arm64_sys_read+0x18/0x20 [ 52.456911] el0_svc_common+0x70/0x168 [ 52.466376] el0_svc_handler+0x2c/0x80 [ 52.475801] el0_svc+0x8/0xc [ 52.484345] Code: 51000442 b9001282 a9400a63 a9007e7f (f9000462) [ 52.496245] ---[ end trace 6e44f0c23e5d9fb5 ]--- [ 52.506922] note: hackbench[5616] exited with preempt_count 1
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:41 UTC):
kernel[3032]: [ 52.056947] Internal error: Oops: 96000046 [#1] PREEMPT SMP
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:41 UTC):
kernel[3032]: [ 52.105341] Process hackbench (pid: 5616, stack limit = 0x00000000a84269cf)
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:41 UTC):
kernel[3032]: [ 52.484345] Code: 51000442 b9001282 a9400a63 a9007e7f (f9000462)
SERVER: read (error: Bad address) Running with 20*40 (== 800) tasks. [ 53.050369] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000 [ 53.065286] Mem abort info: [ 53.074084] ESR = 0x96000044 [ 53.083135] Exception class = DABT (current EL), IL = 32 bits [ 53.095174] SET = 0, FnV = 0 [ 53.104314] EA = 0, S1PTW = 0 [ 53.113497] Data abort info: [ 53.122392] ISV = 0, ISS = 0x00000044 [ 53.132261] CM = 0, WnR = 1 [ 53.141238] user pgtable: 4k pages, 48-bit VAs, pgdp = 000000005aa0b283 [ 53.153996] [0000000000000000] pgd=0000000000000000 [ 53.165047] Internal error: Oops: 96000044 [#2] PREEMPT SMP [ 53.176817] Modules linked in: wl18xx wlcore mac80211 cfg80211 hci_uart adv7511 snd_soc_audio_graph_card crc32_ce btbcm snd_soc_simple_card_utils crct10dif_ce cec kirin_drm bluetooth drm_kms_helper dw_drm_dsi drm wlcore_sdio rfkill drm_panel_orientation_quirks fuse [ 53.214090] Process hackbench (pid: 5624, stack limit = 0x0000000092e9188f) [ 53.228138] CPU: 7 PID: 5624 Comm: hackbench Tainted: G D W 4.19.123-rc1-00049-g6d5c161fb73d #1 [ 53.245231] Hardware name: HiKey Development Board (DT) [ 53.257701] pstate: 80000085 (Nzcv daIf -PAN -UAO) [ 53.269773] pc : skb_dequeue+0x4c/0x90 [ 53.280804] lr : skb_dequeue+0x20/0x90 [ 53.291782] sp : ffff0000142bbae0 [ 53.302190] x29: ffff0000142bbae0 x28: ffff80004e256a00 [ 53.314558] x27: 0000000000000000 x26: ffff80004e20db40 [ 53.326910] x25: 0000000000000003 x24: 0000000000000001 [ 53.339232] x23: ffff0000092198c8 x22: ffff80004e20d4c8 [ 53.351527] x21: ffff80004e20d4dc x20: ffff800048273500 [ 53.363836] x19: ffff80004e20d4c8 x18: 0000000000000333 [ 53.376137] x17: 0000000000000000 x16: 0000000000000000 [ 53.388449] x15: 0000000000000400 x14: 0000000000000333 [ 53.400697] x13: 0000000000000001 x12: 0000000000000000 [ 53.412874] x11: 0000000000000002 x10: ffff800005f0a800 [ 53.424943] x9 : 0000000000000010 x8 : ffff800077fac8e8 [ 53.436880] x7 : 0000000044040000 x6 : 0000000000000002 [ 53.448446] x5 : 0000000000000001 x4 : 0000000000000003 [ 53.459613] x3 : ffff80004e20d4dc x2 : ffff800048273c00 [ 53.470707] x1 : 0000000000000000 x0 : 0000000000000000 [ 53.481673] Call trace: [ 53.489657] skb_dequeue+0x4c/0x90 [ 53.498571] unix_release_sock+0x138/0x268 [ 53.508190] unix_release+0x20/0x38 [ 53.517203] __sock_release+0x40/0xb8 [ 53.526390] sock_close+0x14/0x20 [ 53.535243] __fput+0x88/0x1b0 [ 53.543818] ____fput+0xc/0x18 [ 53.552379] task_work_run+0x90/0xb0 [ 53.561486] do_exit+0x350/0x9a8 [ 53.570250] do_group_exit+0x34/0x98 [ 53.579335] get_signal+0xac/0x618 [ 53.588266] do_signal+0x8c/0x2a0 [ 53.597122] do_notify_resume+0xd0/0x110 [ 53.606623] work_pending+0x8/0x10 [ 53.615588] Code: b9001260 a9400282 a9007e9f f9000440 (f9000002) [ 53.627346] ---[ end trace 6e44f0c23e5d9fb6 ]--- [ 53.637660] Fixing recursive fault but reboot is needed!
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:42 UTC):
kernel[3032]: [ 53.165047] Internal error: Oops: 96000044 [#2] PREEMPT SMP
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:42 UTC):
kernel[3032]: [ 53.214090] Process hackbench (pid: 5624, stack limit = 0x0000000092e9188f)
Broadcast message from systemd-journald@hikey (Sun 2019-03-24 19:24:42 UTC):
kernel[3032]: [ 53.615588] Code: b9001260 a9400282 a9007e9f f9000440 (f9000002)
[ 54.489871] hisi_thermal f7030700.tsensor: THERMAL ALARM stopped: 61675 < 65000 [ 74.654864] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 74.666836] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3834/3912 fqs=2623 [ 74.681934] rcu: (detected by 5, t=5252 jiffies, g=2345, q=677) [ 74.694094] Task dump for CPU 2: [ 74.703435] hackbench R running task 0 5616 1 0x0000022e [ 74.716735] Call trace: [ 74.725367] __switch_to+0xe8/0x148 [ 74.735044] (null) [ 74.744269] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [ 74.756718] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3836/3912 fqs=2623 [ 74.772141] rcu: (detected by 5, t=5273 jiffies, g=2645, q=16353) [ 74.784812] Task dump for CPU 2: [ 74.794529] hackbench R running task 0 5616 1 0x0000022e [ 74.808210] Call trace: [ 74.817173] __switch_to+0xe8/0x148 [ 74.827156] (null) [ 137.674820] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 137.687231] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3834/3912 fqs=10479 [ 137.702783] rcu: (detected by 5, t=21007 jiffies, g=2345, q=677) [ 137.715437] Task dump for CPU 2: [ 137.725159] hackbench R running task 0 5616 1 0x0000022e [ 137.738781] Call trace: [ 137.747752] __switch_to+0xe8/0x148 [ 137.757797] (null) [ 137.767359] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [ 137.780138] rcu: 2-...0: (1 GPs behind) idle=daa/1/0x4000000000000000 softirq=3836/3912 fqs=10464 [ 137.795939] rcu: (detected by 5, t=21029 jiffies, g=2645, q=16636) [ 137.808940] Task dump for CPU 2: [ 137.818844] hackbench R running task 0 5616 1 0x0000022e [ 137.832327] Call trace: [ 137.840756] __switch_to+0xe8/0x148 [ 137.850166] (null) [ 185.305855] audit: type=1701 audit(1553455613.779:3): auid=4294967295 uid=993 gid=990 ses=4294967295 pid=2943 comm="systemd-network" exe="/lib/systemd/systemd-networkd" sig=6 res=1 [ 185.326450] dwmmc_k3 f723d000.dwmmc0: Unexpected interrupt latency [ 200.694868] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
Ref: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.19-oe/build/v4.19.122-4... https://qa-reports.linaro.org/lkft/linux-stable-rc-4.19-oe/build/v4.19.122-4...
kernel config: https://builds.tuxbuild.com/CiEjvux-yM6p2wRSLY2A0Q/kernel.config
-- Linaro LKFT https://lkft.linaro.org
-
Kees Cook -
Naresh Kamboju