Lkft-triage

lkft-triage@lists.linaro.org

33162 discussions

Daily report for validation - 2025-May-29

by lava＠validation.linaro.org

Total jobs: 83 Total errors: 26 (31.33%) LAVA errors: 0 (0.00%) Test errors: 0 (0.00%) Job errors: 7 (8.43%) Infra errors: 19 (22.89%) Canceled jobs: 0 (0.00%) Device type: dragonboard-845c Total jobs: 19 Total errors: 15 (78.95%) Error type: Infrastructure Error count: 15 (78.95%) Error: No match for error type 'Infrastructure', message 'Unable to run pre-power: '/usr/local/lab-scripts/cbrxd_hub_control -n w1-hub01 -m sync -u 6' failed' Count: 3 (15.79%) IDs: dragonboard-845c-06: 4150758 4150759 4150765 Error: No match for error type 'Infrastructure', message 'Unable to run pre-power: '/usr/local/lab-scripts/cbrxd_hub_control -n w1-hub01 -m sync -u 8' failed' Count: 4 (21.05%) IDs: dragonboard-845c-05: 4150740 4150743 4150745 4150746 Error: No match for error type 'Infrastructure', message 'Unable to run pre-power: '/usr/local/lab-scripts/cbrxd_hub_control -n w1-hub01 -m sync -u 4' failed' Count: 4 (21.05%) IDs: dragonboard-845c-08: 4150721 4150724 4150725 4150726 Error: No match for error type 'Infrastructure', message 'Unable to run pre-power: '/usr/local/lab-scripts/cbrxd_hub_control -n w1-hub01 -m sync -u 2' failed' Count: 3 (15.79%) IDs: dragonboard-845c-04: 4150702 4150705 4150706 Error: Reboot failed Count: 1 (5.26%) IDs: dragonboard-845c-04: 4150699 Device type: dragonboard-410c Total jobs: 7 Total errors: 6 (85.71%) Error type: Job Error count: 6 (85.71%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 6 (85.71%) IDs: dragonboard-410c-01: 4150659 4150677 4150697 4150722 4150739 4150762 Device type: x15 Total jobs: 20 Total errors: 1 (5.00%) Error type: Job Error count: 1 (5.00%) Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 1 (5.00%) IDs: x15-01: 4150737 Device type: beaglebone-black Total jobs: 25 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 10 Total errors: 4 (40.00%) Error type: Infrastructure Error count: 4 (40.00%) Error: Reboot failed Count: 3 (30.00%) IDs: rpi3-b-32-03: 4150700 4150703 4150704 Error: Connection closed Count: 1 (10.00%) IDs: rpi3-b-32-03: 4150693 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 5 months

Daily report for validation - 2025-May-28

by lava＠validation.linaro.org

Total jobs: 272 Total errors: 42 (15.44%) LAVA errors: 0 (0.00%) Test errors: 0 (0.00%) Job errors: 34 (12.50%) Infra errors: 8 (2.94%) Canceled jobs: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 45 Total errors: 0 (0.00%) Device type: beaglebone-black Total jobs: 91 Total errors: 1 (1.10%) Error type: Infrastructure Error count: 1 (1.10%) Error: Connection closed Count: 1 (1.10%) IDs: beaglebone-black03: 4150430 Device type: x15 Total jobs: 81 Total errors: 13 (16.05%) Error type: Job Error count: 12 (14.81%) Error: No match for error type 'Job', message 'ipconfig: no devices [ 204.070281] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 204.081970] CPU: 1 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 vices to configure ipconfig: no devices to configure ipconfig:[ 204.095336] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 204.107055] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 204.120391] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.131134] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 204.138122] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 204.144866] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 204.152038] [<c034c28c>] (do_group_exit) from [<b6f06010>] (0xb6f06010) [ 204.158691] CPU0: stopping [ 204.161407] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.169616] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.175750] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.183532] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.190795] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.198486] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.206115] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.215362] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 204.225158] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 204.233917] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 204.242309] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 204.249816] Exception stack(0xc1901f08 to 0xc1901f50) [ 204.254882] 1f00: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 204.263122] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000d8be c1901f58 [ 204.271331] 1f40: c0331648 c0309478 60000013 ffffffff [ 204.276397] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 204.283843] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 204.291961] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 204.299743] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 204.307342] [<c037b5f4>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 204.315582] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150563 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.094726] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 204.106658] CPU: 0 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.114440] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.120574] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.128387] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.135650] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 204.142639] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 204.149383] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 204.156555] [<c034c28c>] (do_group_exit) from [<b6f76010>] (0xb6f76010) [ 204.163208] CPU1: stopping [ 204.165924] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.174163] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.180267] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.188079] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.195343] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.203033] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.210632] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.219909] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 204.229705] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 204.238464] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 204.246856] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 204.254364] Exception stack(0xc212df48 to 0xc212df90) [ 204.259429] df40: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 204.267669] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000e37a c212df98 [ 204.275878] df80: c0331648 c0309478 60000013 ffffffff [ 204.280975] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 204.288391] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 204.296539] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 204.304321] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 204.311920] [<c037b5f4>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 204.318939] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150562 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.841430] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 configure ipconfig: no devices to configure ipconfig: no devi[ 204.853332] CPU: 1 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 ces to configure ipconfig: no devices to configure ipconfig: n[ 204.866699] Hardware name: Generic DRA74X (Flattened Device Tree) o devices to configure ipconfig: no devices to configure /init[ 204.878417] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) : 384: .: Can't open /run/net-*.conf [ 204.891754] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.902313] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 204.909332] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 204.916046] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 204.923217] [<c034c28c>] (do_group_exit) from [<b6f62010>] (0xb6f62010) [ 204.929870] CPU0: stopping [ 204.932586] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.940795] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.946929] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.954711] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.961975] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.969665] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.977294] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.986541] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 204.996337] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.005096] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.013488] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.020996] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.026062] 1f00: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.034271] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000e58e c1901f58 [ 205.042510] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.047576] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.055023] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.063140] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.070922] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.078521] [<c037b5f4>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.086761] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150561 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.945404] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 204.957366] CPU: 0 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.965148] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.971282] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.979064] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.986328] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 204.993347] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 205.000091] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.007263] [<c034c28c>] (do_group_exit) from [<b6f97010>] (0xb6f97010) [ 205.013916] CPU1: stopping [ 205.016632] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.024841] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.030975] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.038757] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.046020] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.053741] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.061340] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.070617] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.080413] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.089141] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.097534] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.105072] Exception stack(0xc212df48 to 0xc212df90) [ 205.110137] df40: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.118347] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000e1a2 c212df98 [ 205.126586] df80: c0331648 c0309478 60000013 ffffffff [ 205.131652] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.139099] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.147216] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.154998] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.162628] [<c037b5f4>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 205.169616] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150560 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.965606] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 204.977539] CPU: 0 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.985321] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.991455] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.999267] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.006530] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 205.013519] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 205.020263] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.027435] [<c034c28c>] (do_group_exit) from [<b6f88010>] (0xb6f88010) [ 205.034088] CPU1: stopping [ 205.036804] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.045043] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.051177] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.058959] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.066223] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.073913] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.081512] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.090789] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.100585] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.109344] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.117736] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.125244] Exception stack(0xc212df48 to 0xc212df90) [ 205.130310] df40: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.138549] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000b6fe c212df98 [ 205.146759] df80: c0331648 c0309478 60000013 ffffffff [ 205.151824] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.159271] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.167419] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.175201] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.182800] [<c037b5f4>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 205.189819] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150559 Error: No match for error type 'Job', message 'ipconfig: no devices [ 204.148742] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 204.160461] CPU: 1 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 vices to configure ipconfig: no devices to configure ipconfig:[ 204.173828] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 204.185546] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 204.198883] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.209625] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 204.216613] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 204.223358] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 204.230529] [<c034c28c>] (do_group_exit) from [<b6f2b010>] (0xb6f2b010) [ 204.237182] CPU0: stopping [ 204.239898] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.248107] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.254241] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.262023] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.269287] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.276977] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.284606] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.293853] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 204.303649] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 204.312377] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 204.320800] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 204.328308] Exception stack(0xc1901f08 to 0xc1901f50) [ 204.333374] 1f00: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 204.341583] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000d002 c1901f58 [ 204.349822] 1f40: c0331648 c0309478 60000013 ffffffff [ 204.354888] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 204.362335] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 204.370452] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 204.378234] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 204.385833] [<c037b5f4>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 204.394073] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150558 Error: No match for error type 'Job', message 'ipconfig: no devices [ 205.004486] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 205.016235] CPU: 1 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 vices to configure ipconfig: no devices to configure ipconfig:[ 205.029571] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 205.041290] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 205.054656] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.065399] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 205.072387] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 205.079132] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.086303] [<c034c28c>] (do_group_exit) from [<b6f60010>] (0xb6f60010) [ 205.092956] CPU0: stopping [ 205.095672] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.103881] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.110015] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.117797] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.125061] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.132751] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.140380] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.149627] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.159423] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.168182] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.176574] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.184082] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.189147] 1f00: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.197357] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000e45a c1901f58 [ 205.205596] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.210662] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.218109] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.226226] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.234008] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.241607] [<c037b5f4>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.249847] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150557 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.996307] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 205.008270] CPU: 0 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.016052] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.022216] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.029998] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.037261] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 205.044250] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 205.050994] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.058166] [<c034c28c>] (do_group_exit) from [<b6f07010>] (0xb6f07010) [ 205.064819] CPU1: stopping [ 205.067535] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.075775] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.081909] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.089691] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.096954] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.104644] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.112274] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.121520] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.131317] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.140075] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.148468] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.155975] Exception stack(0xc212df48 to 0xc212df90) [ 205.161071] df40: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.169281] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000d536 c212df98 [ 205.177490] df80: c0331648 c0309478 60000013 ffffffff [ 205.182586] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.190002] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.198150] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.205932] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.213531] [<c037b5f4>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 205.220550] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150556 Error: No match for error type 'Job', message 'ipconfig: no devices [ 204.993225] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 205.004974] CPU: 1 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 vices to configure ipconfig: no devices to configure ipconfig:[ 205.018310] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 205.030029] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 205.043395] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.054138] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 205.061126] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 205.067871] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.075042] [<c034c28c>] (do_group_exit) from [<b6f4c010>] (0xb6f4c010) [ 205.081695] CPU0: stopping [ 205.084411] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.092620] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.098754] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.106536] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.113800] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.121490] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.129089] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.138366] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.148162] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.156890] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.165283] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.172821] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.177886] 1f00: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.186096] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000ebe2 c1901f58 [ 205.194305] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.199401] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.206817] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.214965] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.222747] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.230346] [<c037b5f4>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.238555] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150553 Error: No match for error type 'Job', message 'ipconfig: no devices [ 205.129608] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 205.139465] CPU: 1 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 vices to configure ipconfig: no devices to configure ipconfig:[ 205.152832] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 205.164550] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 205.177886] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.188629] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 205.195648] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 205.202362] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.209533] [<c034c28c>] (do_group_exit) from [<b6fbc010>] (0xb6fbc010) [ 205.216186] CPU0: stopping [ 205.218902] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.227111] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.233245] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.241027] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.248291] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.255981] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.263610] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.272857] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.282653] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.291412] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.299804] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.307312] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.312377] 1f00: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.320587] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000d012 c1901f58 [ 205.328826] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.333892] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.341339] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.349456] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.357238] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.364837] [<c037b5f4>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.373077] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150546 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.943664] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 204.955566] CPU: 0 PID: 1 Comm: init Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 204.963348] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.969482] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.977294] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 204.984558] [<c0ffa774>] (dump_stack) from [<c0ff65b4>] (panic+0x124/0x334) [ 204.991546] [<c0ff65b4>] (panic) from [<c034b2bc>] (do_exit+0x944/0x97c) [ 204.998291] [<c034b2bc>] (do_exit) from [<c034c28c>] (do_group_exit+0x0/0xb8) [ 205.005462] [<c034c28c>] (do_group_exit) from [<b6f79010>] (0xb6f79010) [ 205.012115] CPU1: stopping [ 205.014831] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.238-rc1-00253-g2d7e2320dffc #1 [ 205.023071] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.029205] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.036987] [<c030cb50>] (show_stack) from [<c0ffa774>] (dump_stack+0xbc/0xd0) [ 205.044250] [<c0ffa774>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.051940] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.059570] [<c030fdb8>] (ipi_handler) from [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.068817] [<c03a8ee8>] (handle_percpu_devid_fasteoi_ipi) from [<c03a21f0>] (generic_handle_irq+0x48/0x94) [ 205.078613] [<c03a21f0>] (generic_handle_irq) from [<c03a28c0>] (__handle_domain_irq+0x5c/0xb0) [ 205.087371] [<c03a28c0>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.095764] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.103271] Exception stack(0xc212df48 to 0xc212df90) [ 205.108367] df40: c1b21440 00000000 fe600000 00000000 c1b219e0 c1904d18 [ 205.116577] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000ca1a c212df98 [ 205.124786] df80: c0331648 c0309478 60000013 ffffffff [ 205.129882] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.137298] [<c0309478>] (arch_cpu_idle) from [<c100fcfc>] (default_idle_call+0x34/0xf4) [ 205.145446] [<c100fcfc>] (default_idle_call) from [<c037b298>] (do_idle+0x24c/0x2ec) [ 205.153228] [<c037b298>] (do_idle) from [<c037b5f4>] (cpu_startup_entry+0x18/0x1c) [ 205.160827] [<c037b5f4>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 205.167846] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.23%) IDs: x15-01: 4150500 Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 1 (1.23%) IDs: x15-01: 4150372 Error type: Infrastructure Error count: 1 (1.23%) Error: Connection closed Count: 1 (1.23%) IDs: x15-01: 4150309 Device type: dragonboard-410c Total jobs: 22 Total errors: 21 (95.45%) Error type: Job Error count: 21 (95.45%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 21 (95.45%) IDs: dragonboard-410c-01: 4150278 4150296 4150327 4150333 4150347 4150379 4150383 4150399 4150424 4150438 4150472 4150479 4150497 4150531 4150541 4150550 4150566 4150592 4150610 4150619 4150636 Device type: dragonboard-845c Total jobs: 31 Total errors: 7 (22.58%) Error type: Infrastructure Error count: 6 (19.35%) Error: Connection closed Count: 5 (16.13%) IDs: dragonboard-845c-04: 4150549 4150552 dragonboard-845c-06: 4150353 4150355 4150595 Error: Reboot failed Count: 1 (3.23%) IDs: dragonboard-845c-08: 4150352 Error type: Job Error count: 1 (3.23%) Error: No match for error type 'Job', message '[ 0.000000] Kernel panic - not syncing: Attempted to kill the idle task! [ 0.000000] ---[ end Kernel panic - not syncing: Attempted to kill the idle task! ]---' Count: 1 (3.23%) IDs: dragonboard-845c-04: 4150528 Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 5 months

stable-rc/queue/6.14: S390: devres.h:111:16: error: implicit declaration of function 'IOMEM_ERR_PTR' [-Werror=implicit-function-declaration]

by Naresh Kamboju

Regressions on S390 tinyconfig builds failing with gcc-13, gcc-8 and clang-20 and clang-nightly tool chains on the stable-rc/queue/6.14. Regression Analysis: - New regression? Yes - Reproducible? Yes Build regression: S390 tinyconfig devres.h 'devm_ioremap_resource' implicit declaration of function 'IOMEM_ERR_PTR' Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> Build log: --------- In file included from include/linux/device.h:31, from include/linux/node.h:18, from include/linux/cpu.h:17, from arch/s390/kernel/traps.c:28: include/linux/device/devres.h: In function 'devm_ioremap_resource': include/linux/device/devres.h:111:16: error: implicit declaration of function 'IOMEM_ERR_PTR' [-Werror=implicit-function-declaration] 111 | return IOMEM_ERR_PTR(-EINVAL); | ^~~~~~~~~~~~~ ## Source * kernel version: 6.14.8 * git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/stable/linux-stabl… * git sha: 3413aa4d097e291186719c26f341c52f8550e22c * git describe: v6.14.8-756-g3413aa4d097e * project details: https://qa-reports.linaro.org/lkft/linux-stable-rc-queues-queue_6.14/build/… * architecture: S390 * toolchain: gcc-8, gcc-13, clang-20, clang-nightly * config : tinyconfig * Build config: https://storage.tuxsuite.com/public/linaro/lkft/builds/2xbEAey3MY3M8lp7doND… * Build: https://storage.tuxsuite.com/public/linaro/lkft/builds/2xbEAey3MY3M8lp7doND… ## Boot log * Build log: https://qa-reports.linaro.org/lkft/linux-stable-rc-queues-queue_6.14/build/… * Build details: https://qa-reports.linaro.org/lkft/linux-stable-rc-queues-queue_6.14/build/… * Build history: https://qa-reports.linaro.org/lkft/linux-stable-rc-queues-queue_6.14/build/… ## Steps to reproduce - tuxmake --runtime podman --target-arch s390 --toolchain gcc-13 --kconfig tinyconfig -- Linaro LKFT https://lkft.linaro.org

1 year, 5 months

Daily cts/vts report for lkft - 2025-May-27

by lava＠validation.linaro.org

Total jobs: 201 Total errors: 60 (29.85%) LAVA errors: 2 (1.00%) Test errors: 56 (27.86%) Job errors: 1 (0.50%) Infra errors: 1 (0.50%) Canceled jobs: 0 (0.00%) Device type: dragonboard-845c Total jobs: 117 Total errors: 27 (23.08%) Error type: Test Error count: 26 (22.22%) Error: No match for error type 'Test', message 'tradefed - adb device lost[927ecf10]' Count: 4 (3.42%) IDs: db845c-11: 8288453 8288918 8288919 8289308 Error: No match for error type 'Test', message 'tradefed - adb device lost[db449025]' Count: 2 (1.71%) IDs: db845c-14: 8288751 8289279 Error: No match for error type 'Test', message 'tradefed - adb device lost[f290bb24]' Count: 3 (2.56%) IDs: db845c-12: 8288452 8288926 8288932 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 1 (0.85%) IDs: db845c-02: 8288841 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 4 (3.42%) IDs: db845c-02: 8288794 8288797 db845c-07: 8287325 8287328 Error: Device NOT found! Count: 6 (5.13%) IDs: db845c-02: 8288601 8288608 8288678 8288708 8288715 8288776 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 599 seconds' Count: 2 (1.71%) IDs: db845c-12: 8288753 db845c-14: 8288669 Error: No match for error type 'Test', message 'tradefed - adb device lost[c7cf1849]' Count: 1 (0.85%) IDs: db845c-07: 8288718 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 593 seconds' Count: 2 (1.71%) IDs: db845c-02: 8287811 db845c-07: 8288631 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 293 seconds' Count: 1 (0.85%) IDs: db845c-07: 8288576 Error type: Infrastructure Error count: 1 (0.85%) Error: fastboot-flash-action timed out Count: 1 (0.85%) IDs: db845c-03: 8287964 Device type: sm8550-hdk Total jobs: 15 Total errors: 3 (20.00%) Error type: Test Error count: 3 (20.00%) Error: Device NOT found! Count: 1 (6.67%) IDs: sm8550-hdk-01: 8288763 Error: No match for error type 'Test', message 'tradefed - adb device lost[124d1c34]' Count: 2 (13.33%) IDs: sm8550-hdk-01: 8288761 8288762 Device type: hi6220-hikey-r2 Total jobs: 10 Total errors: 9 (90.00%) Error type: Test Error count: 9 (90.00%) Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 4 (40.00%) IDs: hikey-6220-r2-01: 8288894 8288914 hikey-6220-r2-05: 8288821 hikey-6220-r2-06: 8288772 Error: No match for error type 'Test', message 'tradefed - adb device lost[4595FE84003F72FC]' Count: 2 (20.00%) IDs: hikey-6220-r2-04: 8288851 8288906 Error: No match for error type 'Test', message 'tradefed - adb device lost[235D989C003B0752]' Count: 2 (20.00%) IDs: hikey-6220-r2-03: 8287987 8288880 Error: No match for error type 'Test', message 'tradefed - adb device lost[191FC75C003312EE]' Count: 1 (10.00%) IDs: hikey-6220-r2-06: 8287980 Device type: qrb5165-rb5 Total jobs: 54 Total errors: 20 (37.04%) Error type: Test Error count: 18 (33.33%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 9 (16.67%) IDs: rb5-03: 8288747 8288800 rb5-07: 8288606 8288621 8288658 8288660 8288665 8288730 8288749 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 5 (9.26%) IDs: rb5-03: 8287817 8288579 8288716 8288729 8288750 Error: No match for error type 'Test', message 'tradefed - adb device lost[d8a1879f]' Count: 2 (3.70%) IDs: rb5-07: 8288623 8288724 Error: Device NOT found! Count: 1 (1.85%) IDs: rb5-03: 8288600 Error: No match for error type 'Test', message 'tradefed - adb device lost[f11b68eb]' Count: 1 (1.85%) IDs: rb5-05: 8287810 Error type: Bug Error count: 2 (3.70%) Error: No match for error type 'Bug', message 'Failed to share device '/dev/bus/usb/003/074' to docker container lava-8288743-2.10.3-c8875fa1-3c8c-4a55-8628-fc453551b876' Count: 1 (1.85%) IDs: rb5-05: 8288743 Error: No match for error type 'Bug', message 'Failed to share device '/dev/bus/usb/003/094' to docker container lava-8288653-2.10.3-cdf2f49c-d73d-4275-a07a-04c43d0e966b' Count: 1 (1.85%) IDs: rb5-05: 8288653 Device type: hi960-hikey Total jobs: 1 Total errors: 0 (0.00%) Device type: x15 Total jobs: 3 Total errors: 1 (33.33%) Error type: Job Error count: 1 (33.33%) Error: No match for error type 'Job', message 'login-action timed out after 1774 seconds' Count: 1 (33.33%) IDs: x15-06: 8288065 Device type: rk3399-rock-pi-4b Total jobs: 1 Total errors: 0 (0.00%)

1 year, 5 months

Daily report for validation - 2025-May-27

by lava＠validation.linaro.org

Total jobs: 89 Total errors: 9 (10.11%) LAVA errors: 0 (0.00%) Test errors: 0 (0.00%) Job errors: 8 (8.99%) Infra errors: 1 (1.12%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 29 Total errors: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 15 Total errors: 0 (0.00%) Device type: x15 Total jobs: 23 Total errors: 1 (4.35%) Error type: Job Error count: 1 (4.35%) Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 1 (4.35%) IDs: x15-01: 4150206 Device type: dragonboard-845c Total jobs: 12 Total errors: 1 (8.33%) Error type: Infrastructure Error count: 1 (8.33%) Error: Connection closed Count: 1 (8.33%) IDs: dragonboard-845c-05: 4150180 Device type: dragonboard-410c Total jobs: 8 Total errors: 7 (87.50%) Error type: Job Error count: 7 (87.50%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 7 (87.50%) IDs: dragonboard-410c-01: 4150156 4150174 4150197 4150214 4150232 4150236 4150250 Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 5 months

Daily cts/vts report for lkft - 2025-May-26

by lava＠validation.linaro.org

Total jobs: 70 Total errors: 20 (28.57%) LAVA errors: 0 (0.00%) Test errors: 10 (14.29%) Job errors: 10 (14.29%) Infra errors: 0 (0.00%) Canceled jobs: 0 (0.00%) Device type: sm8550-hdk Total jobs: 26 Total errors: 10 (38.46%) Error type: Job Error count: 10 (38.46%) Error: No match for error type 'Job', message 'login-action timed out after 871 seconds' Count: 9 (34.62%) IDs: sm8550-hdk-01: 8286318 8286327 8286328 8286331 8287302 8287303 8287304 8287305 8287306 Error: wait for prompt timed out Count: 1 (3.85%) IDs: sm8550-hdk-01: 8286329 Device type: dragonboard-845c Total jobs: 44 Total errors: 10 (22.73%) Error type: Test Error count: 10 (22.73%) Error: Device NOT found! Count: 5 (11.36%) IDs: db845c-02: 8283189 8283191 8283199 8283207 db845c-07: 8287011 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 4 (9.09%) IDs: db845c-02: 8283205 8283206 8283231 db845c-07: 8287007 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 1 (2.27%) IDs: db845c-03: 8286664

1 year, 5 months

Daily report for validation - 2025-May-26

by lava＠validation.linaro.org

Total jobs: 43 Total errors: 3 (6.98%) LAVA errors: 0 (0.00%) Test errors: 0 (0.00%) Job errors: 3 (6.98%) Infra errors: 0 (0.00%) Canceled jobs: 0 (0.00%) Device type: dragonboard-410c Total jobs: 4 Total errors: 3 (75.00%) Error type: Job Error count: 3 (75.00%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 3 (75.00%) IDs: dragonboard-410c-01: 4150108 4150123 4150141 Device type: dragonboard-845c Total jobs: 7 Total errors: 0 (0.00%) Device type: x15 Total jobs: 10 Total errors: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 7 Total errors: 0 (0.00%) Device type: beaglebone-black Total jobs: 13 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 5 months

Re: riscv gcc-13 allyesconfig error the frame size of 2064 bytes is larger than 2048 bytes [-Werror=frame-larger-than=]

by Kent Overstreet

+cc Steve On Sun, May 25, 2025 at 06:18:42PM +0100, David Laight wrote: > On Fri, 23 May 2025 20:01:33 +0200 > "Arnd Bergmann" <arnd(a)arndb.de> wrote: > > > On Fri, May 23, 2025, at 19:11, Kent Overstreet wrote: > > > On Fri, May 23, 2025 at 05:17:15PM +0200, Arnd Bergmann wrote: > > >> > > >> - KASAN_STACK adds extra redzones for each variable > > >> - KASAN_STACK further prevents stack slots from getting > > >> reused inside one function, in order to better pinpoint > > >> which instance caused problems like out-of-scope access > > >> - passing structures by value causes them to be put on > > >> the stack on some architectures, even when the structure > > >> size is only one or two registers > > > > > > We mainly do this with bkey_s_c, which is just two words: on x86_64, > > > that gets passed in registers. Is riscv different? > > > > Not sure, I think it's mostly older ABIs that are limited, > > either not passing structures in registers at all, or only > > possibly one but not two of them. > > > > >> - sanitizers turn off optimizations that lead to better > > >> stack usage > > >> - in some cases, the missed optimization ends up causing > > >> local variables to get spilled to the stack many times > > >> because of a combination of all the above. > > > > > > Yeesh. > > > > > > I suspect we should be running with a larger stack when the sanitizers > > > are running, and perhaps tweak the warnings accordingly. I did a bunch > > > of stack usage work after I found a kmsan build was blowing out the > > > stack, but then running with max stack usage tracing enabled showed it > > > to be a largely non issue on non-sanitizer builds, IIRC. > > > > Enabling KASAN does double the available stack space. However, I don't > > think we should use that as an excuse to raise the per-function > > warning limit, because > > > > - the majority of all function stacks do not grow that much when > > sanitizers are enabled > > - allmodconfig enables KASAN and should still catch mistakes > > where a driver accidentally puts a large structure on the stack > > That is rather annoying when you want to look at the generated code :-( > > > - 2KB on 64-bit targes is a really large limit. At some point > > in the past I had a series that lowered the limit to 1536 byte > > for 64-bit targets, but I never managed to get all the changes > > merged. > > I've a cunning plan to do a proper static analysis of stack usage. > It is a 'simple' matter of getting objtool to output all calls with > the stack offset. > Indirect calls need the function hashes from fine-ibt, but also need > clang to support 'hash seeds' to disambiguate all the void (*)(void *) > functions. > That'll first barf at all recursion, and then, I expect, show a massive > stack use inside snprintf() in some error path. I suspect recursion will make the results you get with that approach useless. We already have "trace max stack", but that only checks at process exit, so it doesn't tell you much. We could do better with tracing - just inject a trampoline that checks the current stack usage against the maximum stack usage we've seen, and emits a trace event with a stack trace if it's greater. (and now Steve's going to tell us he's already done this :)

1 year, 5 months

Daily report for validation - 2025-May-25

by lava＠validation.linaro.org

Total jobs: 34 Total errors: 4 (11.76%) LAVA errors: 0 (0.00%) Test errors: 0 (0.00%) Job errors: 2 (5.88%) Infra errors: 2 (5.88%) Canceled jobs: 0 (0.00%) Device type: dragonboard-410c Total jobs: 3 Total errors: 2 (66.67%) Error type: Job Error count: 2 (66.67%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 2 (66.67%) IDs: dragonboard-410c-01: 4150062 4150083 Device type: dragonboard-845c Total jobs: 7 Total errors: 1 (14.29%) Error type: Infrastructure Error count: 1 (14.29%) Error: Connection closed Count: 1 (14.29%) IDs: dragonboard-845c-08: 4150045 Device type: beaglebone-black Total jobs: 10 Total errors: 1 (10.00%) Error type: Infrastructure Error count: 1 (10.00%) Error: matched a bootloader error message Count: 1 (10.00%) IDs: beaglebone-black03: 4150041 Device type: x15 Total jobs: 7 Total errors: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 5 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 5 months

Daily cts/vts report for lkft - 2025-May-24

by lava＠validation.linaro.org

Total jobs: 294 Total errors: 91 (30.95%) LAVA errors: 0 (0.00%) Test errors: 76 (25.85%) Job errors: 4 (1.36%) Infra errors: 11 (3.74%) Canceled jobs: 0 (0.00%) Device type: hi960-hikey Total jobs: 35 Total errors: 15 (42.86%) Error type: Test Error count: 14 (40.00%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 4 (11.43%) IDs: hi960-hikey-01: 8285848 8286197 hi960-hikey-02: 8285308 8285830 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 596 seconds' Count: 1 (2.86%) IDs: hi960-hikey-05: 8285764 Error: Device NOT found! Count: 2 (5.71%) IDs: hi960-hikey-02: 8285305 hi960-hikey-05: 8285333 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 3 (8.57%) IDs: hi960-hikey-03: 8285284 hi960-hikey-04: 8285282 8285285 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 593 seconds' Count: 2 (5.71%) IDs: hi960-hikey-02: 8285190 hi960-hikey-05: 8285175 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 295 seconds' Count: 1 (2.86%) IDs: hi960-hikey-02: 8285183 Error: No match for error type 'Test', message 'tradefed - adb device lost[57DD383701799F9A]' Count: 1 (2.86%) IDs: hi960-hikey-05: 8285169 Error type: Job Error count: 1 (2.86%) Error: No match for error type 'Job', message 'login-action timed out after 863 seconds' Count: 1 (2.86%) IDs: hi960-hikey-04: 8285170 Device type: dragonboard-845c Total jobs: 143 Total errors: 30 (20.98%) Error type: Test Error count: 23 (16.08%) Error: Device NOT found! Count: 6 (4.20%) IDs: db845c-02: 8284115 8284221 db845c-11: 8285676 8285690 8285692 db845c-14: 8286176 Error: No match for error type 'Test', message 'tradefed - adb device lost[f290bb24]' Count: 2 (1.40%) IDs: db845c-12: 8281108 8285842 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 6 (4.20%) IDs: db845c-02: 8284662 db845c-03: 8285207 db845c-04: 8284661 8285208 db845c-10: 8284664 8285205 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 2 (1.40%) IDs: db845c-02: 8284083 8284657 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 5 (3.50%) IDs: db845c-02: 8284087 8284223 8284229 db845c-07: 8284105 8284117 Error: No match for error type 'Test', message 'tradefed - adb device lost[927ecf10]' Count: 1 (0.70%) IDs: db845c-11: 8283234 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 579 seconds' Count: 1 (0.70%) IDs: db845c-07: 8283187 Error type: Infrastructure Error count: 6 (4.20%) Error: Reboot failed Count: 2 (1.40%) IDs: db845c-11: 8285675 db845c-13: 8285674 Error: Connection closed Count: 1 (0.70%) IDs: db845c-14: 8285673 Error: Unable to fetch git repository Count: 2 (1.40%) IDs: db845c-09: 8283216 db845c-14: 8283236 Error: fastboot-flash-action timed out Count: 1 (0.70%) IDs: db845c-07: 8283212 Error type: Job Error count: 1 (0.70%) Error: No match for error type 'Job', message 'download-postprocess-docker timed out after 4492 seconds' Count: 1 (0.70%) IDs: db845c-09: 8283186 Device type: hi6220-hikey-r2 Total jobs: 16 Total errors: 10 (62.50%) Error type: Test Error count: 9 (56.25%) Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 6 (37.50%) IDs: hikey-6220-r2-05: 8285745 hikey-6220-r2-06: 8285271 8285738 8285740 8285746 8285768 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 1 (6.25%) IDs: hikey-6220-r2-01: 8285741 Error: No match for error type 'Test', message 'tradefed - adb device lost[7B1579B5003E507A]' Count: 1 (6.25%) IDs: hikey-6220-r2-05: 8285270 Error: No match for error type 'Test', message 'tradefed - adb device lost[235D989C003B0752]' Count: 1 (6.25%) IDs: hikey-6220-r2-03: 8285269 Error type: Infrastructure Error count: 1 (6.25%) Error: No match for error type 'Infrastructure', message 'wait-device-boardid timed out after 1169 seconds' Count: 1 (6.25%) IDs: hikey-6220-r2-06: 8285272 Device type: qrb5165-rb5 Total jobs: 83 Total errors: 31 (37.35%) Error type: Test Error count: 25 (30.12%) Error: Device NOT found! Count: 9 (10.84%) IDs: rb5-03: 8284101 8284180 8284213 8284236 8284638 8285729 rb5-06: 8284235 rb5-07: 8284144 8284238 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 1 (1.20%) IDs: rb5-03: 8285711 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 10 (12.05%) IDs: rb5-03: 8284636 8284679 8285664 8285669 8285709 rb5-07: 8284145 8284207 8284300 8285329 8285331 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 590 seconds' Count: 1 (1.20%) IDs: rb5-03: 8285659 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 597 seconds' Count: 1 (1.20%) IDs: rb5-03: 8285658 Error: No match for error type 'Test', message 'lava-docker-test timed out after 299 seconds' Count: 1 (1.20%) IDs: rb5-07: 8284183 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 297 seconds' Count: 1 (1.20%) IDs: rb5-06: 8284177 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 296 seconds' Count: 1 (1.20%) IDs: rb5-06: 8284151 Error type: Infrastructure Error count: 4 (4.82%) Error: fastboot-flash-action timed out Count: 2 (2.41%) IDs: rb5-06: 8284208 rb5-07: 8284234 Error: Unable to fetch git repository Count: 2 (2.41%) IDs: rb5-01: 8284176 rb5-05: 8284179 Error type: Job Error count: 2 (2.41%) Error: No match for error type 'Job', message 'Post-processing of downloads failed' Count: 1 (1.20%) IDs: rb5-01: 8284150 Error: No match for error type 'Job', message 'test-definition timed out after 607 seconds' Count: 1 (1.20%) IDs: rb5-01: 8284146 Device type: x86 Total jobs: 2 Total errors: 0 (0.00%) Device type: sm8550-hdk Total jobs: 15 Total errors: 5 (33.33%) Error type: Test Error count: 5 (33.33%) Error: No match for error type 'Test', message 'tradefed - adb device lost[124d1c34]' Count: 3 (20.00%) IDs: sm8550-hdk-01: 8283145 8283148 8284186 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 7199 seconds' Count: 1 (6.67%) IDs: sm8550-hdk-01: 8283138 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 599 seconds' Count: 1 (6.67%) IDs: sm8550-hdk-01: 8282763

1 year, 5 months

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

Lkft-triage