mainline/master baseline: 958 runs, 222 regressions (v6.3-rc1-230-gef5f68cc1f82) - Kernel-build-reports

11 Mar 2023


      mainline/master baseline: 958 runs, 222 regressions (v6.3-rc1-230-gef5f68cc1f82)
Regressions Summary
-------------------
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | clang-16   | multi_v7_defconfig           | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+ima       | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+crypto    | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | omap2plus_defconfig          | 1          
beaglebone-black             | arm    | lab-broonie     | gcc-10     | omap2plus_defconfig          | 1          
beaglebone-black             | arm    | lab-cip         | gcc-10     | omap2plus_defconfig          | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+ima       | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+crypto    | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10     | davinci_all_defconfig        | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ok+kselftest | 1          
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10     | multi_v7_defconfig+debug     | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | clang-11   | defconfig                    | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | clang-11   | defconfig+CON..._64K_PAGES=y | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+ima                | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+CON...OMIZE_BASE=y | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+videodec           | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+kselftest          | 1          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+crypto             | 5          
kontron-pitx-imx8m           | arm64  | lab-kontron     | clang-11   | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64  | lab-kontron     | clang-16   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ook+videodec | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ook+videodec | 3          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ook+videodec | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10     | oxnas_v6_defconfig           | 1          
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | clang-11   | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-broonie     | clang-11   | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-collabora   | clang-11   | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig+debug         | 1          
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig+debug         | 1          
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig+debug         | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-11   | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-11   | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-16   | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-16   | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | clang-11   | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | clang-11   | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defconfig+rust        | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10     | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | clang-11   | defconfig+CON..._64K_PAGES=y | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1          
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | clang-16   | multi_v7_defconfig           | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+ima       | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+crypto    | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:  https://kernelci.org/test/job/mainline/branch/master/kernel/v6.3-rc1-230-gef...
Test:     baseline
  Tree:     mainline
  Branch:   master
  Describe: v6.3-rc1-230-gef5f68cc1f82
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
  SHA:      ef5f68cc1f829b492b19cd4df5af4454aa816b93
Test Regressions
----------------
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f9a516281e79d8c86a9
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1f9a516281e79d8c86aa
        failing since 13 days (last pass: v6.2-10827-g489fa31ea873, first fail: v6.2-11606-g116b41162f8b)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | clang-16   | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/640c238a82760aa5a58c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c238a82760aa5a58c8630
        failing since 18 days (last pass: v6.2-rc8-151-g925cf0457d7e, first fail: v6.2-340-geca3a04f140a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+ima       | 1
Details:     https://kernelci.org/test/plan/id/640c1d4ae27d33605d8c863c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1d4ae27d33605d8c863d
        failing since 252 days (last pass: v5.19-rc4-125-ga175eca0f3d7, first fail: v5.19-rc4-166-gb336ad598a3b)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+crypto    | 1
Details:     https://kernelci.org/test/plan/id/640c20c94ddc361fd88c8673
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c20c94ddc361fd88c8674
        failing since 31 days (last pass: v6.2-rc7-11-g05ecb680708a, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/640c2147adf46f23138c863c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2147adf46f23138c863d
        failing since 18 days (last pass: v6.2-340-geca3a04f140a, first fail: v6.2-575-g5b0ed5964928)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | omap2plus_defconfig          | 1
Details:     https://kernelci.org/test/plan/id/640c1afed8dacabdee8c8676
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1afed8dacabdee8c8677
        failing since 0 day (last pass: v6.3-rc1-106-g44889ba56cbb3, first fail: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beaglebone-black             | arm    | lab-broonie     | gcc-10     | omap2plus_defconfig          | 1
Details:     https://kernelci.org/test/plan/id/640c1a6bd5d879908c8c871b
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a6bd5d879908c8c8724
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:06:19.030744  <8>[   22.988723] <LAVA_SIGNAL_ENDRUN 0_dmesg 143020_1.5.2.4.1>
    2023-03-11T06:06:19.141245  / # #
    2023-03-11T06:06:19.244032  export SHELL=/bin/sh
    2023-03-11T06:06:19.244852  #
    2023-03-11T06:06:19.347196  / # export SHELL=/bin/sh. /lava-143020/environment
    2023-03-11T06:06:19.347796  
    2023-03-11T06:06:19.449766  / # . /lava-143020/environment/lava-143020/bin/lava-test-runner /lava-143020/1
    2023-03-11T06:06:19.450974  
    2023-03-11T06:06:19.454502  / # /lava-143020/bin/lava-test-runner /lava-143020/1
    2023-03-11T06:06:19.568939  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beaglebone-black             | arm    | lab-cip         | gcc-10     | omap2plus_defconfig          | 1
Details:     https://kernelci.org/test/plan/id/640c1bed78c6eb221b8c8632
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1bed78c6eb221b8c8639
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:12:51.829194  <8>[   14.930772] <LAVA_SIGNAL_ENDRUN 0_dmesg 872272_1.5.2.4.1>
    2023-03-11T06:12:51.938243  / # #
    2023-03-11T06:12:52.041054  export SHELL=/bin/sh
    2023-03-11T06:12:52.041677  #
    2023-03-11T06:12:52.143189  / # export SHELL=/bin/sh. /lava-872272/environment
    2023-03-11T06:12:52.143983  
    2023-03-11T06:12:52.245858  / # . /lava-872272/environment/lava-872272/bin/lava-test-runner /lava-872272/1
    2023-03-11T06:12:52.246997  
    2023-03-11T06:12:52.253064  / # /lava-872272/bin/lava-test-runner /lava-872272/1
    2023-03-11T06:12:52.365199  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+ima       | 1
Details:     https://kernelci.org/test/plan/id/640c1d8666bdbd8fb38c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1d8666bdbd8fb38c8653
        failing since 52 days (last pass: v6.1-13139-gf9ff5644bcc0, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-11T06:18:46.481345  + set +x<8>[   15.069752] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403992_1.5.2.4.1>
    2023-03-11T06:18:46.482230  
    2023-03-11T06:18:46.594960  / # #
    2023-03-11T06:18:46.697413  export SHELL=/bin/sh
    2023-03-11T06:18:46.698474  #
    2023-03-11T06:18:46.800738  / # export SHELL=/bin/sh. /lava-3403992/environment
    2023-03-11T06:18:46.801338  
    2023-03-11T06:18:46.902926  / # . /lava-3403992/environment/lava-3403992/bin/lava-test-runner /lava-3403992/1
    2023-03-11T06:18:46.904148  
    2023-03-11T06:18:46.904476  / # <3>[   15.406421] Bluetooth: hci0: command 0x0c03 tx timeout 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/640c1e1edd6ffffdb28c866c
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1e1edd6ffffdb28c8675
        failing since 52 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-11T06:21:59.971955  + set +x<8>[   17.752959] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404004_1.5.2.4.1>
    2023-03-11T06:21:59.972452  
    2023-03-11T06:22:00.084996  / # #
    2023-03-11T06:22:00.188608  export SHELL=/bin/sh
    2023-03-11T06:22:00.189493  #
    2023-03-11T06:22:00.189987  / # export SHELL=/bin/sh<3>[   17.966349] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-11T06:22:00.292050  . /lava-3404004/environment
    2023-03-11T06:22:00.293096  
    2023-03-11T06:22:00.395661  / # . /lava-3404004/environment/lava-3404004/bin/lava-test-runner /lava-3404004/1
    2023-03-11T06:22:00.396983   
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1
Details:     https://kernelci.org/test/plan/id/640c1eb28dbb20067f8c8650
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1eb28dbb20067f8c8659
        failing since 52 days (last pass: v6.1-13139-gf9ff5644bcc0, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-11T06:24:26.620285  <8>[   16.644706] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404057_1.5.2.4.1>
    2023-03-11T06:24:26.726732  / # #
    2023-03-11T06:24:26.828075  export SHELL=/bin/sh
    2023-03-11T06:24:26.828624  #
    2023-03-11T06:24:26.929756  / # export SHELL=/bin/sh. /lava-3404057/environment
    2023-03-11T06:24:26.930122  
    2023-03-11T06:24:27.031258  / # . /lava-3404057/environment/lava-3404057/bin/lava-test-runner /lava-3404057/1
    2023-03-11T06:24:27.031780  
    2023-03-11T06:24:27.036655  / # /lava-3404057/bin/lava-test-runner /lava-3404057/1
    2023-03-11T06:24:27.117135  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+crypto    | 1
Details:     https://kernelci.org/test/plan/id/640c1f9b8b42bef38b8c864e
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f9b8b42bef38b8c8657
        failing since 52 days (last pass: v6.1-13139-gf9ff5644bcc0, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-11T06:27:15.555660  + set +x<8>[   24.408844] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404123_1.5.2.4.1>
    2023-03-11T06:27:15.556411  
    2023-03-11T06:27:15.667478  / # #
    2023-03-11T06:27:15.770827  export SHELL=/bin/sh
    2023-03-11T06:27:15.771927  #
    2023-03-11T06:27:15.873909  / # export SHELL=/bin/sh. /lava-3404123/environment
    2023-03-11T06:27:15.875180  
    2023-03-11T06:27:15.977220  / # . /lava-3404123/environment/lava-3404123/bin/lava-test-runner /lava-3404123/1
    2023-03-11T06:27:15.979035  
    2023-03-11T06:27:15.983755  / # /lava-3404123/bin/lava-test-runner /lava-3404123/1 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/640c202b1c0538d2158c865b
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c202b1c0538d2158c8664
        failing since 52 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-11T06:30:50.102815  <8>[   15.337923] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404180_1.5.2.4.1>
    2023-03-11T06:30:50.211757  / # #
    2023-03-11T06:30:50.313394  export SHELL=/bin/sh
    2023-03-11T06:30:50.313841  #
    2023-03-11T06:30:50.415072  / # export SHELL=/bin/sh. /lava-3404180/environment
    2023-03-11T06:30:50.415498  
    2023-03-11T06:30:50.415700  / # . /lava-3404180/environment<3>[   15.641507] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-03-11T06:30:50.516917  /lava-3404180/bin/lava-test-runner /lava-3404180/1
    2023-03-11T06:30:50.517475  
    2023-03-11T06:30:50.522467  / # /lava-3404180/bin/lava-test-runner /lava-3404180/1 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10     | davinci_all_defconfig        | 1
Details:     https://kernelci.org/test/plan/id/640c18af82ca04c0058c864e
Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.dmesg.emerg: https://kernelci.org/test/case/id/640c18af82ca04c0058c8651
        failing since 8 days (last pass: v6.2-1847-gdb77b8502a40, first fail: v6.2-13277-g2eb29d59ddf0)
        30 lines
2023-03-11T05:58:48.818693  kern  :alert : Register r6 information: NULL pointer
    2023-03-11T05:58:48.862690  kern  :alert : Register r7 information: non-paged memory
    2023-03-11T05:58:48.863374  kern  :alert : Register r8 information: slab kmalloc-512 start c4c57200 pointer offset 4 size 512
    2023-03-11T05:58:48.863815  kern  :alert : Register r9 information: non-paged memory
    2023-03-11T05:58:48.864222  kern  :alert : Register r10 information: NULL pointer
    2023-03-11T05:58:48.864610  kern  :alert : Register r11 information: 5-page vmalloc region starting at 0xbf3e6000 allocated at load_module+0x898/0x1b10
    2023-03-11T05:58:48.866034  kern  :alert : Register r12 information: non-paged memory
    2023-03-11T05:58:48.954150  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-03-11T05:58:48.954857  kern  :emerg : Process udevd (pid: 64, stack limit = 0x77a27f8e)
    2023-03-11T05:58:48.955321  kern  :emerg : Stack: (0xc88fdcf8 to 0xc88fe000) 
    ... (9 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c1c922c74f816888c8652
Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.dmesg.emerg: https://kernelci.org/test/case/id/640c1c922c74f816888c8655
        failing since 1 day (last pass: v6.3-rc1-19-g6a98c9cae2328, first fail: v6.3-rc1-106-g44889ba56cbb3)
        3 lines
2023-03-11T06:15:31.689104  kern  :emerg : __common_interrupt: 1.55 No irq handler for vector
2023-03-11T06:15:31.695542  kern  :emerg : __common_interrupt: 2.55 No irq handler for vector
2023-03-11T06:15:31.708798  kern  :emerg : __common_interrupt: 3.55 No irq handler for vector<8>[   12.422713] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=3>
2023-03-11T06:15:31.708891
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c2136683a1003ad8c8660
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2136683a1003ad8c8661
        failing since 126 days (last pass: v6.0-rc6, first fail: v6.1-rc3-239-g10d916c86eca)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1e2e03985a4b268c8654
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e2e03985a4b268c8655
        failing since 315 days (last pass: v5.18-rc2, first fail: v5.18-rc4-205-g3e71713c9e75)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c1acf8eb61ef3978c8674
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/ris...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/ris...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1acf8eb61ef3978c8675
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | clang-11   | defconfig                    | 5
Details:     https://kernelci.org/test/plan/id/640c1ba532e584721d8c87e9
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ba532e584721d8c87f0
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:11:30.499203  <8>[   22.037108] <LAVA_SIGNAL_ENDRUN 0_dmesg 292587_1.5.2.4.1>
    2023-03-11T06:11:30.603148  / # #
    2023-03-11T06:11:30.705093  export SHELL=/bin/sh
    2023-03-11T06:11:30.705698  #
    2023-03-11T06:11:30.806982  / # export SHELL=/bin/sh. /lava-292587/environment
    2023-03-11T06:11:30.807644  
    2023-03-11T06:11:30.909341  / # . /lava-292587/environment/lava-292587/bin/lava-test-runner /lava-292587/1
    2023-03-11T06:11:30.910184  
    2023-03-11T06:11:30.914887  / # /lava-292587/bin/lava-test-runner /lava-292587/1
    2023-03-11T06:11:30.981954  + export 'TESTRUN_ID=1_bootrr' 
    ... (18 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/640c1ba532e584721d8c87f4
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:11:33.077067  /lava-292587/1/../bin/lava-test-case
    2023-03-11T06:11:33.077353  <8>[   24.597242] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-11T06:11:33.077503  /lava-292587/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/640c1ba532e584721d8c87f6
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:11:34.136175  /lava-292587/1/../bin/lava-test-case
    2023-03-11T06:11:34.136492  <8>[   25.635289] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-11T06:11:34.136641  /lava-292587/1/../bin/lava-test-case
    2023-03-11T06:11:34.136801  <8>[   25.652279] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2023-03-11T06:11:34.136963  /lava-292587/1/../bin/lava-test-case
    2023-03-11T06:11:34.137100  <8>[   25.671939] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2023-03-11T06:11:34.137250  /lava-292587/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/640c1ba532e584721d8c87fb
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:11:35.212292  /lava-292587/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/640c1ba532e584721d8c87fc
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:11:35.215375  <8>[   26.749136] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-11T06:11:36.268929  /lava-292587/1/../bin/lava-test-case
    2023-03-11T06:11:36.269213  <8>[   27.770284] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-11T06:11:36.269362  /lava-292587/1/../bin/lava-test-case
    2023-03-11T06:11:36.269503  <8>[   27.787819] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2023-03-11T06:11:36.269642  /lava-292587/1/../bin/lava-test-case
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | clang-11   | defconfig+CON..._64K_PAGES=y | 5
Details:     https://kernelci.org/test/plan/id/640c200426f70287af8c867f
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c200426f70287af8c8686
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:30:12.883859  / # #
    2023-03-11T06:30:12.985540  export SHELL=/bin/sh
    2023-03-11T06:30:12.986275  #
    2023-03-11T06:30:13.087648  / # export SHELL=/bin/sh. /lava-292620/environment
    2023-03-11T06:30:13.088195  
    2023-03-11T06:30:13.189677  / # . /lava-292620/environment/lava-292620/bin/lava-test-runner /lava-292620/1
    2023-03-11T06:30:13.190579  
    2023-03-11T06:30:13.196879  / # /lava-292620/bin/lava-test-runner /lava-292620/1
    2023-03-11T06:30:13.263780  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:30:13.264330  + <8>[   22.627286] <LAVA_SIGNAL_STARTRUN 1_bootrr 292620_1.5.2.4.5> 
    ... (17 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/640c200426f70287af8c868a
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:30:15.358939  /lava-292620/1/../bin/lava-test-case
    2023-03-11T06:30:15.359600  <8>[   24.733453] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-11T06:30:15.359894  /lava-292620/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/640c200426f70287af8c868c
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:30:16.414978  /lava-292620/1/../bin/lava-test-case
    2023-03-11T06:30:16.415294  <8>[   25.770904] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-11T06:30:16.415485  /lava-292620/1/../bin/lava-test-case
    2023-03-11T06:30:16.415709  <8>[   25.787149] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2023-03-11T06:30:16.415942  /lava-292620/1/../bin/lava-test-case
    2023-03-11T06:30:16.416164  <8>[   25.806049] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2023-03-11T06:30:16.416384  /lava-292620/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/640c200426f70287af8c8691
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:30:17.490387  /lava-292620/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/640c200426f70287af8c8692
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:30:17.493574  <8>[   26.881666] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-11T06:30:18.553132  /lava-292620/1/../bin/lava-test-case
    2023-03-11T06:30:18.553530  <8>[   27.903343] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-11T06:30:18.553769  /lava-292620/1/../bin/lava-test-case
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+ima                | 5
Details:     https://kernelci.org/test/plan/id/640c19ec9167bf9dcd8c8635
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c19ec9167bf9dcd8c863c
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:04:09.087379  <8>[   22.092570] <LAVA_SIGNAL_ENDRUN 0_dmesg 292563_1.5.2.4.1>
    2023-03-11T06:04:09.192808  / # #
    2023-03-11T06:04:09.294711  export SHELL=/bin/sh
    2023-03-11T06:04:09.295323  #
    2023-03-11T06:04:09.396742  / # export SHELL=/bin/sh. /lava-292563/environment
    2023-03-11T06:04:09.397256  
    2023-03-11T06:04:09.498783  / # . /lava-292563/environment/lava-292563/bin/lava-test-runner /lava-292563/1
    2023-03-11T06:04:09.499503  
    2023-03-11T06:04:09.504743  / # /lava-292563/bin/lava-test-runner /lava-292563/1
    2023-03-11T06:04:09.571685  + export 'TESTRUN_ID=1_bootrr' 
    ... (16 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/640c19ec9167bf9dcd8c8640
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:04:11.667805  /lava-292563/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/640c19ec9167bf9dcd8c8642
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:04:12.724318  /lava-292563/1/../bin/lava-test-case
    2023-03-11T06:04:12.724687  <8>[   25.697306] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/640c19ec9167bf9dcd8c8647
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:04:13.798956  /lava-292563/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/640c19ec9167bf9dcd8c8648
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:04:13.802211  <8>[   26.807654] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-11T06:04:14.855697  /lava-292563/1/../bin/lava-test-case
    2023-03-11T06:04:14.856087  <8>[   27.828816] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-11T06:04:14.856325  /lava-292563/1/../bin/lava-test-case
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+CON...OMIZE_BASE=y | 5
Details:     https://kernelci.org/test/plan/id/640c1a53278ed2bfa28c8651
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a53278ed2bfa28c8658
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:05:52.765332  
    2023-03-11T06:05:52.866788  / # #export SHELL=/bin/sh
    2023-03-11T06:05:52.867570  
    2023-03-11T06:05:52.969508  / # export SHELL=/bin/sh. /lava-292572/environment
    2023-03-11T06:05:52.970055  
    2023-03-11T06:05:53.071576  / # . /lava-292572/environment/lava-292572/bin/lava-test-runner /lava-292572/1
    2023-03-11T06:05:53.072612  
    2023-03-11T06:05:53.076915  / # /lava-292572/bin/lava-test-runner /lava-292572/1
    2023-03-11T06:05:53.144641  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:05:53.144973  + <8>[   22.539745] <LAVA_SIGNAL_STARTRUN 1_bootrr 292572_1.5.2.4.5> 
    ... (15 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/640c1a53278ed2bfa28c865c
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:05:55.239656  /lava-292572/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/640c1a53278ed2bfa28c865e
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:05:56.299745  /lava-292572/1/../bin/lava-test-case
    2023-03-11T06:05:56.300169  <8>[   25.684188] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/640c1a53278ed2bfa28c8663
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:05:57.374896  /lava-292572/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/640c1a53278ed2bfa28c8664
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:05:57.377994  <8>[   26.799266] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-11T06:05:58.435115  /lava-292572/1/../bin/lava-test-case
    2023-03-11T06:05:58.435512  <8>[   27.820293] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-11T06:05:58.435749  /lava-292572/1/../bin/lava-test-case
    2023-03-11T06:05:58.435986  <8>[   27.836594] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2023-03-11T06:05:58.436210  /lava-292572/1/../bin/lava-test-case
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+videodec           | 5
Details:     https://kernelci.org/test/plan/id/640c2068ccf7d6a07d8c8635
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c2068ccf7d6a07d8c863c
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:31:50.190279  / # #
    2023-03-11T06:31:50.292120  export SHELL=/bin/sh
    2023-03-11T06:31:50.292753  #
    2023-03-11T06:31:50.393990  / # export SHELL=/bin/sh. /lava-292628/environment
    2023-03-11T06:31:50.394618  
    2023-03-11T06:31:50.495871  / # . /lava-292628/environment/lava-292628/bin/lava-test-runner /lava-292628/1
    2023-03-11T06:31:50.496712  
    2023-03-11T06:31:50.503494  / # /lava-292628/bin/lava-test-runner /lava-292628/1
    2023-03-11T06:31:50.569573  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:31:50.569861  + <8>[   22.543854] <LAVA_SIGNAL_STARTRUN 1_bootrr 292628_1.5.2.4.5> 
    ... (18 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/640c2069ccf7d6a07d8c8640
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:31:52.663658  /lava-292628/1/../bin/lava-test-case
    2023-03-11T06:31:52.664076  <8>[   24.650895] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-11T06:31:52.664238  /lava-292628/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/640c2069ccf7d6a07d8c8642
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:31:53.724002  /lava-292628/1/../bin/lava-test-case
    2023-03-11T06:31:53.724294  <8>[   25.688539] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-11T06:31:53.724443  /lava-292628/1/../bin/lava-test-case
    2023-03-11T06:31:53.724580  <8>[   25.706040] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2023-03-11T06:31:53.724718  /lava-292628/1/../bin/lava-test-case
    2023-03-11T06:31:53.724851  <8>[   25.725833] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2023-03-11T06:31:53.724984  /lava-292628/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/640c2069ccf7d6a07d8c8647
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:31:54.799059  /lava-292628/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/640c2069ccf7d6a07d8c8648
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:31:54.802291  <8>[   26.802799] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-11T06:31:55.854605  /lava-292628/1/../bin/lava-test-case
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c224fe5b2b79ed78c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c224fe5b2b79ed78c864c
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10     | defconfig+crypto             | 5
Details:     https://kernelci.org/test/plan/id/640c22c41bc61b7c068c8675
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c22c41bc61b7c068c867c
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:41:51.121604  / # #
    2023-03-11T06:41:51.223216  export SHELL=/bin/sh
    2023-03-11T06:41:51.223653  #
    2023-03-11T06:41:51.325125  / # export SHELL=/bin/sh. /lava-292647/environment
    2023-03-11T06:41:51.325605  
    2023-03-11T06:41:51.426975  / # . /lava-292647/environment/lava-292647/bin/lava-test-runner /lava-292647/1
    2023-03-11T06:41:51.427789  
    2023-03-11T06:41:51.434871  / # /lava-292647/bin/lava-test-runner /lava-292647/1
    2023-03-11T06:41:51.500791  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:41:51.501113  + <8>[   43.753979] <LAVA_SIGNAL_STARTRUN 1_bootrr 292647_1.5.2.4.5> 
    ... (17 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/640c22c41bc61b7c068c8680
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:41:53.595803  /lava-292647/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/640c22c41bc61b7c068c8682
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:41:54.656404  /lava-292647/1/../bin/lava-test-case
    2023-03-11T06:41:54.656675  <8>[   46.899017] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-11T06:41:54.656824  /lava-292647/1/../bin/lava-test-case
    2023-03-11T06:41:54.656962  <8>[   46.916341] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2023-03-11T06:41:54.657138  /lava-292647/1/../bin/lava-test-case
    2023-03-11T06:41:54.657275  <8>[   46.936784] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2023-03-11T06:41:54.657412  /lava-292647/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/640c22c41bc61b7c068c8687
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:41:55.732155  /lava-292647/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/640c22c41bc61b7c068c8688
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:41:55.735415  <8>[   48.014291] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-11T06:41:56.794594  /lava-292647/1/../bin/lava-test-case
    2023-03-11T06:41:56.795061  <8>[   49.035622] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-11T06:41:56.795308  /lava-292647/1/../bin/lava-test-case
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-pitx-imx8m           | arm64  | lab-kontron     | clang-11   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1eec73ce9f6a918c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1eec73ce9f6a918c863e
        failing since 8 days (last pass: v6.2-12485-gf3a2439f20d91, first fail: v6.2-13277-g2eb29d59ddf0)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-pitx-imx8m           | arm64  | lab-kontron     | clang-16   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1e9c8dbb20067f8c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e9c8dbb20067f8c8634
        failing since 3 days (last pass: v6.2-12485-gf3a2439f20d91, first fail: v6.3-rc1-2-g8ca09d5fa354)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1aa52ece4659408c8645
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1aa52ece4659408c864e
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:07:20.288894  / # #
    2023-03-11T06:07:20.390732  export SHELL=/bin/sh
    2023-03-11T06:07:20.391234  #
    2023-03-11T06:07:20.492625  / # export SHELL=/bin/sh. /lava-3403925/environment
    2023-03-11T06:07:20.493114  
    2023-03-11T06:07:20.493420  / # <3>[   18.126728] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:07:20.594836  . /lava-3403925/environment/lava-3403925/bin/lava-test-runner /lava-3403925/1
    2023-03-11T06:07:20.595776  
    2023-03-11T06:07:20.609975  / # /lava-3403925/bin/lava-test-runner /lava-3403925/1
    2023-03-11T06:07:20.665874  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f2d0a85a0fb648c86f2
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f2d0a85a0fb648c86fb
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:26:28.442110  / # #
    2023-03-11T06:26:28.543617  export SHELL=/bin/sh
    2023-03-11T06:26:28.543971  #
    2023-03-11T06:26:28.645171  / # export SHELL=/bin/sh. /lava-3404151/environment
    2023-03-11T06:26:28.645524  <3>[   18.714408] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:26:28.645734  
    2023-03-11T06:26:28.746917  / # . /lava-3404151/environment/lava-3404151/bin/lava-test-runner /lava-3404151/1
    2023-03-11T06:26:28.747496  
    2023-03-11T06:26:28.764179  / # /lava-3404151/bin/lava-test-runner /lava-3404151/1
    2023-03-11T06:26:28.825042  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1ec894ab99d09e8c8634
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ec894ab99d09e8c863d
        failing since 15 days (last pass: v6.2-6695-gd8ca6dbb8de7, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:24:52.203168  / # #
    2023-03-11T06:24:52.304973  export SHELL=/bin/sh
    2023-03-11T06:24:52.305402  #
    2023-03-11T06:24:52.406755  / # export SHELL=/bin/sh. /lava-3404092/environment
    2023-03-11T06:24:52.407243  <3>[   17.971007] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:24:52.407490  
    2023-03-11T06:24:52.508854  / # . /lava-3404092/environment/lava-3404092/bin/lava-test-runner /lava-3404092/1
    2023-03-11T06:24:52.510296  
    2023-03-11T06:24:52.526474  / # /lava-3404092/bin/lava-test-runner /lava-3404092/1
    2023-03-11T06:24:52.588528  + export 'TESTRUN_ID=1_bootrr' 
    ... (17 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/640c19a1099b0292588c8632
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c19a1099b0292588c863b
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:03:05.896285  / # #
    2023-03-11T06:03:05.997776  export SHELL=/bin/sh
    2023-03-11T06:03:05.998132  #
    2023-03-11T06:03:06.099327  / # export SHELL=/bin/sh. /lava-3403787/environment
    2023-03-11T06:03:06.099792  
    2023-03-11T06:03:06.100047  / # <3>[   18.085122] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:03:06.201381  . /lava-3403787/environment/lava-3403787/bin/lava-test-runner /lava-3403787/1
    2023-03-11T06:03:06.202141  
    2023-03-11T06:03:06.215563  / # /lava-3403787/bin/lava-test-runner /lava-3403787/1
    2023-03-11T06:03:06.272372  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1a058087c3fdf58c8652
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a058087c3fdf58c865b
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:04:35.254223  / # #
    2023-03-11T06:04:35.355981  export SHELL=/bin/sh
    2023-03-11T06:04:35.356405  #
    2023-03-11T06:04:35.457757  / # export SHELL=/bin/sh. /lava-3403808/environment
    2023-03-11T06:04:35.458199  
    2023-03-11T06:04:35.458436  / # <3>[   18.023048] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:04:35.559664  . /lava-3403808/environment/lava-3403808/bin/lava-test-runner /lava-3403808/1
    2023-03-11T06:04:35.560346  
    2023-03-11T06:04:35.575844  / # /lava-3403808/bin/lava-test-runner /lava-3403808/1
    2023-03-11T06:04:35.630762  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1a5405cf2e1df28c862f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a5405cf2e1df28c8638
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:06:06.412029  <8>[   17.788756] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403891_1.5.2.4.1>
    2023-03-11T06:06:06.517275  / # #
    2023-03-11T06:06:06.618945  export SHELL=/bin/sh
    2023-03-11T06:06:06.619365  #
    2023-03-11T06:06:06.720759  / # export SHELL=/bin/sh. /lava-3403891/environment
    2023-03-11T06:06:06.721180  <3>[   18.026769] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:06:06.721425  
    2023-03-11T06:06:06.822713  / # . /lava-3403891/environment/lava-3403891/bin/lava-test-runner /lava-3403891/1
    2023-03-11T06:06:06.824268  
    2023-03-11T06:06:06.833371  / # /lava-3403891/bin/lava-test-runner /lava-3403891/1 
    ... (17 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/640c1f90516281e79d8c866f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f90516281e79d8c8678
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:28:09.587168  <8>[   17.677187] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404164_1.5.2.4.1>
    2023-03-11T06:28:09.691254  / # #
    2023-03-11T06:28:09.793040  export SHELL=/bin/sh
    2023-03-11T06:28:09.793447  #
    2023-03-11T06:28:09.894808  / # export SHELL=/bin/sh. /lava-3404164/environment
    2023-03-11T06:28:09.895284  
    2023-03-11T06:28:09.895568  / # <3>[   17.915711] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:28:09.996894  . /lava-3404164/environment/lava-3404164/bin/lava-test-runner /lava-3404164/1
    2023-03-11T06:28:09.997441  
    2023-03-11T06:28:10.013775  / # /lava-3404164/bin/lava-test-runner /lava-3404164/1 
    ... (15 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c210c66418f01578c8642
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c210c66418f01578c8643
        failing since 33 days (last pass: v6.2-rc6-289-g870c3a9a2bc4, first fail: v6.2-rc7)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/640c21ad1744bc28928c8651
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c21ad1744bc28928c865a
        failing since 15 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:37:26.151958  / # #
    2023-03-11T06:37:26.253759  export SHELL=/bin/sh
    2023-03-11T06:37:26.254187  #
    2023-03-11T06:37:26.355571  / # export SHELL=/bin/sh. /lava-3404261/environment
    2023-03-11T06:37:26.356025  
    2023-03-11T06:37:26.356276  / # <3>[  102.797440] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:37:26.457674  . /lava-3404261/environment/lava-3404261/bin/lava-test-runner /lava-3404261/1
    2023-03-11T06:37:26.458379  
    2023-03-11T06:37:26.499161  / # /lava-3404261/bin/lava-test-runner /lava-3404261/1
    2023-03-11T06:37:26.499420  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c21ff1ee5ae844d8c86e9
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c21ff1ee5ae844d8c86ea
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c2247eddf9b20c68c8636
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2247eddf9b20c68c8637
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c217d15add897588c8635
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c217d15add897588c8636
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c210294319f13018c8662
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c210294319f13018c8663
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c21490f6171d2708c86b0
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c21490f6171d2708c86b1
        failing since 18 days (last pass: v6.2-340-geca3a04f140a, first fail: v6.2-575-g5b0ed5964928)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1b15a5427563b28c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1b15a5427563b28c8653
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:08:55.567280  + set +x<8>[   19.087332] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403946_1.5.2.4.1>
    2023-03-11T06:08:55.567519  
    2023-03-11T06:08:55.672500  / # #
    2023-03-11T06:08:55.774182  export SHELL=/bin/sh
    2023-03-11T06:08:55.774532  #
    2023-03-11T06:08:55.875906  / # export SHELL=/bin/sh. /lava-3403946/environment
    2023-03-11T06:08:55.876254  
    2023-03-11T06:08:55.977609  / # . /lava-3403946/environment/lava-3403946/bin/lava-test-runner /lava-3403946/1
    2023-03-11T06:08:55.978206  
    2023-03-11T06:08:55.983285  / # /lava-3403946/bin/lava-test-runner /lava-3403946/1 
    ... (17 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f74ec34b1d64a8c862f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f74ec34b1d64a8c8638
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:27:30.590753  + set<8>[   20.077223] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404146_1.5.2.4.1>
    2023-03-11T06:27:30.590984   +x
    2023-03-11T06:27:30.696442  / # #
    2023-03-11T06:27:30.798231  export SHELL=/bin/sh
    2023-03-11T06:27:30.798766  #
    2023-03-11T06:27:30.900169  / # export SHELL=/bin/sh. /lava-3404146/environment
    2023-03-11T06:27:30.900716  
    2023-03-11T06:27:31.002136  / # . /lava-3404146/environment/lava-3404146/bin/lava-test-runner /lava-3404146/1
    2023-03-11T06:27:31.002929  
    2023-03-11T06:27:31.007246  / # /lava-3404146/bin/lava-test-runner /lava-3404146/1 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1ee4679ba411aa8c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ee5679ba411aa8c8653
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12018-g2fcd07b7ccd5f)
2023-03-11T06:25:16.713648  / # #
    2023-03-11T06:25:16.815231  export SHELL=/bin/sh
    2023-03-11T06:25:16.815762  #
    2023-03-11T06:25:16.917302  / # export SHELL=/bin/sh. /lava-3404098/environment
    2023-03-11T06:25:16.917853  
    2023-03-11T06:25:17.019289  / # . /lava-3404098/environment/lava-3404098/bin/lava-test-runner /lava-3404098/1
    2023-03-11T06:25:17.020158  
    2023-03-11T06:25:17.023981  / # /lava-3404098/bin/lava-test-runner /lava-3404098/1
    2023-03-11T06:25:17.103945  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:25:17.104747  + cd /lava-3404098/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/640c19d60ef4667e098c8669
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c19d60ef4667e098c8672
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:03:26.614364  + set +x<8>[   18.250158] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403782_1.5.2.4.1>
    2023-03-11T06:03:26.719817  / # #
    2023-03-11T06:03:26.821675  export SHELL=/bin/sh
    2023-03-11T06:03:26.822047  #
    2023-03-11T06:03:26.923381  / # export SHELL=/bin/sh. /lava-3403782/environment
    2023-03-11T06:03:26.923842  
    2023-03-11T06:03:27.025221  / # . /lava-3403782/environment/lava-3403782/bin/lava-test-runner /lava-3403782/1
    2023-03-11T06:03:27.025929  
    2023-03-11T06:03:27.031367  / # /lava-3403782/bin/lava-test-runner /lava-3403782/1
    2023-03-11T06:03:27.103087  + export 'TESTRUN_ID=1_bootrr' 
    ... (16 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1aa6b99e3c68eb8c8655
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1aa6b99e3c68eb8c865e
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:07:19.774421  / # #
    2023-03-11T06:07:19.876227  export SHELL=/bin/sh
    2023-03-11T06:07:19.876686  <3>[   17.676514] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:07:19.876933  #
    2023-03-11T06:07:19.978265  / # export SHELL=/bin/sh. /lava-3403908/environment
    2023-03-11T06:07:19.978794  
    2023-03-11T06:07:20.080206  / # . /lava-3403908/environment/lava-3403908/bin/lava-test-runner /lava-3403908/1
    2023-03-11T06:07:20.081006  
    2023-03-11T06:07:20.096656  / # /lava-3403908/bin/lava-test-runner /lava-3403908/1
    2023-03-11T06:07:20.155470  + export 'TESTRUN_ID=1_bootrr' 
    ... (16 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/640c1fec25934ad5728c86ed
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1fec25934ad5728c86f6
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:29:41.724529  / # #
    2023-03-11T06:29:41.826243  export SHELL=/bin/sh
    2023-03-11T06:29:41.826618  #
    2023-03-11T06:29:41.927927  / # export SHELL=/bin/sh. /lava-3404172/environment
    2023-03-11T06:29:41.928297  
    2023-03-11T06:29:42.029674  / # . /lava-3404172/environment/lava-3404172/bin/lava-test-runner /lava-3404172/1
    2023-03-11T06:29:42.030291  
    2023-03-11T06:29:42.035881  / # /lava-3404172/bin/lava-test-runner /lava-3404172/1
    2023-03-11T06:29:42.067878  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:29:42.102770  + cd /lava-3404172/1/tests/1_bootrr 
    ... (16 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c2157adf46f23138c8648
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2157adf46f23138c8649
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/640c21d8d2b2a68dec8c863d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c21d8d2b2a68dec8c8646
        failing since 15 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:38:01.740855  + set +x<8>[   34.866188] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404247_1.5.2.4.1>
    2023-03-11T06:38:01.846165  / # #
    2023-03-11T06:38:01.947849  export SHELL=/bin/sh
    2023-03-11T06:38:01.948202  #
    2023-03-11T06:38:02.049566  / # export SHELL=/bin/sh. /lava-3404247/environment
    2023-03-11T06:38:02.050382  
    2023-03-11T06:38:02.151992  / # . /lava-3404247/environment/lava-3404247/bin/lava-test-runner /lava-3404247/1
    2023-03-11T06:38:02.153179  
    2023-03-11T06:38:02.157673  / # /lava-3404247/bin/lava-test-runner /lava-3404247/1
    2023-03-11T06:38:02.189727  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1b550a2ee8c0a28c865a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1b550a2ee8c0a28c8663
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:09:54.870015  <8>[   18.121960] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403951_1.5.2.4.1>
    2023-03-11T06:09:54.975404  / # #
    2023-03-11T06:09:55.077144  export SHELL=/bin/sh
    2023-03-11T06:09:55.077496  #
    2023-03-11T06:09:55.178829  / # export SHELL=/bin/sh. /lava-3403951/environment
    2023-03-11T06:09:55.179181  
    2023-03-11T06:09:55.280489  / # . /lava-3403951/environment/lava-3403951/bin/lava-test-runner /lava-3403951/1
    2023-03-11T06:09:55.281126  
    2023-03-11T06:09:55.286493  / # /lava-3403951/bin/lava-test-runner /lava-3403951/1
    2023-03-11T06:09:55.364385  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f728b8781977f8c8691
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f728b8781977f8c869a
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:27:32.173552  / # #
    2023-03-11T06:27:32.275575  export SHELL=/bin/sh
    2023-03-11T06:27:32.276105  #
    2023-03-11T06:27:32.377430  / # export SHELL=/bin/sh. /lava-3404137/environment
    2023-03-11T06:27:32.377957  
    2023-03-11T06:27:32.479343  / # . /lava-3404137/environment/lava-3404137/bin/lava-test-runner /lava-3404137/1
    2023-03-11T06:27:32.480136  
    2023-03-11T06:27:32.484621  / # /lava-3404137/bin/lava-test-runner /lava-3404137/1
    2023-03-11T06:27:32.533057  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:27:32.573533  + cd /lava-3404137/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1ef4d09727a2988c8653
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ef4d09727a2988c865c
        failing since 15 days (last pass: v6.2-6695-gd8ca6dbb8de7, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:25:28.912943  <8>[   18.013786] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=pass UNITS=lines MEASUREMENT=0>
    2023-03-11T06:25:28.913185  + set +x
    2023-03-11T06:25:28.914774  <8>[   18.018215] <LAVA_SIGNAL_ENDRUN 0_dmesg 3404082_1.5.2.4.1>
    2023-03-11T06:25:29.020279  / # #
    2023-03-11T06:25:29.122684  export SHELL=/bin/sh
    2023-03-11T06:25:29.123247  #
    2023-03-11T06:25:29.224818  / # export SHELL=/bin/sh. /lava-3404082/environment
    2023-03-11T06:25:29.225589  
    2023-03-11T06:25:29.326910  / # . /lava-3404082/environment/lava-3404082/bin/lava-test-runner /lava-3404082/1
    2023-03-11T06:25:29.327979   
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/640c19d246f48ee83d8c8631
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c19d246f48ee83d8c863a
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:03:39.166919  / # #
    2023-03-11T06:03:39.269264  export SHELL=/bin/sh
    2023-03-11T06:03:39.269816  #
    2023-03-11T06:03:39.371303  / # export SHELL=/bin/sh. /lava-3403770/environment
    2023-03-11T06:03:39.371909  
    2023-03-11T06:03:39.473440  / # . /lava-3403770/environment/lava-3403770/bin/lava-test-runner /lava-3403770/1
    2023-03-11T06:03:39.474375  
    2023-03-11T06:03:39.491573  / # /lava-3403770/bin/lava-test-runner /lava-3403770/1
    2023-03-11T06:03:39.557391  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:03:39.558078  + cd /lava-3403770/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1a55cb485a6dc28c86a6
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a55cb485a6dc28c86af
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:06:00.267893  / # #
    2023-03-11T06:06:00.369864  export SHELL=/bin/sh
    2023-03-11T06:06:00.370375  #
    2023-03-11T06:06:00.471675  / # export SHELL=/bin/sh. /lava-3403826/environment
    2023-03-11T06:06:00.472085  
    2023-03-11T06:06:00.573424  / # . /lava-3403826/environment/lava-3403826/bin/lava-test-runner /lava-3403826/1
    2023-03-11T06:06:00.574062  
    2023-03-11T06:06:00.579053  / # /lava-3403826/bin/lava-test-runner /lava-3403826/1
    2023-03-11T06:06:00.660954  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:06:00.661432  + cd /lava-3403826/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1aca8eb61ef3978c8658
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1aca8eb61ef3978c8661
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:07:50.939183  / # #
    2023-03-11T06:07:51.040852  export SHELL=/bin/sh
    2023-03-11T06:07:51.041198  #
    2023-03-11T06:07:51.142507  / # export SHELL=/bin/sh. /lava-3403905/environment
    2023-03-11T06:07:51.142855  
    2023-03-11T06:07:51.244175  / # . /lava-3403905/environment/lava-3403905/bin/lava-test-runner /lava-3403905/1
    2023-03-11T06:07:51.244788  
    2023-03-11T06:07:51.251713  / # /lava-3403905/bin/lava-test-runner /lava-3403905/1
    2023-03-11T06:07:51.330572  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:07:51.331051  + cd /lava-3403905/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/640c200926f70287af8c86f6
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c200926f70287af8c86ff
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:29:54.130674  / # #
    2023-03-11T06:29:54.232502  export SHELL=/bin/sh
    2023-03-11T06:29:54.233038  #
    2023-03-11T06:29:54.334373  / # export SHELL=/bin/sh. /lava-3404179/environment
    2023-03-11T06:29:54.334890  
    2023-03-11T06:29:54.436223  / # . /lava-3404179/environment/lava-3404179/bin/lava-test-runner /lava-3404179/1
    2023-03-11T06:29:54.436895  
    2023-03-11T06:29:54.441372  / # /lava-3404179/bin/lava-test-runner /lava-3404179/1
    2023-03-11T06:29:54.519267  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:29:54.519746  + cd /lava-3404179/1/tests/1_bootrr 
    ... (15 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/640c22592f46d298228c862f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c22592f46d298228c8638
        failing since 15 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:39:59.973401  / # #
    2023-03-11T06:40:00.075121  export SHELL=/bin/sh
    2023-03-11T06:40:00.075488  #
    2023-03-11T06:40:00.176804  / # export SHELL=/bin/sh. /lava-3404264/environment
    2023-03-11T06:40:00.177163  
    2023-03-11T06:40:00.278499  / # . /lava-3404264/environment/lava-3404264/bin/lava-test-runner /lava-3404264/1
    2023-03-11T06:40:00.279115  
    2023-03-11T06:40:00.284652  / # /lava-3404264/bin/lava-test-runner /lava-3404264/1
    2023-03-11T06:40:00.361544  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:40:00.362040  + cd /lava-3404264/1/tests/1_bootrr 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c2249ecf8a2395b8c8680
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2249ecf8a2395b8c8681
        failing since 31 days (last pass: v6.2-rc6-239-g0136d86b7852, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c21550f6171d2708c86b5
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c21550f6171d2708c86b6
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c2152b9cc53ccf88c8631
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2152b9cc53ccf88c8632
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c21b9ef77877c4e8c8644
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c21b9ef77877c4e8c8645
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c210fe35077f18e8c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c210fe35077f18e8c863e
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c2294d00faf523b8c8638
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2294d00faf523b8c8639
        failing since 33 days (last pass: v6.2-rc6-289-g870c3a9a2bc4, first fail: v6.2-rc7)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | clang-11   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1ab88eb61ef3978c863c
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ab88eb61ef3978c8645
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:07:41.438544  <8>[   17.990887] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403917_1.5.2.4.1>
    2023-03-11T06:07:41.542484  / # #
    2023-03-11T06:07:41.644184  export SHELL=/bin/sh
    2023-03-11T06:07:41.644568  #
    2023-03-11T06:07:41.745940  / # export SHELL=/bin/sh. /lava-3403917/environment
    2023-03-11T06:07:41.746664  
    2023-03-11T06:07:41.747133  / # <3>[   18.246156] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:07:41.848834  . /lava-3403917/environment/lava-3403917/bin/lava-test-runner /lava-3403917/1
    2023-03-11T06:07:41.849486  
    2023-03-11T06:07:41.861360  / # /lava-3403917/bin/lava-test-runner /lava-3403917/1 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | clang-11   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f2c0a85a0fb648c86dc
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f2c0a85a0fb648c86e5
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:26:28.889518  / # #
    2023-03-11T06:26:28.990913  export SHELL=/bin/sh
    2023-03-11T06:26:28.991248  #
    2023-03-11T06:26:29.092438  / # export SHELL=/bin/sh. /lava-3404136/environment
    2023-03-11T06:26:29.092761  
    2023-03-11T06:26:29.092901  / # <3>[   18.178268] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:26:29.194010  . /lava-3404136/environment/lava-3404136/bin/lava-test-runner /lava-3404136/1
    2023-03-11T06:26:29.194517  
    2023-03-11T06:26:29.202818  / # /lava-3404136/bin/lava-test-runner /lava-3404136/1
    2023-03-11T06:26:29.262791  + export 'TESTRUN_ID=1_bootrr' 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | clang-16   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1ec9643305db598c864b
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ec9643305db598c8654
        failing since 15 days (last pass: v6.2-6695-gd8ca6dbb8de7, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:24:53.608561  / # #
    2023-03-11T06:24:53.710223  export SHELL=/bin/sh
    2023-03-11T06:24:53.710569  #
    2023-03-11T06:24:53.811724  / # export SHELL=/bin/sh. /lava-3404099/environment
    2023-03-11T06:24:53.812066  
    2023-03-11T06:24:53.812222  / # <3>[   17.984881] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:24:53.913315  . /lava-3404099/environment/lava-3404099/bin/lava-test-runner /lava-3404099/1
    2023-03-11T06:24:53.913793  
    2023-03-11T06:24:53.931550  / # /lava-3404099/bin/lava-test-runner /lava-3404099/1
    2023-03-11T06:24:53.978624  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/640c19a08fa77827c38c864d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c19a08fa77827c38c8656
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:03:06.087573  / # #
    2023-03-11T06:03:06.189395  export SHELL=/bin/sh
    2023-03-11T06:03:06.189851  #
    2023-03-11T06:03:06.291021  / # export SHELL=/bin/sh. /lava-3403776/environment
    2023-03-11T06:03:06.291434  
    2023-03-11T06:03:06.291704  / # <3>[   18.051717] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:03:06.393124  . /lava-3403776/environment/lava-3403776/bin/lava-test-runner /lava-3403776/1
    2023-03-11T06:03:06.394259  
    2023-03-11T06:03:06.407201  / # /lava-3403776/bin/lava-test-runner /lava-3403776/1
    2023-03-11T06:03:06.463857  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1a037e75796f598c8663
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a037e75796f598c866c
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:04:36.900326  / # #
    2023-03-11T06:04:37.001764  export SHELL=/bin/sh
    2023-03-11T06:04:37.002102  #
    2023-03-11T06:04:37.103370  / # export SHELL=/bin/sh. /lava-3403802/environment
    2023-03-11T06:04:37.103989  
    2023-03-11T06:04:37.104336  / # <3>[   18.124364] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:04:37.205785  . /lava-3403802/environment/lava-3403802/bin/lava-test-runner /lava-3403802/1
    2023-03-11T06:04:37.206467  
    2023-03-11T06:04:37.223882  / # /lava-3403802/bin/lava-test-runner /lava-3403802/1
    2023-03-11T06:04:37.267200  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/640c1a68d5d879908c8c8700
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a68d5d879908c8c8709
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:06:08.283326  / # #
    2023-03-11T06:06:08.384921  export SHELL=/bin/sh
    2023-03-11T06:06:08.385383  #
    2023-03-11T06:06:08.486694  / # export SHELL=/bin/sh. /lava-3403903/environment
    2023-03-11T06:06:08.487076  
    2023-03-11T06:06:08.487348  / # <3>[   18.028554] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:06:08.588751  . /lava-3403903/environment/lava-3403903/bin/lava-test-runner /lava-3403903/1
    2023-03-11T06:06:08.590043  
    2023-03-11T06:06:08.601762  / # /lava-3403903/bin/lava-test-runner /lava-3403903/1
    2023-03-11T06:06:08.659608  + export 'TESTRUN_ID=1_bootrr' 
    ... (16 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/640c1f91516281e79d8c8685
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f91516281e79d8c868e
        failing since 15 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:28:10.729943  / # #
    2023-03-11T06:28:10.832644  export SHELL=/bin/sh
    2023-03-11T06:28:10.833085  #
    2023-03-11T06:28:10.934456  / # export SHELL=/bin/sh. /lava-3404167/environment
    2023-03-11T06:28:10.934894  
    2023-03-11T06:28:10.935152  / # <3>[   18.118432] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:28:11.036424  . /lava-3404167/environment/lava-3404167/bin/lava-test-runner /lava-3404167/1
    2023-03-11T06:28:11.037115  
    2023-03-11T06:28:11.054433  / # /lava-3404167/bin/lava-test-runner /lava-3404167/1
    2023-03-11T06:28:11.095227  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c210d94319f13018c8667
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c210d94319f13018c8668
        failing since 33 days (last pass: v6.2-rc6-289-g870c3a9a2bc4, first fail: v6.2-rc7)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/640c21ac1744bc28928c8645
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c21ac1744bc28928c864e
        failing since 15 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-11T06:37:26.434601  / # #
    2023-03-11T06:37:26.536334  export SHELL=/bin/sh
    2023-03-11T06:37:26.536723  #
    2023-03-11T06:37:26.638245  / # export SHELL=/bin/sh. /lava-3404259/environment
    2023-03-11T06:37:26.638721  
    2023-03-11T06:37:26.639004  / # <3>[  101.554449] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-11T06:37:26.740305  . /lava-3404259/environment/lava-3404259/bin/lava-test-runner /lava-3404259/1
    2023-03-11T06:37:26.741330  
    2023-03-11T06:37:26.752491  / # /lava-3404259/bin/lava-test-runner /lava-3404259/1
    2023-03-11T06:37:26.810426  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ook+videodec | 1
Details:     https://kernelci.org/test/plan/id/640c1b2dcafd5c5d148c8656
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b2dcafd5c5d148c8657
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c24405fa3979f8a8c8634
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c24405fa3979f8a8c8635
        failing since 45 days (last pass: v6.2-rc5-13-g2475bf0250de, first fail: v6.2-rc5-27-gfb6e71db53f3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3
Details:     https://kernelci.org/test/plan/id/640c19c7a56225b8228c8630
Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/640c19c7a56225b8228c8676
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:03:28.645238  /lava-9552594/1/../bin/lava-test-case
2023-03-11T06:03:28.655106  <8>[   25.286755] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>
* baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/640c19c7a56225b8228c86d6
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12018-g2fcd07b7ccd5f)
2023-03-11T06:03:25.775662  /lava-9552594/1/../bin/lava-test-case
2023-03-11T06:03:25.785368  <8>[   22.416437] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/640c19c7a56225b8228c86d7
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12018-g2fcd07b7ccd5f)
2023-03-11T06:03:23.729663  0x200018C
2023-03-11T06:03:23.729758    commandIndex: 0x18c
2023-03-11T06:03:23.732768    reserved1:    0x0
2023-03-11T06:03:23.735709    nv:           0
2023-03-11T06:03:23.735818    extensive:    0
2023-03-11T06:03:23.739214    flushed:      0
2023-03-11T06:03:23.739333    cHandles:     0x1
2023-03-11T06:03:23.742343    rHandle:      0
2023-03-11T06:03:23.742445    V:            0
2023-03-11T06:03:23.745807    Res:          0x0
... (28 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ook+videodec | 3
Details:     https://kernelci.org/test/plan/id/640c1a7a8e0ea43bee8c865d
Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/640c1a7a8e0ea43bee8c86b1
        failing since 18 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-11T06:06:28.907734  /lava-9552735/1/../bin/lava-test-case
2023-03-11T06:06:28.918604  <8>[   24.488823] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>
* baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/640c1a7a8e0ea43bee8c8703
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12017-g1ec35eadc3b44)
2023-03-11T06:06:26.044586  /lava-9552735/1/../bin/lava-test-case
2023-03-11T06:06:26.055044  <8>[   21.626130] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/640c1a7a8e0ea43bee8c8704
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12017-g1ec35eadc3b44)
2023-03-11T06:06:24.003955    nv:           0
2023-03-11T06:06:24.004046    extensive:    0
2023-03-11T06:06:24.007154    flushed:      0
2023-03-11T06:06:24.007241    cHandles:     0x0
2023-03-11T06:06:24.010171    rHandle:      0
2023-03-11T06:06:24.010256    V:            0
2023-03-11T06:06:24.014023    Res:          0x0
2023-03-11T06:06:24.017299  TPM2_CC_PolicyPCR:
2023-03-11T06:06:24.017387    value: 0x200017F
2023-03-11T06:06:24.020538    commandIndex: 0x17f
... (80 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c2440e19a4694f38c8677
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2440e19a4694f38c8678
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3
Details:     https://kernelci.org/test/plan/id/640c19ee64c32158188c8631
Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/640c19ee64c32158188c86e7
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12018-g2fcd07b7ccd5f)
2023-03-11T06:04:10.668545  /lava-9552595/1/../bin/lava-test-case
2023-03-11T06:04:10.675001  <8>[   22.649709] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/640c19ee64c32158188c86e8
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12018-g2fcd07b7ccd5f)
2023-03-11T06:04:09.649670  /lava-9552595/1/../bin/lava-test-case
2023-03-11T06:04:09.656450  <8>[   21.630374] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/640c19ee64c32158188c86e9
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12018-g2fcd07b7ccd5f)
2023-03-11T06:04:07.622078    Res:          0x0
2023-03-11T06:04:07.622551  TPM2_CC_TestParms:
2023-03-11T06:04:07.622886    value: 0x18A
2023-03-11T06:04:07.625524    commandIndex: 0x18a
2023-03-11T06:04:07.628710    reserved1:    0x0
2023-03-11T06:04:07.629115    nv:           0
2023-03-11T06:04:07.632342    extensive:    0
2023-03-11T06:04:07.632752    flushed:      0
2023-03-11T06:04:07.635443    cHandles:     0x0
2023-03-11T06:04:07.635852    rHandle:      0
... (50 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ook+videodec | 3
Details:     https://kernelci.org/test/plan/id/640c1a90bbf085c0958c86c1
Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/640c1a90bbf085c0958c8777
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12017-g1ec35eadc3b44)
2023-03-11T06:06:47.300262  /lava-9552740/1/../bin/lava-test-case
2023-03-11T06:06:47.306806  <8>[   22.759512] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/640c1a90bbf085c0958c8778
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12017-g1ec35eadc3b44)
2023-03-11T06:06:46.281274  /lava-9552740/1/../bin/lava-test-case
2023-03-11T06:06:46.287790  <8>[   21.740501] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/640c1a90bbf085c0958c8779
        failing since 13 days (last pass: v6.2-11606-g116b41162f8b, first fail: v6.2-12017-g1ec35eadc3b44)
2023-03-11T06:06:44.251248     0
2023-03-11T06:06:44.251731    Res:          0x0
2023-03-11T06:06:44.254144  TPM2_CC_TestParms:
2023-03-11T06:06:44.254629    value: 0x18A
2023-03-11T06:06:44.257946    commandIndex: 0x18a
2023-03-11T06:06:44.258529    reserved1:    0x0
2023-03-11T06:06:44.261081    nv:           0
2023-03-11T06:06:44.261666    extensive:    0
2023-03-11T06:06:44.264395    flushed:      0
2023-03-11T06:06:44.264901    cHandles:     0x0
... (51 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c24400101ebc5258c8632
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c24400101ebc5258c8633
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10     | oxnas_v6_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/640c182307c1cf76e38c8634
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c182307c1cf76e38c8635
        failing since 150 days (last pass: v6.0-9423-g493ffd6605b2d, first fail: v6.0-10822-g60bb8154d1d7)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c220eddf969f1478c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c220eddf969f1478c8630
        failing since 149 days (last pass: v6.0-9413-g4899a36f91a9f, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c25340611cf1a3d8c8636
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c25340611cf1a3d8c8637
        failing since 149 days (last pass: v6.0-9413-g4899a36f91a9f, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c2213e87d1c4aa28c8673
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2213e87d1c4aa28c8674
        failing since 149 days (last pass: v6.0-6205-gffb39098bf87d, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c254cf4852e1a1c8c8643
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c254cf4852e1a1c8c8644
        failing since 149 days (last pass: v6.0-6205-gffb39098bf87d, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c211fe35077f18e8c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c211fe35077f18e8c864c
        failing since 149 days (last pass: v6.0-6205-gffb39098bf87d, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c2211ddf969f1478c8642
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2211ddf969f1478c8643
        failing since 149 days (last pass: v6.0-6205-gffb39098bf87d, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c2549f4852e1a1c8c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2549f4852e1a1c8c863e
        failing since 149 days (last pass: v6.0-6205-gffb39098bf87d, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c211eba2b0ff7d58c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c211eba2b0ff7d58c8630
        failing since 149 days (last pass: v6.0-6205-gffb39098bf87d, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c2212066300ebf98c8672
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2212066300ebf98c8673
        failing since 149 days (last pass: v6.0-9413-g4899a36f91a9f, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/640c254af4852e1a1c8c8640
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c254af4852e1a1c8c8641
        failing since 149 days (last pass: v6.0-9413-g4899a36f91a9f, first fail: v6.0-11546-g1440f57602288)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | clang-11   | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/640c1cb1e7bec500cc8c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1cb1e7bec500cc8c8651
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | clang-11   | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/640c1ff726f70287af8c863a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ff726f70287af8c863b
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-collabora   | clang-11   | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/640c1c6e17a4dd5da98c8649
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1c6e17a4dd5da98c864a
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/640c1a2f97201424268c866e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a2f97201424268c866f
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig+debug         | 1
Details:     https://kernelci.org/test/plan/id/640c1a9776a0f580b88c86f8
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a9776a0f580b88c86f9
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/640c1a56cb485a6dc28c86b1
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a56cb485a6dc28c86b2
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig+debug         | 1
Details:     https://kernelci.org/test/plan/id/640c1babefa990642e8c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1babefa990642e8c863e
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/640c1a2a76687d44d88c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a2a76687d44d88c863e
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig+debug         | 1
Details:     https://kernelci.org/test/plan/id/640c1a7a8e0ea43bee8c870c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/i38...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a7a8e0ea43bee8c870d
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-11   | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1e28048ebc45278c8630
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e28048ebc45278c8631
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-11   | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c21d7bb25c436568c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c21d7bb25c436568c8651
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-16   | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1ef3d09727a2988c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ef3d09727a2988c8651
        failing since 15 days (last pass: v6.2-8661-ge4bc15889506, first fail: v6.2-9238-gd2980d8d8265)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-16   | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c237e334896dea58c867e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c237e334896dea58c867f
        failing since 15 days (last pass: v6.2-8661-ge4bc15889506, first fail: v6.2-9238-gd2980d8d8265)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/640c19dc51b64274bb8c8714
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c19dc51b64274bb8c8715
        failing since 25 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/640c1a7db5abb6db648c8663
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a7db5abb6db648c8664
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-127-gdbeed98d89ea)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/640c1a9376a0f580b88c86f2
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a9376a0f580b88c86f3
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1b10fd4e8b16fb8c867a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b10fd4e8b16fb8c867b
        failing since 12 days (last pass: v6.2-12018-g2fcd07b7ccd5f, first fail: v6.2-12485-gf3a2439f20d91)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/640c1b690a2ee8c0a28c86a4
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b690a2ee8c0a28c86a5
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/640c1c21517fdea7a18c8632
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1c21517fdea7a18c8633
        failing since 20 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-145-g5e725d112e1a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/640c1c720426f002de8c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1c720426f002de8c863f
        failing since 5 days (last pass: v6.2-13534-gb01fe98d34f3, first fail: v6.2-13563-gf915322fe014)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/640c23f64f65bb7a8b8c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c23f64f65bb7a8b8c8651
        failing since 25 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/640c19f256cb06a33b8c866d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c19f256cb06a33b8c866e
        failing since 25 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/640c1aa6202cd219d98c8634
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1aa6202cd219d98c8635
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-127-gdbeed98d89ea)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/640c1b6fb7e175425a8c863b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b6fb7e175425a8c863c
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1cd7db58089e028c8668
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1cd7db58089e028c8669
        failing since 12 days (last pass: v6.2-12018-g2fcd07b7ccd5f, first fail: v6.2-12485-gf3a2439f20d91)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/640c1d3bec52608d6c8c86dd
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1d3bec52608d6c8c86de
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/640c1e7b49829686ff8c8664
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e7b49829686ff8c8665
        failing since 20 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-145-g5e725d112e1a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/640c1ea48dbb20067f8c863c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ea48dbb20067f8c863d
        failing since 5 days (last pass: v6.2-13534-gb01fe98d34f3, first fail: v6.2-13563-gf915322fe014)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/640c269f108c7c96b28c86c3
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c269f108c7c96b28c86c4
        failing since 25 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/640c19c751b64274bb8c8631
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c19c751b64274bb8c8632
        failing since 25 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/640c1a6505cf2e1df28c865f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a6505cf2e1df28c8660
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-127-gdbeed98d89ea)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/640c1a79b5abb6db648c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a79b5abb6db648c864c
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1add1daab811018c863a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1add1daab811018c863b
        failing since 12 days (last pass: v6.2-12018-g2fcd07b7ccd5f, first fail: v6.2-12485-gf3a2439f20d91)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/640c1b2ecb29bbdd2b8c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b2ecb29bbdd2b8c863f
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/640c1bf5ef7575dbc88c868a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1bf5ef7575dbc88c868b
        failing since 5 days (last pass: v6.2-13534-gb01fe98d34f3, first fail: v6.2-13563-gf915322fe014)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/640c1c1e4b518b08128c865f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1c1e4b518b08128c8660
        failing since 20 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-145-g5e725d112e1a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/640c22fe51d8fb37608c8658
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c22fe51d8fb37608c8659
        failing since 25 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/640c1bf50f8b4e52188c863a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1bf50f8b4e52188c863b
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/640c1db3cfc0f50d7a8c863b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1db3cfc0f50d7a8c863c
        failing since 21 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1ec994ab99d09e8c8642
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ec994ab99d09e8c8643
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/640c1e3f5e8415cf5a8c86c0
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e3f5e8415cf5a8c86c1
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/640c2123ba2b0ff7d58c8632
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c2123ba2b0ff7d58c8633
        failing since 21 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c234006f59542f68c8645
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c234006f59542f68c8646
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/640c1bcea3427c4c4f8c86cd
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1bcea3427c4c4f8c86ce
        failing since 21 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/640c1d5d2460aeb6418c875c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1d5d2460aeb6418c875d
        failing since 21 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | clang-11   | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1e14dd6ffffdb28c8653
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e14dd6ffffdb28c8654
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | clang-11   | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c21c3d2c26778d28c8630
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c21c3d2c26778d28c8631
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/640c19da0500ca76158c8672
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c19da0500ca76158c8673
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/640c1a7f6b502916758c8668
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a7f6b502916758c8669
        failing since 25 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/640c1a9576a0f580b88c86f5
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a9576a0f580b88c86f6
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1b12fd4e8b16fb8c867e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b12fd4e8b16fb8c867f
        failing since 25 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/640c1b6b0a2ee8c0a28c86b2
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b6b0a2ee8c0a28c86b3
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-127-gdbeed98d89ea)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/640c1c1f4b518b08128c8664
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1c1f4b518b08128c8665
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/640c1c244b518b08128c8674
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1c244b518b08128c8675
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/640c23f7723f1ea7978c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c23f7723f1ea7978c863f
        failing since 21 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/640c19ca0ef4667e098c8659
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c19ca0ef4667e098c865a
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/640c1b0ad8dacabdee8c8684
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b0ad8dacabdee8c8685
        failing since 25 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/640c1b82b7e175425a8c8744
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b82b7e175425a8c8745
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1ceb8edd6ff02f8c8681
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ceb8edd6ff02f8c8682
        failing since 25 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/640c1d3cec52608d6c8c86eb
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1d3cec52608d6c8c86ec
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-127-gdbeed98d89ea)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/640c1e5335e43c374d8c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e5335e43c374d8c8634
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/640c1ea38dbb20067f8c8639
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ea38dbb20067f8c863a
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/640c26a1b1420fc2768c8651
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c26a1b1420fc2768c8652
        failing since 21 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/640c19c60500ca76158c8641
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c19c60500ca76158c8642
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/640c1a66e505ad1fcf8c8684
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a66e505ad1fcf8c8685
        failing since 25 days (last pass: v6.2-rc7-216-gf339c2597ebb, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/640c1a7a6b502916758c8653
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a7a6b502916758c8654
        failing since 25 days (last pass: v6.2-rc7-231-g711e9a4d52bf, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1ade3e228e8c7c8c8656
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ade3e228e8c7c8c8657
        failing since 25 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/640c1b412443b6b6018c865b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1b412443b6b6018c865c
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-127-gdbeed98d89ea)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/640c1be1aa62b1ead78c86b3
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1be1aa62b1ead78c86b4
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/640c1be2aa62b1ead78c86b6
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1be2aa62b1ead78c86b7
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/640c22ff9ad3a029208c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c22ff9ad3a029208c8651
        failing since 21 days (last pass: v6.2-rc7-213-g47e9aa14ce5a, first fail: v6.2-rc8-98-gec35307e18ba)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/640c1bd7c007831ffb8c8644
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1bd7c007831ffb8c8645
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/640c1db5cef939ca658c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1db5cef939ca658c8630
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c1eca94ab99d09e8c8648
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1eca94ab99d09e8c8649
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/640c1ddbcef939ca658c86d1
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1ddbcef939ca658c86d2
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/640c214badf46f23138c8640
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c214badf46f23138c8641
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/640c23415c92cea4668c863c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c23415c92cea4668c863d
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/640c1bcda3427c4c4f8c86bb
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1bcda3427c4c4f8c86bc
        failing since 21 days (last pass: v6.2-rc8, first fail: v6.2-rc8-134-g38f8ccde04a3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/640c1d5ec7e9e132678c870a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/x86...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1d5ec7e9e132678c870b
        failing since 25 days (last pass: v6.2-rc8, first fail: v6.2-rc8-15-gf6feea56f66d)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10     | shmobile_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/640c1a23b324fad1548c8668
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1a23b324fad1548c8669
        failing since 1 day (last pass: v6.3-rc1-19-g6a98c9cae2328, first fail: v6.3-rc1-106-g44889ba56cbb3)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1e455e8415cf5a8c86ce
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e455e8415cf5a8c86cf
        failing since 81 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.1-13822-g6feb57c2fd7c)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1
Details:     https://kernelci.org/test/plan/id/640c1cc96abccce99b8c8665
Results:     65 PASS, 6 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.cros-ec-keyb-probed: https://kernelci.org/test/case/id/640c1cc96abccce99b8c86a6
        new failure (last pass: v6.3-rc1-198-g55a21105ecc1)
2023-03-11T06:16:29.578187  /lava-9552994/1/../bin/lava-test-case<8>[   24.168192] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-keyb-probed RESULT=fail>
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1d2dec52608d6c8c8644
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1d2dec52608d6c8c8645
        failing since 80 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.1-13822-g6feb57c2fd7c)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c243f3223ea97828c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c243f3223ea97828c8630
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | clang-11   | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f19fd407de74d8c8652
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f19fd407de74d8c865b
        failing since 58 days (last pass: v6.2-rc2-320-g93928d485d9df, first fail: v6.2-rc3-30-ge8f60cd7db24)
2023-03-11T06:26:13.533910  <8>[   19.104964] <LAVA_SIGNAL_ENDRUN 0_dmesg 411598_1.5.2.4.1>
    2023-03-11T06:26:13.639276  / # #
    2023-03-11T06:26:13.741179  export SHELL=/bin/sh
    2023-03-11T06:26:13.741713  #
    2023-03-11T06:26:13.843021  / # export SHELL=/bin/sh. /lava-411598/environment
    2023-03-11T06:26:13.843533  
    2023-03-11T06:26:13.944865  / # . /lava-411598/environment/lava-411598/bin/lava-test-runner /lava-411598/1
    2023-03-11T06:26:13.945625  
    2023-03-11T06:26:13.958046  / # /lava-411598/bin/lava-test-runner /lava-411598/1
    2023-03-11T06:26:14.002454  + export 'TESTRUN_ID=1_bootrr' 
    ... (42 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c20d0936baf03628c8630
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c20d0936baf03628c8631
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c20f7e35077f18e8c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c20f7e35077f18e8c8634
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c243ee19a4694f38c8667
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c243ee19a4694f38c8668
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10     | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/640c243fe19a4694f38c866d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c243fe19a4694f38c866e
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c20eee35077f18e8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c20eee35077f18e8c8630
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/640c213eadf46f23138c8637
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c213eadf46f23138c8638
        failing since 31 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/640c1a4062f17875638c8668
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1a4062f17875638c8671
        failing since 12 days (last pass: v6.2-12018-g2fcd07b7ccd5f, first fail: v6.2-12485-gf3a2439f20d91)
2023-03-11T06:05:30.957085  <8>[   10.014939] <LAVA_SIGNAL_ENDRUN 0_dmesg 3403872_1.5.2.4.1>
    2023-03-11T06:05:31.078317  / # #
    2023-03-11T06:05:31.183844  export SHELL=/bin/sh
    2023-03-11T06:05:31.185414  #
    2023-03-11T06:05:31.288706  / # export SHELL=/bin/sh. /lava-3403872/environment
    2023-03-11T06:05:31.290296  
    2023-03-11T06:05:31.393727  / # . /lava-3403872/environment/lava-3403872/bin/lava-test-runner /lava-3403872/1
    2023-03-11T06:05:31.396588  
    2023-03-11T06:05:31.400794  / # /lava-3403872/bin/lava-test-runner /lava-3403872/1
    2023-03-11T06:05:31.544244  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | clang-16   | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/640c20e794319f13018c863e
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230306092938+ae37edf1486d-1~exp1~20230306213043.48))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c20e794319f13018c8647
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:34:01.224590  / # #
    2023-03-11T06:34:01.326364  export SHELL=/bin/sh
    2023-03-11T06:34:01.326813  #
    2023-03-11T06:34:01.428179  / # export SHELL=/bin/sh. /lava-3404282/environment
    2023-03-11T06:34:01.428730  
    2023-03-11T06:34:01.530055  / # . /lava-3404282/environment/lava-3404282/bin/lava-test-runner /lava-3404282/1
    2023-03-11T06:34:01.530860  
    2023-03-11T06:34:01.535690  / # /lava-3404282/bin/lava-test-runner /lava-3404282/1
    2023-03-11T06:34:01.640620  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:34:01.641214  + cd /lava-3404282/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+ima       | 1
Details:     https://kernelci.org/test/plan/id/640c1c26517fdea7a18c8637
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1c26517fdea7a18c8640
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:13:29.866179  / # #
    2023-03-11T06:13:29.967897  export SHELL=/bin/sh
    2023-03-11T06:13:29.968244  #
    2023-03-11T06:13:30.069566  / # export SHELL=/bin/sh. /lava-3403990/environment
    2023-03-11T06:13:30.069918  
    2023-03-11T06:13:30.171252  / # . /lava-3403990/environment/lava-3403990/bin/lava-test-runner /lava-3403990/1
    2023-03-11T06:13:30.171882  
    2023-03-11T06:13:30.176841  / # /lava-3403990/bin/lava-test-runner /lava-3403990/1
    2023-03-11T06:13:30.280675  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:13:30.280933  + cd /lava-3403990/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/640c1c756defd965cd8c86b1
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1c756defd965cd8c86ba
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:14:50.306087  / # #
    2023-03-11T06:14:50.407783  export SHELL=/bin/sh
    2023-03-11T06:14:50.408287  #
    2023-03-11T06:14:50.509684  / # export SHELL=/bin/sh. /lava-3404015/environment
    2023-03-11T06:14:50.510079  
    2023-03-11T06:14:50.611408  / # . /lava-3404015/environment/lava-3404015/bin/lava-test-runner /lava-3404015/1
    2023-03-11T06:14:50.612035  
    2023-03-11T06:14:50.616996  / # /lava-3404015/bin/lava-test-runner /lava-3404015/1
    2023-03-11T06:14:50.711032  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:14:50.711302  + cd /lava-3404015/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+crypto    | 1
Details:     https://kernelci.org/test/plan/id/640c1ecc643305db598c865f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1ecc643305db598c8668
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:24:55.737347  / # #
    2023-03-11T06:24:55.839297  export SHELL=/bin/sh
    2023-03-11T06:24:55.839803  #
    2023-03-11T06:24:55.941275  / # export SHELL=/bin/sh. /lava-3404110/environment
    2023-03-11T06:24:55.941866  
    2023-03-11T06:24:56.043253  / # . /lava-3404110/environment/lava-3404110/bin/lava-test-runner /lava-3404110/1
    2023-03-11T06:24:56.044046  
    2023-03-11T06:24:56.061829  / # /lava-3404110/bin/lava-test-runner /lava-3404110/1
    2023-03-11T06:24:56.152781  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:24:56.153233  + cd /lava-3404110/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/640c1f468db38488908c8647
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c1f468db38488908c8650
        failing since 3 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-11T06:26:59.670129  / # #
    2023-03-11T06:26:59.772123  export SHELL=/bin/sh
    2023-03-11T06:26:59.772673  #
    2023-03-11T06:26:59.874033  / # export SHELL=/bin/sh. /lava-3404182/environment
    2023-03-11T06:26:59.874630  
    2023-03-11T06:26:59.976149  / # . /lava-3404182/environment/lava-3404182/bin/lava-test-runner /lava-3404182/1
    2023-03-11T06:26:59.976948  
    2023-03-11T06:26:59.980837  / # /lava-3404182/bin/lava-test-runner /lava-3404182/1
    2023-03-11T06:27:00.084811  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:27:00.085547  + cd /lava-3404182/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/640c19fc64c32158188c8722
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640c19fc64c32158188c872b
        failing since 0 day (last pass: v6.3-rc1-106-g44889ba56cbb3, first fail: v6.3-rc1-198-g55a21105ecc1)
2023-03-11T06:04:05.227673  / # #
    2023-03-11T06:04:05.329364  export SHELL=/bin/sh
    2023-03-11T06:04:05.329711  #
    2023-03-11T06:04:05.431018  / # export SHELL=/bin/sh. /lava-3403876/environment
    2023-03-11T06:04:05.431366  
    2023-03-11T06:04:05.532660  / # . /lava-3403876/environment/lava-3403876/bin/lava-test-runner /lava-3403876/1
    2023-03-11T06:04:05.533259  
    2023-03-11T06:04:05.540230  / # /lava-3403876/bin/lava-test-runner /lava-3403876/1
    2023-03-11T06:04:05.687127  + export 'TESTRUN_ID=1_bootrr'
    2023-03-11T06:04:05.687393  + cd /lava-3403876/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/640c1e6f35e43c374d8c8654
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc1-230-gef5f68cc1f82/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/640c1e6f35e43c374d8c8655
        failing since 80 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.1-13822-g6feb57c2fd7c)