next/master baseline: 972 runs, 155 regressions (next-20230309)

9 Mar 2023


      next/master baseline: 972 runs, 155 regressions (next-20230309)
Regressions Summary
-------------------
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10     | sama5_defconfig              | 1          
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10     | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | omap2plus_defconfig          | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10     | davinci_all_defconfig        | 1          
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10     | defconfig+kselftest          | 1          
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10     | defconfig+debug              | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10     | multi_v7_defconfig+debug     | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
kontron-pitx-imx8m           | arm64  | lab-kontron     | gcc-10     | defconfig+CON..._64K_PAGES=y | 1          
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10     | defconfig+debug              | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...BIG_ENDIAN=y | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._16K_PAGES=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | defconfig+arm64-chromebook   | 2          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10     | oxnas_v6_defconfig           | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10     | defconfig+kselftest          | 1          
qemu_arm-vexpress-a9         | arm    | lab-baylibre    | gcc-10     | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm    | lab-broonie     | gcc-10     | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm    | lab-collabora   | gcc-10     | vexpress_defconfig           | 1          
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-baylibre    | gcc-10     | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-broonie     | gcc-10     | defconfig+debug              | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig+debug         | 1          
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig+debug         | 1          
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig               | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defcon...rust-samples | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10     | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+debug              | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10     | defconfig+debug              | 1
Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20230309/plan/b...
Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20230309
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      2c6433e9294b6d0f4d8f08c3c70a3eac434d3ec8
Test Regressions
----------------
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1
Details:     https://kernelci.org/test/plan/id/6409b6ef79f9b95a508c863f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b6ef79f9b95a508c8640
        failing since 173 days (last pass: next-20220915, first fail: next-20220916)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10     | sama5_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/6409b398f0e96a13938c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sama5_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/sama5_defconfig/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/sama5_defconfig/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b398f0e96a13938c863f
        failing since 36 days (last pass: next-20230125, first fail: next-20230131)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10     | bcm2835_defconfig            | 1
Details:     https://kernelci.org/test/plan/id/6409b60267320fbe7e8c8665
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/bcm2835_defconfi...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/bcm2835_defconfi...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b60267320fbe7e8c866e
        new failure (last pass: next-20230308)
2023-03-09T10:33:17.856220  + set +x
    2023-03-09T10:33:17.859817  <8>[   17.920204] <LAVA_SIGNAL_ENDRUN 0_dmesg 132085_1.5.2.4.1>
    2023-03-09T10:33:17.992576  / # #
    2023-03-09T10:33:18.094617  export SHELL=/bin/sh
    2023-03-09T10:33:18.095127  #
    2023-03-09T10:33:18.196698  / # export SHELL=/bin/sh. /lava-132085/environment
    2023-03-09T10:33:18.197193  
    2023-03-09T10:33:18.298809  / # . /lava-132085/environment/lava-132085/bin/lava-test-runner /lava-132085/1
    2023-03-09T10:33:18.299640  
    2023-03-09T10:33:18.306323  / # /lava-132085/bin/lava-test-runner /lava-132085/1 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/6409b7be96c02238e48c8640
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7be96c02238e48c8641
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/6409b737bf19c0a8128c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b737bf19c0a8128c8634
        new failure (last pass: next-20230308)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | omap2plus_defconfig          | 1
Details:     https://kernelci.org/test/plan/id/6409b9f9c94cd791da8c86ce
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/omap2plus_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/omap2plus_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9f9c94cd791da8c86cf
        failing since 6 days (last pass: next-20230220, first fail: next-20230303)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/6409b859ecc2b875158c863d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b859ecc2b875158c8646
        failing since 49 days (last pass: next-20221219, first fail: next-20230118)
2023-03-09T10:42:45.975913  <8>[   14.941990] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400220_1.5.2.4.1>
    2023-03-09T10:42:46.082543  / # #
    2023-03-09T10:42:46.184139  export SHELL=/bin/sh
    2023-03-09T10:42:46.184484  #
    2023-03-09T10:42:46.285614  / # export SHELL=/bin/sh. /lava-3400220/environment
    2023-03-09T10:42:46.285990  
    2023-03-09T10:42:46.387159  / # . /lava-3400220/environment/lava-3400220/bin/lava-test-runner /lava-3400220/1
    2023-03-09T10:42:46.387696  
    2023-03-09T10:42:46.393034  / # /lava-3400220/bin/lava-test-runner /lava-3400220/1
    2023-03-09T10:42:46.431638  <3>[   15.401718] Bluetooth: hci0: command 0x1001 tx timeout 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1
Details:     https://kernelci.org/test/plan/id/6409b8e0cff20dc5aa8c8699
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b8e0cff20dc5aa8c86a2
        failing since 50 days (last pass: next-20221219, first fail: next-20230118)
2023-03-09T10:45:43.719876  <8>[   16.744198] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400306_1.5.2.4.1>
    2023-03-09T10:45:43.829632  / # #
    2023-03-09T10:45:43.932231  export SHELL=/bin/sh
    2023-03-09T10:45:43.933013  #
    2023-03-09T10:45:44.034781  / # export SHELL=/bin/sh. /lava-3400306/environment
    2023-03-09T10:45:44.035479  
    2023-03-09T10:45:44.137107  / # . /lava-3400306/environment/lava-3400306/bin/lava-test-runner /lava-3400306/1
    2023-03-09T10:45:44.138796  
    2023-03-09T10:45:44.143125  / # /lava-3400306/bin/lava-test-runner /lava-3400306/1
    2023-03-09T10:45:44.235398  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6409ba4e38dda191f58c8645
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409ba4e38dda191f58c864d
        failing since 50 days (last pass: next-20221219, first fail: next-20230117)
2023-03-09T10:51:40.894116  <8>[   14.846536] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400449_1.5.2.4.1>
    2023-03-09T10:51:41.005372  / # #
    2023-03-09T10:51:41.108248  export SHELL=/bin/sh
    2023-03-09T10:51:41.109118  #
    2023-03-09T10:51:41.211046  / # export SHELL=/bin/sh. /lava-3400449/environment
    2023-03-09T10:51:41.211762  
    2023-03-09T10:51:41.313446  / # . /lava-3400449/environment/lava-3400449/bin/lava-test-runner /lava-3400449/1
    2023-03-09T10:51:41.314768  <3>[   15.166953] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-03-09T10:51:41.315159  
    2023-03-09T10:51:41.319783  / # /lava-3400449/bin/lava-test-runner /lava-3400449/1 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10     | davinci_all_defconfig        | 1
Details:     https://kernelci.org/test/plan/id/6409b3fcc30e9850648c8655
Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/davinci_all_defc...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/davinci_all_defc...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.dmesg.emerg: https://kernelci.org/test/case/id/6409b3fcc30e9850648c8658
        failing since 24 days (last pass: next-20230208, first fail: next-20230213)
        29 lines
2023-03-09T10:24:42.337547  kern  :alert : Register r8 information: slab kmalloc-512 start c4b49200 pointer offset 4 size 512
    2023-03-09T10:24:42.370187  kern  :alert : Register r9 information: non-paged memory
    2023-03-09T10:24:42.370949  kern  :alert : Register r10 information: NULL pointer
    2023-03-09T10:24:42.371498  kern  :alert : Register r11 information: 1-page vmalloc region starting at 0xbf15c000 allocated at load_module+0x6d4/0x18ec
    2023-03-09T10:24:42.373379  kern  :alert : Register r12 information: non-paged memory
    2023-03-09T10:24:42.477657  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-03-09T10:24:42.478413  kern  :emerg : Process udevd (pid: 74, stack limit = 0xfb034c2f)
    2023-03-09T10:24:42.478863  kern  :emerg : Stack: (0xc88e5d08 to 0xc88e6000)
    2023-03-09T10:24:42.479272  kern  :emerg : 5d00:                   c4b49200 c076f860 00000000 c03ad300 00000000 fe171284
    2023-03-09T10:24:42.479666  kern  :emerg : 5d20: 0000005d fe171284 c076f860 bf15c220 00000000 00000000 00000000 00000001 
    ... (7 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409bb2eb78a40130d8c8630
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409bb2eb78a40130d8c8637
        failing since 27 days (last pass: next-20230209, first fail: next-20230210)
2023-03-09T10:55:27.279884  + set +x
    2023-03-09T10:55:27.281642  [   22.301566] <LAVA_SIGNAL_ENDRUN 0_dmesg 1168584_1.5.2.4.1>
    2023-03-09T10:55:27.396468  #
    2023-03-09T10:55:27.498543  / # #export SHELL=/bin/sh
    2023-03-09T10:55:27.499014  
    2023-03-09T10:55:27.600362  / # export SHELL=/bin/sh. /lava-1168584/environment
    2023-03-09T10:55:27.600815  
    2023-03-09T10:55:27.702183  / # . /lava-1168584/environment/lava-1168584/bin/lava-test-runner /lava-1168584/1
    2023-03-09T10:55:27.702906  
    2023-03-09T10:55:27.705635  / # /lava-1168584/bin/lava-test-runner /lava-1168584/1 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10     | defconfig+debug              | 1
Details:     https://kernelci.org/test/plan/id/6409bd3acc88b59fe98c867d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bd3acc88b59fe98c867e
        failing since 45 days (last pass: next-20230120, first fail: next-20230123)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/6409b7c496c02238e48c8645
Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.tpm-chip-is-online: https://kernelci.org/test/case/id/6409b7c496c02238e48c8658
        new failure (last pass: next-20230308)
2023-03-09T10:40:49.699489  /usr/bin/tpm2_getcap
2023-03-09T10:40:49.732063  <4>[   11.516389] i2c_designware AMD0010:01: timeout in disabling adapter
2023-03-09T10:40:49.759159  <4>[   11.543423] i2c_designware AMD0010:01: timeout waiting for bus ready
2023-03-09T10:40:49.786228  <4>[   11.570329] i2c_designware AMD0010:01: timeout waiting for bus ready
2023-03-09T10:40:49.792791  <4>[   11.576957] tpm tpm0: i2c transfer failed (attempt 2/3): -110
2023-03-09T10:40:49.818858  <4>[   11.603311] i2c_designware AMD0010:01: timeout waiting for bus ready
2023-03-09T10:40:49.825240  <4>[   11.609938] tpm tpm0: i2c transfer failed (attempt 3/3): -110
2023-03-09T10:40:49.851568  <4>[   11.636143] i2c_designware AMD0010:01: timeout waiting for bus ready
2023-03-09T10:40:49.878829  <4>[   11.663140] i2c_designware AMD0010:01: timeout waiting for bus ready
2023-03-09T10:40:49.885939  <4>[   11.669767] tpm tpm0: i2c transfer failed (attempt 2/3): -110
... (162 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b70b824598b1d18c8649
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b70b824598b1d18c864a
        failing since 198 days (last pass: next-20220810, first fail: next-20220822)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b6072489d6ada68c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b6072489d6ada68c863f
        failing since 331 days (last pass: next-20220401, first fail: next-20220411)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b85d65265424368c8634
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/riscv/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/riscv/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b85d65265424368c8635
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-pitx-imx8m           | arm64  | lab-kontron     | gcc-10     | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6409b55be4ada526908c8635
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b55be4ada526908c8636
        failing since 6 days (last pass: next-20230222, first fail: next-20230303)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10     | defconfig+debug              | 1
Details:     https://kernelci.org/test/plan/id/6409b9d1650d9f32888c8631
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9d1650d9f32888c8632
        failing since 1 day (last pass: next-20230307, first fail: next-20230308)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6409b46d386b7516b88c863d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b46d386b7516b88c8644
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:26:29.192734  / # #
    2023-03-09T10:26:29.294465  export SHELL=/bin/sh
    2023-03-09T10:26:29.294899  #
    2023-03-09T10:26:29.396209  / # export SHELL=/bin/sh. /lava-3400061/environment
    2023-03-09T10:26:29.396609  <3>[   18.340568] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:26:29.396801  
    2023-03-09T10:26:29.497957  / # . /lava-3400061/environment/lava-3400061/bin/lava-test-runner /lava-3400061/1
    2023-03-09T10:26:29.498512  
    2023-03-09T10:26:29.504647  / # /lava-3400061/bin/lava-test-runner /lava-3400061/1
    2023-03-09T10:26:29.570830  + export 'TESTRUN_ID=1_bootrr' 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6409b4e5c60f656f1e8c8661
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b4e5c60f656f1e8c8669
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:28:30.070023  / # #
    2023-03-09T10:28:30.171920  export SHELL=/bin/sh
    2023-03-09T10:28:30.172540  #
    2023-03-09T10:28:30.274180  / # export SHELL=/bin/sh. /lava-3400092/environment
    2023-03-09T10:28:30.274584  <3>[   18.369329] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:28:30.274836  
    2023-03-09T10:28:30.376245  / # . /lava-3400092/environment/lava-3400092/bin/lava-test-runner /lava-3400092/1
    2023-03-09T10:28:30.377021  
    2023-03-09T10:28:30.394165  / # /lava-3400092/bin/lava-test-runner /lava-3400092/1
    2023-03-09T10:28:30.454059  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b7651066a731818c8630
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b7651066a731818c8639
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:39:22.856926  / # #
    2023-03-09T10:39:22.958956  export SHELL=/bin/sh
    2023-03-09T10:39:22.959830  #
    2023-03-09T10:39:23.061711  / # export SHELL=/bin/sh. /lava-3400199/environment
    2023-03-09T10:39:23.062134  <3>[   18.442277] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:39:23.062385  
    2023-03-09T10:39:23.163868  / # . /lava-3400199/environment/lava-3400199/bin/lava-test-runner /lava-3400199/1
    2023-03-09T10:39:23.165411  
    2023-03-09T10:39:23.184131  / # /lava-3400199/bin/lava-test-runner /lava-3400199/1
    2023-03-09T10:39:23.239058  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6409b7b518c8c66c778c862f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b7b518c8c66c778c8638
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:40:42.580681  <8>[   18.184777] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400236_1.5.2.4.1>
    2023-03-09T10:40:42.684215  / # #
    2023-03-09T10:40:42.785663  export SHELL=/bin/sh
    2023-03-09T10:40:42.786074  #
    2023-03-09T10:40:42.887382  / # export SHELL=/bin/sh. /lava-3400236/environment
    2023-03-09T10:40:42.887739  
    2023-03-09T10:40:42.887911  / # <3>[   18.418115] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:40:42.989152  . /lava-3400236/environment/lava-3400236/bin/lava-test-runner /lava-3400236/1
    2023-03-09T10:40:42.989937  
    2023-03-09T10:40:43.002223  / # /lava-3400236/bin/lava-test-runner /lava-3400236/1 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6409b8051d3803fdd08c867d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b8051d3803fdd08c8684
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:42:02.229277  / # #
    2023-03-09T10:42:02.331901  export SHELL=/bin/sh
    2023-03-09T10:42:02.332308  #
    2023-03-09T10:42:02.433675  / # export SHELL=/bin/sh<3>[   18.433971] brcmfmac: brcm. /lava-3400283/environment
    2023-03-09T10:42:02.434088  f_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:42:02.434329  
    2023-03-09T10:42:02.535708  / # . /lava-3400283/environment/lava-3400283/bin/lava-test-runner /lava-3400283/1
    2023-03-09T10:42:02.536828  
    2023-03-09T10:42:02.555789  / # /lava-3400283/bin/lava-test-runner /lava-3400283/1
    2023-03-09T10:42:02.612889  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6409baea768c085afd8c865b
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409baea768c085afd8c8664
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:54:14.102260  / # #
    2023-03-09T10:54:14.203783  export SHELL=/bin/sh
    2023-03-09T10:54:14.204240  #
    2023-03-09T10:54:14.305323  / # export SHELL=/bin/sh. /lava-3400541/environment
    2023-03-09T10:54:14.305786  
    2023-03-09T10:54:14.306014  / # <3>[  102.160379] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:54:14.407303  . /lava-3400541/environment/lava-3400541/bin/lava-test-runner /lava-3400541/1
    2023-03-09T10:54:14.408010  
    2023-03-09T10:54:14.412886  / # /lava-3400541/bin/lava-test-runner /lava-3400541/1
    2023-03-09T10:54:14.444822  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409baf7768c085afd8c86cb
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409baf7768c085afd8c86cc
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409bb2aad7754dfea8c8649
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bb2aad7754dfea8c864a
        failing since 43 days (last pass: next-20230124, first fail: next-20230125)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b9284c758e22ab8c8659
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9284c758e22ab8c865a
        failing since 43 days (last pass: next-20230124, first fail: next-20230125)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409ba3f38dda191f58c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba3f38dda191f58c8630
        failing since 43 days (last pass: next-20230124, first fail: next-20230125)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b9254c758e22ab8c8640
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9254c758e22ab8c8641
        failing since 31 days (last pass: next-20230203, first fail: next-20230206)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6409b47e4d5ea2bfc78c86f0
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b47e4d5ea2bfc78c86f9
        failing since 50 days (last pass: next-20221130, first fail: next-20230118)
2023-03-09T10:26:46.647401  / # #
    2023-03-09T10:26:46.749404  export SHELL=/bin/sh
    2023-03-09T10:26:46.749937  <3>[   18.092636] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:26:46.750185  #
    2023-03-09T10:26:46.851564  / # export SHELL=/bin/sh. /lava-3400053/environment
    2023-03-09T10:26:46.852100  
    2023-03-09T10:26:46.953517  / # . /lava-3400053/environment/lava-3400053/bin/lava-test-runner /lava-3400053/1
    2023-03-09T10:26:46.954333  
    2023-03-09T10:26:46.967852  / # /lava-3400053/bin/lava-test-runner /lava-3400053/1
    2023-03-09T10:26:47.031553  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6409b511bb18661dc98c8634
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b511bb18661dc98c863d
        failing since 50 days (last pass: next-20221129, first fail: next-20230118)
2023-03-09T10:28:56.123706  / # #
    2023-03-09T10:28:56.227440  export SHELL=/bin/sh
    2023-03-09T10:28:56.228279  #
    2023-03-09T10:28:56.329939  / # export SHELL=/bin/sh. /lava-3400105/environment
    2023-03-09T10:28:56.330637  
    2023-03-09T10:28:56.432350  / # . /lava-3400105/environment/lava-3400105/bin/lava-test-runner /lava-3400105/1
    2023-03-09T10:28:56.433214  
    2023-03-09T10:28:56.450664  / # /lava-3400105/bin/lava-test-runner /lava-3400105/1
    2023-03-09T10:28:56.516610  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:28:56.517356  + cd /lava-3400105/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b6366add2cd4a28c863d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b6366add2cd4a28c8646
        failing since 50 days (last pass: next-20221130, first fail: next-20230118)
2023-03-09T10:34:10.934557  / # #
    2023-03-09T10:34:11.036705  export SHELL=/bin/sh
    2023-03-09T10:34:11.037193  #
    2023-03-09T10:34:11.138723  / # export SHELL=/bin/sh. /lava-3400182/environment
    2023-03-09T10:34:11.139208  
    2023-03-09T10:34:11.240762  / # . /lava-3400182/environment/lava-3400182/bin/lava-test-runner /lava-3400182/1
    2023-03-09T10:34:11.241636  
    2023-03-09T10:34:11.260162  / # /lava-3400182/bin/lava-test-runner /lava-3400182/1
    2023-03-09T10:34:11.317053  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:34:11.317667  + cd /lava-3400182/1/tests/1_bootrr 
    ... (16 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6409b80b1d3803fdd08c86c5
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b80b1d3803fdd08c86ce
        failing since 50 days (last pass: next-20221130, first fail: next-20230118)
2023-03-09T10:42:06.488852  / # #
    2023-03-09T10:42:06.590539  export SHELL=/bin/sh
    2023-03-09T10:42:06.590893  #
    2023-03-09T10:42:06.692210  / # export SHELL=/bin/sh. /lava-3400242/environment
    2023-03-09T10:42:06.692652  
    2023-03-09T10:42:06.794006  / # . /lava-3400242/environment/lava-3400242/bin/lava-test-runner /lava-3400242/1
    2023-03-09T10:42:06.794634  
    2023-03-09T10:42:06.801295  / # /lava-3400242/bin/lava-test-runner /lava-3400242/1
    2023-03-09T10:42:06.872131  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:42:06.872390  + cd /lava-3400242/1/tests/1_bootrr 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6409b86d198568e3808c8671
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b86d198568e3808c867a
        failing since 50 days (last pass: next-20221129, first fail: next-20230118)
2023-03-09T10:43:46.329674  + set +x<8>[   18.298896] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400287_1.5.2.4.1>
    2023-03-09T10:43:46.434987  / # #
    2023-03-09T10:43:46.536520  export SHELL=/bin/sh
    2023-03-09T10:43:46.536882  #<3>[   18.403310] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:43:46.537119  
    2023-03-09T10:43:46.638418  / # export SHELL=/bin/sh. /lava-3400287/environment
    2023-03-09T10:43:46.638775  
    2023-03-09T10:43:46.740105  / # . /lava-3400287/environment/lava-3400287/bin/lava-test-runner /lava-3400287/1
    2023-03-09T10:43:46.740741  
    2023-03-09T10:43:46.747455  / # /lava-3400287/bin/lava-test-runner /lava-3400287/1 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b9d7650d9f32888c8635
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9d7650d9f32888c8636
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6409bbe741a80cb0f78c8656
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409bbe741a80cb0f78c865f
        failing since 50 days (last pass: next-20221130, first fail: next-20230118)
2023-03-09T10:58:30.173286  / # #
    2023-03-09T10:58:30.275221  export SHELL=/bin/sh
    2023-03-09T10:58:30.275895  #
    2023-03-09T10:58:30.377522  / # export SHELL=/bin/sh. /lava-3400534/environment
    2023-03-09T10:58:30.378028  
    2023-03-09T10:58:30.479419  / # . /lava-3400534/environment/lava-3400534/bin/lava-test-runner /lava-3400534/1
    2023-03-09T10:58:30.480336  
    2023-03-09T10:58:30.499785  / # /lava-3400534/bin/lava-test-runner /lava-3400534/1
    2023-03-09T10:58:30.557673  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:58:30.558290  + cd /lava-3400534/1/tests/1_bootrr 
    ... (15 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6409b48d035a9fad688c8630
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b48d035a9fad688c8639
        failing since 19 days (last pass: next-20221130, first fail: next-20230217)
2023-03-09T10:26:59.414804  / # #
    2023-03-09T10:26:59.516435  export SHELL=/bin/sh
    2023-03-09T10:26:59.516916  #
    2023-03-09T10:26:59.618274  / # export SHELL=/bin/sh. /lava-3400050/environment
    2023-03-09T10:26:59.618792  
    2023-03-09T10:26:59.720195  / # . /lava-3400050/environment/lava-3400050/bin/lava-test-runner /lava-3400050/1
    2023-03-09T10:26:59.721195  
    2023-03-09T10:26:59.727027  / # /lava-3400050/bin/lava-test-runner /lava-3400050/1
    2023-03-09T10:26:59.805958  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:26:59.806352  + cd /lava-3400050/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6409b50fdfa54638978c8630
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b50fdfa54638978c8639
        failing since 19 days (last pass: next-20221129, first fail: next-20230217)
2023-03-09T10:29:08.665598  / # #
    2023-03-09T10:29:08.767504  export SHELL=/bin/sh
    2023-03-09T10:29:08.768031  #
    2023-03-09T10:29:08.869429  / # export SHELL=/bin/sh. /lava-3400103/environment
    2023-03-09T10:29:08.869952  
    2023-03-09T10:29:08.971359  / # . /lava-3400103/environment/lava-3400103/bin/lava-test-runner /lava-3400103/1
    2023-03-09T10:29:08.972140  
    2023-03-09T10:29:08.977788  / # /lava-3400103/bin/lava-test-runner /lava-3400103/1
    2023-03-09T10:29:09.064696  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:29:09.065049  + cd /lava-3400103/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b6318beab214548c8663
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b6318beab214548c866c
        failing since 19 days (last pass: next-20221130, first fail: next-20230217)
2023-03-09T10:34:13.112915  / # #
    2023-03-09T10:34:13.214790  export SHELL=/bin/sh
    2023-03-09T10:34:13.215178  #
    2023-03-09T10:34:13.316516  / # export SHELL=/bin/sh. /lava-3400157/environment
    2023-03-09T10:34:13.316877  
    2023-03-09T10:34:13.418204  / # . /lava-3400157/environment/lava-3400157/bin/lava-test-runner /lava-3400157/1
    2023-03-09T10:34:13.418960  
    2023-03-09T10:34:13.423092  / # /lava-3400157/bin/lava-test-runner /lava-3400157/1
    2023-03-09T10:34:13.503856  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:34:13.504396  + cd /lava-3400157/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6409b823b7dac580308c8641
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b823b7dac580308c864a
        failing since 19 days (last pass: next-20221130, first fail: next-20230217)
2023-03-09T10:42:15.196852  + set +x
    2023-03-09T10:42:15.198994  <8>[   18.438240] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400244_1.5.2.4.1>
    2023-03-09T10:42:15.304250  / # #
    2023-03-09T10:42:15.406073  export SHELL=/bin/sh
    2023-03-09T10:42:15.406457  #
    2023-03-09T10:42:15.507810  / # export SHELL=/bin/sh. /lava-3400244/environment
    2023-03-09T10:42:15.508318  
    2023-03-09T10:42:15.609707  / # . /lava-3400244/environment/lava-3400244/bin/lava-test-runner /lava-3400244/1
    2023-03-09T10:42:15.610318  
    2023-03-09T10:42:15.629590  / # /lava-3400244/bin/lava-test-runner /lava-3400244/1 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6409b88762ab5c4d078c86d3
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b88762ab5c4d078c86dc
        failing since 16 days (last pass: next-20221129, first fail: next-20230221)
2023-03-09T10:44:10.224764  / # #
    2023-03-09T10:44:10.326536  export SHELL=/bin/sh
    2023-03-09T10:44:10.326962  #
    2023-03-09T10:44:10.428253  / # export SHELL=/bin/sh. /lava-3400267/environment
    2023-03-09T10:44:10.428698  
    2023-03-09T10:44:10.530059  / # . /lava-3400267/environment/lava-3400267/bin/lava-test-runner /lava-3400267/1
    2023-03-09T10:44:10.530790  
    2023-03-09T10:44:10.536572  / # /lava-3400267/bin/lava-test-runner /lava-3400267/1
    2023-03-09T10:44:10.615513  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:44:10.615853  + cd /lava-3400267/1/tests/1_bootrr 
    ... (9 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...BIG_ENDIAN=y | 1
Details:     https://kernelci.org/test/plan/id/6409bbd087d09bcca08c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409bbd087d09bcca08c8653
        failing since 19 days (last pass: next-20221130, first fail: next-20230217)
2023-03-09T10:58:00.512047  / # #
    2023-03-09T10:58:00.614376  export SHELL=/bin/sh
    2023-03-09T10:58:00.615031  #
    2023-03-09T10:58:00.716603  / # export SHELL=/bin/sh. /lava-3400502/environment
    2023-03-09T10:58:00.717260  
    2023-03-09T10:58:00.818852  / # . /lava-3400502/environment/lava-3400502/bin/lava-test-runner /lava-3400502/1
    2023-03-09T10:58:00.819848  
    2023-03-09T10:58:00.836607  / # /lava-3400502/bin/lava-test-runner /lava-3400502/1
    2023-03-09T10:58:00.868724  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:58:00.908447  + cd /lava-3400502/1/tests/1_bootrr 
    ... (9 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6409bc96aeb86f96838c862f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409bc96aeb86f96838c8638
        failing since 16 days (last pass: next-20221130, first fail: next-20230221)
2023-03-09T11:01:30.287442  / # #
    2023-03-09T11:01:30.389503  export SHELL=/bin/sh
    2023-03-09T11:01:30.390338  #
    2023-03-09T11:01:30.491796  / # export SHELL=/bin/sh. /lava-3400531/environment
    2023-03-09T11:01:30.492614  
    2023-03-09T11:01:30.594373  / # . /lava-3400531/environment/lava-3400531/bin/lava-test-runner /lava-3400531/1
    2023-03-09T11:01:30.595587  
    2023-03-09T11:01:30.612604  / # /lava-3400531/bin/lava-test-runner /lava-3400531/1
    2023-03-09T11:01:30.684369  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T11:01:30.685278  + cd /lava-3400531/1/tests/1_bootrr 
    ... (9 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409baf4768c085afd8c86c8
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409baf4768c085afd8c86c9
        failing since 30 days (last pass: next-20230203, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409ba1539373111628c864f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba1539373111628c8650
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b9f1c94cd791da8c86bc
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9f1c94cd791da8c86bd
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b9550a2a63fccd8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9550a2a63fccd8c8630
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409ba9eb6f094e0108c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba9eb6f094e0108c864c
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b988b4ce660d3c8c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b988b4ce660d3c8c8634
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6409b4590678a708228c8631
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ima/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b4590678a708228c863a
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:26:27.810220  / # #
    2023-03-09T10:26:27.912053  export SHELL=/bin/sh
    2023-03-09T10:26:27.912511  #
    2023-03-09T10:26:28.013847  / # export SHELL=/bin/sh. /lava-3400046/environment
    2023-03-09T10:26:28.014330  <3>[   18.516508] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:26:28.014731  
    2023-03-09T10:26:28.116248  / # . /lava-3400046/environment/lava-3400046/bin/lava-test-runner /lava-3400046/1
    2023-03-09T10:26:28.117005  
    2023-03-09T10:26:28.122394  / # /lava-3400046/bin/lava-test-runner /lava-3400046/1
    2023-03-09T10:26:28.187409  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6409b4e6c9c689a06d8c8678
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b4e6c9c689a06d8c8681
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:28:31.169733  / # #
    2023-03-09T10:28:31.271552  export SHELL=/bin/sh
    2023-03-09T10:28:31.272305  #
    2023-03-09T10:28:31.374191  / # export SHELL=/bin/sh. /lava-3400109/environment
    2023-03-09T10:28:31.374573  
    2023-03-09T10:28:31.374806  / # <3>[   18.343950] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:28:31.476224  . /lava-3400109/environment/lava-3400109/bin/lava-test-runner /lava-3400109/1
    2023-03-09T10:28:31.476927  
    2023-03-09T10:28:31.491618  / # /lava-3400109/bin/lava-test-runner /lava-3400109/1
    2023-03-09T10:28:31.546429  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON...OMIZE_BASE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b611e245df6b0b8c8641
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b611e245df6b0b8c864a
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:33:29.887444  / # #
    2023-03-09T10:33:29.989341  export SHELL=/bin/sh
    2023-03-09T10:33:29.989788  #
    2023-03-09T10:33:30.091276  / # export SHELL=/bin/sh. /lava-3400159/environment
    2023-03-09T10:33:30.092021  
    2023-03-09T10:33:30.092497  / # <3>[   18.424514] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:33:30.194306  . /lava-3400159/environment/lava-3400159/bin/lava-test-runner /lava-3400159/1
    2023-03-09T10:33:30.195616  
    2023-03-09T10:33:30.199925  / # /lava-3400159/bin/lava-test-runner /lava-3400159/1
    2023-03-09T10:33:30.243351  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._16K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6409b66156edd517fa8c863c
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_16K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+CONF...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b66156edd517fa8c8645
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:35:03.024836  
    2023-03-09T10:35:03.126912  / # #export SHELL=/bin/sh
    2023-03-09T10:35:03.127441  
    2023-03-09T10:35:03.228780  / # export SHELL=/bin/sh. /lava-3400171/environment
    2023-03-09T10:35:03.229234  
    2023-03-09T10:35:03.229774  / # . /lava-3400171/environment<3>[   17.937631] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:35:03.331631  /lava-3400171/bin/lava-test-runner /lava-3400171/1
    2023-03-09T10:35:03.332913  
    2023-03-09T10:35:03.350783  / # /lava-3400171/bin/lava-test-runner /lava-3400171/1
    2023-03-09T10:35:03.396701  + export 'TESTRUN_ID=1_bootrr' 
    ... (13 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6409b6b1b4d335f4ac8c8671
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+vide...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b6b1b4d335f4ac8c867a
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:36:22.905485  <8>[   18.118061] <LAVA_SIGNAL_ENDRUN 0_dmesg 3400238_1.5.2.4.1>
    2023-03-09T10:36:23.009176  / # #
    2023-03-09T10:36:23.111160  export SHELL=/bin/sh
    2023-03-09T10:36:23.111705  #
    2023-03-09T10:36:23.213117  / # export SHELL=/bin/sh. /lava-3400238/environment
    2023-03-09T10:36:23.213668  
    2023-03-09T10:36:23.213978  / # <3>[   18.360460] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:36:23.315259  . /lava-3400238/environment/lava-3400238/bin/lava-test-runner /lava-3400238/1
    2023-03-09T10:36:23.316087  
    2023-03-09T10:36:23.335268  / # /lava-3400238/bin/lava-test-runner /lava-3400238/1 
    ... (15 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6409b7023742e5ac648c8645
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig/gcc-...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b7023742e5ac648c864e
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:37:43.526849  / # #
    2023-03-09T10:37:43.629504  export SHELL=/bin/sh
    2023-03-09T10:37:43.629870  #
    2023-03-09T10:37:43.731187  / # export SHELL=/bin/sh. /lava-3400268/environment
    2023-03-09T10:37:43.731552  
    2023-03-09T10:37:43.731784  / # <3>[   18.368527] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:37:43.833106  . /lava-3400268/environment/lava-3400268/bin/lava-test-runner /lava-3400268/1
    2023-03-09T10:37:43.833878  
    2023-03-09T10:37:43.850930  / # /lava-3400268/bin/lava-test-runner /lava-3400268/1
    2023-03-09T10:37:43.905830  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6409bae9768c085afd8c8650
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+cryp...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409bae9768c085afd8c8659
        failing since 50 days (last pass: next-20230109, first fail: next-20230118)
2023-03-09T10:54:13.279394  / # #
    2023-03-09T10:54:13.381370  export SHELL=/bin/sh
    2023-03-09T10:54:13.381848  #
    2023-03-09T10:54:13.483257  / # export SHELL=/bin/sh. /lava-3400530/environment
    2023-03-09T10:54:13.483750  
    2023-03-09T10:54:13.484031  / # <3>[  100.580069] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-09T10:54:13.585366  . /lava-3400530/environment/lava-3400530/bin/lava-test-runner /lava-3400530/1
    2023-03-09T10:54:13.586232  
    2023-03-09T10:54:13.600826  / # /lava-3400530/bin/lava-test-runner /lava-3400530/1
    2023-03-09T10:54:13.657801  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409acf49e5656db108c8658
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/cros---chromeo...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/cros---chromeo...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409acf49e5656db108c8659
        failing since 41 days (last pass: next-20230120, first fail: next-20230127)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409a914ed6939fa4d8c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/cros---chromeo...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/cros---chromeo...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409a914ed6939fa4d8c8651
        failing since 44 days (last pass: next-20230123, first fail: next-20230124)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | defconfig+arm64-chromebook   | 2
Details:     https://kernelci.org/test/plan/id/6409a8572fb90837718c8632
Results:     163 PASS, 8 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+arm6...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+arm6...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.mtk-thermal-driver-present: https://kernelci.org/test/case/id/6409a8572fb90837718c864f
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
2023-03-09T09:34:55.907553  /lava-9514318/1/../bin/lava-test-case
2023-03-09T09:34:55.917114  <8>[   29.816016] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mtk-thermal-driver-present RESULT=fail>
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409a8572fb90837718c86ae
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
2023-03-09T09:34:43.918733  + set +x
2023-03-09T09:34:43.922420  <8>[   17.824779] <LAVA_SIGNAL_ENDRUN 0_dmesg 9514318_1.5.2.3.1>
2023-03-09T09:34:44.037380  / # #
2023-03-09T09:34:44.140104  export SHELL=/bin/sh
2023-03-09T09:34:44.140894  #
2023-03-09T09:34:44.242913  / # export SHELL=/bin/sh. /lava-9514318/environment
2023-03-09T09:34:44.243761
2023-03-09T09:34:44.345343  / # . /lava-9514318/environment/lava-9514318/bin/lava-test-runner /lava-9514318/1
2023-03-09T09:34:44.346519
2023-03-09T09:34:44.351312  / # /lava-9514318/bin/lava-test-runner /lava-9514318/1
... (12 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3
Details:     https://kernelci.org/test/plan/id/6409b515dfa54638978c86f6
Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+arm6...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+arm6...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/6409b515dfa54638978c87ac
        failing since 35 days (last pass: next-20230130, first fail: next-20230202)
2023-03-09T10:29:10.241959  /lava-9515106/1/../bin/lava-test-case
2023-03-09T10:29:10.252337  <8>[   22.651629] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/6409b515dfa54638978c87ad
        failing since 35 days (last pass: next-20230130, first fail: next-20230202)
2023-03-09T10:29:09.225967  /lava-9515106/1/../bin/lava-test-case
2023-03-09T10:29:09.232067  <8>[   21.632021] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>
* baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/6409b515dfa54638978c87ae
        failing since 35 days (last pass: next-20230130, first fail: next-20230202)
2023-03-09T10:29:07.197198    Res:          0x0
2023-03-09T10:29:07.197587  TPM2_CC_TestParms:
2023-03-09T10:29:07.197920    value: 0x18A
2023-03-09T10:29:07.200803    commandIndex: 0x18a
2023-03-09T10:29:07.203776    reserved1:    0x0
2023-03-09T10:29:07.204241    nv:           0
2023-03-09T10:29:07.207257    extensive:    0
2023-03-09T10:29:07.207704    flushed:      0
2023-03-09T10:29:07.210299    cHandles:     0x0
2023-03-09T10:29:07.210688    rHandle:      0
... (50 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10     | oxnas_v6_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6409b7c996c02238e48c865e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/oxnas_v6_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/oxnas_v6_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7c996c02238e48c865f
        failing since 198 days (last pass: next-20220822, first fail: next-20220823)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409c4ab32130038ed8c864a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409c4ab32130038ed8c864b
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-vexpress-a9         | arm    | lab-baylibre    | gcc-10     | vexpress_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6409b12a898a30332a8c8687
Results:     3 PASS, 2 FAIL, 2 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/vexpress_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/vexpress_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/6409b12a898a30332a8c868f
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
2023-03-09T10:12:37.933557  /lava-3399998/1/../bin/lava-test-case
    2023-03-09T10:12:38.025243  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-vexpress-a9         | arm    | lab-broonie     | gcc-10     | vexpress_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6409b115898a30332a8c8638
Results:     3 PASS, 2 FAIL, 2 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/vexpress_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/vexpress_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/6409b115898a30332a8c8640
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
2023-03-09T10:12:25.965530  /lava-131975/1/../bin/lava-test-case
    2023-03-09T10:12:26.034158  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-vexpress-a9         | arm    | lab-collabora   | gcc-10     | vexpress_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6409b0ee58ccb5047b8c8656
Results:     3 PASS, 2 FAIL, 2 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/vexpress_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/vexpress_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/6409b0ef58ccb5047b8c865e
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
2023-03-09T10:11:49.931945  /lava-9514930/1/../bin/lava-test-case
    2023-03-09T10:11:49.932168
2023-03-09T10:11:49.980038  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>
    2023-03-09T10:11:49.980227
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b7e39b1aece8488c8636
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7e39b1aece8488c8637
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b9ea758b2d3f988c8665
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9ea758b2d3f988c8666
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b7a5e5b66ba5ac8c86d7
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7a5e5b66ba5ac8c86d8
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b8bf0541b3af1d8c86d7
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b8bf0541b3af1d8c86d8
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b7a7e5b66ba5ac8c86e5
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7a7e5b66ba5ac8c86e6
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b9af8f64ba0e7b8c8637
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9af8f64ba0e7b8c8638
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b7aa40676c95688c8641
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7aa40676c95688c8642
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10     | multi_v7_defconfig+debug     | 1
Details:     https://kernelci.org/test/plan/id/6409b9c332c5f491218c8630
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9c332c5f491218c8631
        failing since 176 days (last pass: next-20220907, first fail: next-20220913)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-baylibre    | gcc-10     | defconfig+debug              | 1
Details:     https://kernelci.org/test/plan/id/6409bb1950a5c7d8828c8647
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bb1950a5c7d8828c8648
        failing since 1 day (last pass: next-20230307, first fail: next-20230308)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-broonie     | gcc-10     | defconfig+debug              | 1
Details:     https://kernelci.org/test/plan/id/6409bf67167fce900d8c864c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bf67167fce900d8c864d
        failing since 1 day (last pass: next-20230307, first fail: next-20230308)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/6409b696ee56838a7b8c864e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b696ee56838a7b8c864f
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig+debug         | 1
Details:     https://kernelci.org/test/plan/id/6409ba990fc36961ea8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig+...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig+...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba990fc36961ea8c8630
        failing since 23 days (last pass: next-20230210, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/6409b88262ab5c4d078c8699
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b88262ab5c4d078c869a
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig+debug         | 1
Details:     https://kernelci.org/test/plan/id/6409be0f387f9993f48c86d9
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig+...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig+...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409be0f387f9993f48c86da
        failing since 23 days (last pass: next-20230210, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig               | 1
Details:     https://kernelci.org/test/plan/id/6409b65356edd517fa8c8632
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/i386/i386_defconfig/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b65356edd517fa8c8633
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409a9d1f0076feb148c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409a9d1f0076feb148c8634
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409ab602d553b12c18c865e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ab602d553b12c18c865f
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | clang-13   | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409a9d1f0076feb148c8636
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409a9d1f0076feb148c8637
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/6409b360f63f8f1c118c8656
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b360f63f8f1c118c8657
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/6409b4754d5ea2bfc78c86dd
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b4754d5ea2bfc78c86de
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/6409b5008e014d9d2d8c86c1
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b5008e014d9d2d8c86c2
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/6409b5020a3005b0ba8c865d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b5020a3005b0ba8c865e
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409b5bb7c3b0552828c870d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b5bb7c3b0552828c870e
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409b95f0a2a63fccd8c8641
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b95f0a2a63fccd8c8642
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/6409b97968bd8471878c8635
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b97968bd8471878c8636
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/6409ba97b6f094e0108c8642
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba97b6f094e0108c8643
        failing since 14 days (last pass: next-20230222, first fail: next-20230223)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/6409b3a9f0e96a13938c8676
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b3a9f0e96a13938c8677
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/6409b4714d5ea2bfc78c86d5
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b4714d5ea2bfc78c86d6
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/6409b526dfa54638978c87ca
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b526dfa54638978c87cb
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/6409b67a800cdbd6d68c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b67a800cdbd6d68c8630
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409b6ca2cebcec44d8c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b6ca2cebcec44d8c863f
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409bb7c7030cee5f88c864f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bb7c7030cee5f88c8650
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/6409bbf341a80cb0f78c8679
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bbf341a80cb0f78c867a
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/6409bdfb387f9993f48c8695
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bdfb387f9993f48c8696
        failing since 14 days (last pass: next-20230222, first fail: next-20230223)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/6409b3478a4405d28a8c8665
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b3478a4405d28a8c8666
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/6409b4734d5ea2bfc78c86d8
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b4734d5ea2bfc78c86d9
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/6409b48787aeae8f018c8654
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b48787aeae8f018c8655
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/6409b513324d44f77c8c8640
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b513324d44f77c8c8641
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409b793ccab9264fb8c8636
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b793ccab9264fb8c8637
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/6409b694ee56838a7b8c8648
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b694ee56838a7b8c8649
        failing since 6 days (last pass: next-20221226, first fail: next-20230303)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/6409b99caead1a383c8c8660
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b99caead1a383c8c8661
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409bb06cc2b7ff4398c869f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bb06cc2b7ff4398c86a0
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/6409b846ecc2b875158c8636
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b846ecc2b875158c8637
        failing since 6 days (last pass: next-20221226, first fail: next-20230303)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/6409bccf592a83db528c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bccf592a83db528c864c
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409bf64430a0b5fb68c8689
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bf64430a0b5fb68c868a
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409a9d2f0076feb148c864d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409a9d2f0076feb148c864e
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409ab7419500507388c866e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ab7419500507388c866f
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | clang-13   | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409a9d2f0076feb148c8650
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409a9d2f0076feb148c8651
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/6409b35e120c72883b8c8641
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b35e120c72883b8c8642
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/6409b4764d5ea2bfc78c86eb
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b4764d5ea2bfc78c86ec
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/6409b4ecc9c689a06d8c868a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b4ecc9c689a06d8c868b
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/6409b5172bc08b59f48c8631
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b5172bc08b59f48c8632
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409b5be7c3b0552828c877d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b5be7c3b0552828c877e
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409b9378dc3cabdb18c8635
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9378dc3cabdb18c8636
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/6409b9770c7c28ab098c8653
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9770c7c28ab098c8654
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/6409ba95a66bc7965d8c864a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba95a66bc7965d8c864b
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/6409b36dce823dbab28c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b36dce823dbab28c8634
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/6409b4c2c01fc3d15c8c8632
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b4c2c01fc3d15c8c8633
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/6409b54ebdfdeb73ed8c865b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b54ebdfdeb73ed8c865c
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1
Details:     https://kernelci.org/test/plan/id/6409b68eff848547648c865c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b68eff848547648c865d
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409b6ded95165437b8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b6ded95165437b8c8630
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1
Details:     https://kernelci.org/test/plan/id/6409bb7b0120c92e268c8691
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bb7b0120c92e268c8692
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1
Details:     https://kernelci.org/test/plan/id/6409bbdff2eaf0451b8c8675
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bbdff2eaf0451b8c8676
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/6409bdd3cc7a0a052e8c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bdd3cc7a0a052e8c864c
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1
Details:     https://kernelci.org/test/plan/id/6409b333b58bf6ffcf8c8645
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b333b58bf6ffcf8c8646
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1
Details:     https://kernelci.org/test/plan/id/6409b474c607ad93158c8637
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b474c607ad93158c8638
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+amdgpu      | 1
Details:     https://kernelci.org/test/plan/id/6409b49b26219cd7908c8655
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b49b26219cd7908c8656
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1
Details:     https://kernelci.org/test/plan/id/6409b9244c758e22ab8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9244c758e22ab8c8630
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/6409b695ee56838a7b8c864b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b695ee56838a7b8c864c
        failing since 6 days (last pass: next-20221226, first fail: next-20230303)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/6409b99eaead1a383c8c8663
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b99eaead1a383c8c8664
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409bb05cc2b7ff4398c869a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bb05cc2b7ff4398c869b
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1
Details:     https://kernelci.org/test/plan/id/6409b85ae43e8618838c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b85ae43e8618838c863f
        failing since 6 days (last pass: next-20221226, first fail: next-20230303)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/6409bcf7e503ca654a8c863f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bcf7e503ca654a8c8640
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1
Details:     https://kernelci.org/test/plan/id/6409bf3b4309ee15bb8c866e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409bf3b4309ee15bb8c866f
        failing since 23 days (last pass: next-20230213, first fail: next-20230214)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | rustc-1.62 | x86_64_defcon...rust-samples | 1
Details:     https://kernelci.org/test/plan/id/6409b7e48b4a61266f8c8662
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/x86_64/x86_64_defcon...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b7e48b4a61266f8c8663
        failing since 22 days (last pass: next-20230213, first fail: next-20230215)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10     | shmobile_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6409b8262256afd89e8c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/shmobile_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/shmobile_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b8262256afd89e8c863e
        failing since 3 days (last pass: next-20230303, first fail: next-20230306)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b6bc2cebcec44d8c8631
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b6bc2cebcec44d8c8632
        failing since 107 days (last pass: next-20221121, first fail: next-20221122)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b5ba54b1779c6a8c8673
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b5ba54b1779c6a8c8674
        failing since 107 days (last pass: next-20221121, first fail: next-20221122)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409ba13b9bcc45ec28c866e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba13b9bcc45ec28c866f
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+debug              | 1
Details:     https://kernelci.org/test/plan/id/6409bb2b45f54b1fbe8c8633
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409bb2b45f54b1fbe8c863c
        failing since 63 days (last pass: next-20221130, first fail: next-20230105)
2023-03-09T10:55:30.624331  + set +x
    2023-03-09T10:55:30.625782  <8>[   69.422822][  T203] <LAVA_SIGNAL_ENDRUN 0_dmesg 410819_1.5.2.4.1>
    2023-03-09T10:55:30.764105  #
    2023-03-09T10:55:30.866432  / # #export SHELL=/bin/sh
    2023-03-09T10:55:30.866963  
    2023-03-09T10:55:30.968447  / # export SHELL=/bin/sh. /lava-410819/environment
    2023-03-09T10:55:30.969058  
    2023-03-09T10:55:31.070601  / # . /lava-410819/environment/lava-410819/bin/lava-test-runner /lava-410819/1
    2023-03-09T10:55:31.071573  
    2023-03-09T10:55:31.078173  / # /lava-410819/bin/lava-test-runner /lava-410819/1 
    ... (43 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b9254c758e22ab8c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b9254c758e22ab8c863e
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409ba4dae4b85bf958c8631
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409ba4dae4b85bf958c8632
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6409b90cfe33f4ffd18c8739
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+ksel...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b90dfe33f4ffd18c873a
        failing since 30 days (last pass: next-20230206, first fail: next-20230207)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/6409b4139c8f8b012c8c86c3
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/sunxi_defconfig/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/sunxi_defconfig/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b4139c8f8b012c8c86cc
        failing since 12 days (last pass: next-20230224, first fail: next-20230225)
2023-03-09T10:25:08.422561  / # #
    2023-03-09T10:25:08.528713  export SHELL=/bin/sh
    2023-03-09T10:25:08.531990  #
    2023-03-09T10:25:08.638560  / # export SHELL=/bin/sh. /lava-3400036/environment
    2023-03-09T10:25:08.641953  
    2023-03-09T10:25:08.748346  / # . /lava-3400036/environment/lava-3400036/bin/lava-test-runner /lava-3400036/1
    2023-03-09T10:25:08.751751  
    2023-03-09T10:25:08.764396  / # /lava-3400036/bin/lava-test-runner /lava-3400036/1
    2023-03-09T10:25:08.888161  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:25:08.889290  + cd /lava-3400036/1/tests/1_bootrr 
    ... (11 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/6409b3fac30e9850648c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/sunxi_defconfig/...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/sunxi_defconfig/...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b3fac30e9850648c8653
        failing since 44 days (last pass: next-20230123, first fail: next-20230124)
2023-03-09T10:24:39.133661  / # #
    2023-03-09T10:24:39.236076  export SHELL=/bin/sh
    2023-03-09T10:24:39.236639  #
    2023-03-09T10:24:39.338006  / # export SHELL=/bin/sh. /lava-3400031/environment
    2023-03-09T10:24:39.338558  
    2023-03-09T10:24:39.439989  / # . /lava-3400031/environment/lava-3400031/bin/lava-test-runner /lava-3400031/1
    2023-03-09T10:24:39.440881  
    2023-03-09T10:24:39.458121  / # /lava-3400031/bin/lava-test-runner /lava-3400031/1
    2023-03-09T10:24:39.585956  + export 'TESTRUN_ID=1_bootrr'
    2023-03-09T10:24:39.586756  + cd /lava-3400031/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6409b67eff848547648c863d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm/multi_v7_defconf...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6409b67eff848547648c863e
        failing since 105 days (last pass: next-20221121, first fail: next-20221123)
platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10     | defconfig+debug              | 1
Details:     https://kernelci.org/test/plan/id/6409b98cb4ce660d3c8c8638
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  HTML log:    https://storage.kernelci.org//next/master/next-20230309/arm64/defconfig+debu...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6409b98cb4ce660d3c8c863f
        failing since 63 days (last pass: next-20221207, first fail: next-20230105)
2023-03-09T10:48:21.098266  + set +x
    2023-03-09T10:48:21.123366  <8>[   44.530231][  T192] <LAVA_SIGNAL_ENDRUN 0_dmesg 870560_1.5.2.4.1>
    2023-03-09T10:48:21.265759  #
    2023-03-09T10:48:21.368008  / # #export SHELL=/bin/sh
    2023-03-09T10:48:21.368481  
    2023-03-09T10:48:21.469856  / # export SHELL=/bin/sh. /lava-870560/environment
    2023-03-09T10:48:21.470334  
    2023-03-09T10:48:21.571754  / # . /lava-870560/environment/lava-870560/bin/lava-test-runner /lava-870560/1
    2023-03-09T10:48:21.572535  
    2023-03-09T10:48:21.577189  / # /lava-870560/bin/lava-test-runner /lava-870560/1 
    ... (18 line(s) more)

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

next/master baseline: 972 runs, 155 regressions (next-20230309)