mainline/master baseline: 684 runs, 88 regressions (v6.3-rc2-16-g4979bf8668255) - Kernel-build-reports

14 Mar 2023


      mainline/master baseline: 684 runs, 88 regressions (v6.3-rc2-16-g4979bf8668255)
Regressions Summary
-------------------
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm   | lab-collabora | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beaglebone-black             | arm   | lab-broonie   | gcc-10   | omap2plus_defconfig          | 1          
beaglebone-black             | arm   | lab-cip       | gcc-10   | omap2plus_defconfig          | 1          
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+ima       | 1          
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig           | 1          
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+crypto    | 1          
da850-lcdk                   | arm   | lab-baylibre  | gcc-10   | davinci_all_defconfig        | 1          
imx6q-udoo                   | arm   | lab-broonie   | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 2          
jetson-tk1                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | clang-11 | defconfig+CON..._64K_PAGES=y | 5          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+videodec           | 5          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+kselftest          | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+crypto             | 5          
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron   | gcc-10   | multi_v7_defconfig+crypto    | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron   | clang-11 | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron   | gcc-10   | defconfig                    | 2          
meson-g12a-sei510            | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1          
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1          
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1          
meson-g12a-u200              | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64 | lab-collabora | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1          
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1          
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1          
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1          
meson-gxl-s905d-p230         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-khadas-vim3l       | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1          
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1          
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1          
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1          
mt8173-elm-hana              | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8192-asurada-spherion-r0   | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre  | gcc-10   | oxnas_v6_defconfig           | 1          
rk3288-rock2-square          | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1          
rk3399-roc-pc                | arm64 | lab-clabbe    | clang-11 | defconfig+CON..._64K_PAGES=y | 1          
rk3399-roc-pc                | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64 | lab-collabora | gcc-10   | defconfig+kselftest          | 1          
sc7180-trogdor-kingoftown    | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1          
sun50i-a64-pine64-plus       | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-zero  | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | clang-16 | multi_v7_defconfig           | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+ima       | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig           | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+crypto    | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          
tegra124-nyan-big            | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1
Details:  https://kernelci.org/test/job/mainline/branch/master/kernel/v6.3-rc2-16-g497...
Test:     baseline
  Tree:     mainline
  Branch:   master
  Describe: v6.3-rc2-16-g4979bf8668255
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
  SHA:      4979bf8668255a67449714653314662fbc7e5bdb
Test Regressions
----------------
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm   | lab-collabora | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca4444e4ecde188c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410ca4444e4ecde188c863f
        failing since 16 days (last pass: v6.2-10827-g489fa31ea873, first fail: v6.2-11606-g116b41162f8b)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-broonie   | gcc-10   | omap2plus_defconfig          | 1
Details:     https://kernelci.org/test/plan/id/6410cc227f0e6540638c864a
Results:     52 PASS, 3 FAIL, 1 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cc227f0e6540638c8683
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T19:33:36.862251  <8>[   20.859769] <LAVA_SIGNAL_ENDRUN 0_dmesg 163000_1.5.2.4.1>
    2023-03-14T19:33:36.973067  / # #
    2023-03-14T19:33:37.075574  export SHELL=/bin/sh
    2023-03-14T19:33:37.076470  #
    2023-03-14T19:33:37.178879  / # export SHELL=/bin/sh. /lava-163000/environment
    2023-03-14T19:33:37.179585  
    2023-03-14T19:33:37.281895  / # . /lava-163000/environment/lava-163000/bin/lava-test-runner /lava-163000/1
    2023-03-14T19:33:37.283069  
    2023-03-14T19:33:37.288101  / # /lava-163000/bin/lava-test-runner /lava-163000/1
    2023-03-14T19:33:37.394242  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-cip       | gcc-10   | omap2plus_defconfig          | 1
Details:     https://kernelci.org/test/plan/id/6410e1bca5b7c36e778c863d
Results:     52 PASS, 3 FAIL, 1 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410e1bca5b7c36e778c8644
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T21:05:55.946658  <8>[   15.919083] <LAVA_SIGNAL_ENDRUN 0_dmesg 875383_1.5.2.4.1>
    2023-03-14T21:05:56.057821  / # #
    2023-03-14T21:05:56.160419  export SHELL=/bin/sh
    2023-03-14T21:05:56.161208  #
    2023-03-14T21:05:56.263214  / # export SHELL=/bin/sh. /lava-875383/environment
    2023-03-14T21:05:56.264030  
    2023-03-14T21:05:56.366044  / # . /lava-875383/environment/lava-875383/bin/lava-test-runner /lava-875383/1
    2023-03-14T21:05:56.367315  
    2023-03-14T21:05:56.374308  / # /lava-875383/bin/lava-test-runner /lava-875383/1
    2023-03-14T21:05:56.481138  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca23881b9a43948c8654
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca23881b9a43948c865d
        failing since 56 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-14T19:24:54.679552  <8>[   15.153974] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410638_1.5.2.4.1>
    2023-03-14T19:24:54.789088  / # #
    2023-03-14T19:24:54.891950  export SHELL=/bin/sh
    2023-03-14T19:24:54.892778  #
    2023-03-14T19:24:54.994978  / # export SHELL=/bin/sh. /lava-3410638/environment
    2023-03-14T19:24:54.995950  
    2023-03-14T19:24:55.097790  / # . /lava-3410638/environment/lava-3410638/bin/lava-test-runner /lava-3410638/1
    2023-03-14T19:24:55.099202  
    2023-03-14T19:24:55.099596  / # /lava-3410638/bin/lava-test-runner /lava-3410638/1<3>[   15.561775] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-14T19:24:55.104151   
    ... (12 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+ima       | 1
Details:     https://kernelci.org/test/plan/id/6410cab4e1102ee3158c8678
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cab4e1102ee3158c8681
        failing since 56 days (last pass: v6.1-13139-gf9ff5644bcc0, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-14T19:27:25.677620  + set +x<8>[   14.719262] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410664_1.5.2.4.1>
    2023-03-14T19:27:25.678367  
    2023-03-14T19:27:25.790582  / # #
    2023-03-14T19:27:25.894696  export SHELL=/bin/sh
    2023-03-14T19:27:25.895722  #
    2023-03-14T19:27:25.997905  / # export SHELL=/bin/sh. /lava-3410664/environment
    2023-03-14T19:27:25.999150  
    2023-03-14T19:27:26.000061  / # . /lava-3410664/en<3>[   15.005936] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-14T19:27:26.102505  vironment/lava-3410664/bin/lava-test-runner /lava-3410664/1
    2023-03-14T19:27:26.104474   
    ... (13 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6410cbd21445f807de8c866c
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cbd21445f807de8c8675
        failing since 56 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-14T19:32:13.840627  <8>[   14.830402] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410714_1.5.2.4.1>
    2023-03-14T19:32:13.950505  / # #
    2023-03-14T19:32:14.054646  export SHELL=/bin/sh
    2023-03-14T19:32:14.055530  #
    2023-03-14T19:32:14.157438  / # export SHELL=/bin/sh. /lava-3410714/environment
    2023-03-14T19:32:14.158104  
    2023-03-14T19:32:14.158443  / # <3>[   15.086050] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-14T19:32:14.259994  . /lava-3410714/environment/lava-3410714/bin/lava-test-runner /lava-3410714/1
    2023-03-14T19:32:14.261538  
    2023-03-14T19:32:14.266358  / # /lava-3410714/bin/lava-test-runner /lava-3410714/1 
    ... (12 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1
Details:     https://kernelci.org/test/plan/id/6410cdee99e389706c8c864c
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cdee99e389706c8c8655
        failing since 56 days (last pass: v6.1-13139-gf9ff5644bcc0, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-14T19:41:22.022653  <8>[   16.660431] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410849_1.5.2.4.1>
    2023-03-14T19:41:22.129635  / # #
    2023-03-14T19:41:22.231667  export SHELL=/bin/sh
    2023-03-14T19:41:22.232588  #
    2023-03-14T19:41:22.333750  / # export SHELL=/bin/sh. /lava-3410849/environment
    2023-03-14T19:41:22.334155  
    2023-03-14T19:41:22.435437  / # . /lava-3410849/environment/lava-3410849/bin/lava-test-runner /lava-3410849/1
    2023-03-14T19:41:22.436351  
    2023-03-14T19:41:22.441145  / # /lava-3410849/bin/lava-test-runner /lava-3410849/1
    2023-03-14T19:41:22.523373  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+crypto    | 1
Details:     https://kernelci.org/test/plan/id/6410d15ec418fbc5568c8635
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410d15ec418fbc5568c863c
        failing since 56 days (last pass: v6.1-13139-gf9ff5644bcc0, first fail: v6.2-rc4-31-g6e50979a9c87)
2023-03-14T19:55:50.594114  <8>[   24.425820] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410870_1.5.2.4.1>
    2023-03-14T19:55:50.708027  / # #
    2023-03-14T19:55:50.811951  export SHELL=/bin/sh
    2023-03-14T19:55:50.812779  #
    2023-03-14T19:55:50.914899  / # export SHELL=/bin/sh. /lava-3410870/environment
    2023-03-14T19:55:50.916023  
    2023-03-14T19:55:51.018997  / # . /lava-3410870/environment/lava-3410870/bin/lava-test-runner /lava-3410870/1
    2023-03-14T19:55:51.020344  
    2023-03-14T19:55:51.024658  / # /lava-3410870/bin/lava-test-runner /lava-3410870/1
    2023-03-14T19:55:51.112688  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
da850-lcdk                   | arm   | lab-baylibre  | gcc-10   | davinci_all_defconfig        | 1
Details:     https://kernelci.org/test/plan/id/6410c5d590cd97235e8c8659
Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.dmesg.emerg: https://kernelci.org/test/case/id/6410c5d590cd97235e8c865c
        failing since 11 days (last pass: v6.2-1847-gdb77b8502a40, first fail: v6.2-13277-g2eb29d59ddf0)
        30 lines
2023-03-14T19:06:40.424981  kern  :alert : Register r6 information: NULL pointer
    2023-03-14T19:06:40.467970  kern  :alert : Register r7 information: non-paged memory
    2023-03-14T19:06:40.468551  kern  :alert : Register r8 information: slab kmalloc-512 start c4b9c200 pointer offset 4 size 512
    2023-03-14T19:06:40.468947  kern  :alert : Register r9 information: non-paged memory
    2023-03-14T19:06:40.469615  kern  :alert : Register r10 information: NULL pointer
    2023-03-14T19:06:40.470037  kern  :alert : Register r11 information: 5-page vmalloc region starting at 0xbf3e2000 allocated at load_module+0x898/0x1b10
    2023-03-14T19:06:40.471170  kern  :alert : Register r12 information: non-paged memory
    2023-03-14T19:06:40.559232  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-03-14T19:06:40.559905  kern  :emerg : Process udevd (pid: 64, stack limit = 0xf58e5aee)
    2023-03-14T19:06:40.560425  kern  :emerg : Stack: (0xc88fdcf8 to 0xc88fe000) 
    ... (8 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
imx6q-udoo                   | arm   | lab-broonie   | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 2
Details:     https://kernelci.org/test/plan/id/6410ce0409a6e162598c8664
Results:     29 PASS, 4 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.sound-card: https://kernelci.org/test/case/id/6410ce0409a6e162598c8671
        new failure (last pass: v6.3-rc2-6-gfc89d7fb499b)
2023-03-14T19:41:38.387151  /lava-163040/1/../bin/lava-test-case
    2023-03-14T19:41:38.409823  <8>[   32.747773] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sound-card RESULT=fail>
* baseline.bootrr.sound-card-probed: https://kernelci.org/test/case/id/6410ce0409a6e162598c8672
        new failure (last pass: v6.3-rc2-6-gfc89d7fb499b)
2023-03-14T19:41:37.346069  /lava-163040/1/../bin/lava-test-case
    2023-03-14T19:41:37.369167  <8>[   31.706446] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sound-card-probed RESULT=fail>
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6410c583fbd0ef5bf48c868e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410c583fbd0ef5bf48c868f
        failing since 318 days (last pass: v5.18-rc2, first fail: v5.18-rc4-205-g3e71713c9e75)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | clang-11 | defconfig+CON..._64K_PAGES=y | 5
Details:     https://kernelci.org/test/plan/id/6410ca999fe1feecd88c8661
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca999fe1feecd88c8668
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:26:59.639421  / # #
    2023-03-14T19:26:59.747371  export SHELL=/bin/sh
    2023-03-14T19:26:59.749545  #
    2023-03-14T19:26:59.856521  / # export SHELL=/bin/sh. /lava-295463/environment
    2023-03-14T19:26:59.857184  
    2023-03-14T19:26:59.958856  / # . /lava-295463/environment/lava-295463/bin/lava-test-runner /lava-295463/1
    2023-03-14T19:26:59.959457  
    2023-03-14T19:26:59.979519  / # /lava-295463/bin/lava-test-runner /lava-295463/1
    2023-03-14T19:27:00.032649  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:27:00.032940  + <8>[   22.540302] <LAVA_SIGNAL_STARTRUN 1_bootrr 295463_1.5.2.4.5> 
    ... (17 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/6410ca999fe1feecd88c866c
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:27:01.094926  <8>[   23.627064] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-driver-present RESULT=pass>
    2023-03-14T19:27:02.127836  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:02.128133  <8>[   24.648310] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-14T19:27:02.128291  /lava-295463/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6410ca999fe1feecd88c866e
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:27:03.185938  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:03.186230  <8>[   25.685273] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-14T19:27:03.186483  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:03.186725  <8>[   25.702095] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2023-03-14T19:27:03.186889  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:03.187034  <8>[   25.721518] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2023-03-14T19:27:03.187174  /lava-295463/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/6410ca999fe1feecd88c8673
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:27:04.264044  /lava-295463/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/6410ca999fe1feecd88c8674
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:27:04.266825  <8>[   26.796317] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-14T19:27:05.320865  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:05.321176  <8>[   27.816952] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-14T19:27:05.321336  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:05.321484  <8>[   27.833552] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2023-03-14T19:27:05.321628  /lava-295463/1/../bin/lava-test-case
    2023-03-14T19:27:05.321767  <8>[   27.853436] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-probed RESULT=pass>
    2023-03-14T19:27:05.321905  /lava-295463/1/../bin/lava-test-case
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+videodec           | 5
Details:     https://kernelci.org/test/plan/id/6410c97f48847e89848c866c
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c97f48847e89848c8673
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:22:20.450391  / # #
    2023-03-14T19:22:20.552505  export SHELL=/bin/sh
    2023-03-14T19:22:20.552961  #
    2023-03-14T19:22:20.654472  / # export SHELL=/bin/sh. /lava-295444/environment
    2023-03-14T19:22:20.654909  
    2023-03-14T19:22:20.757250  / # . /lava-295444/environment/lava-295444/bin/lava-test-runner /lava-295444/1
    2023-03-14T19:22:20.758061  
    2023-03-14T19:22:20.762314  / # /lava-295444/bin/lava-test-runner /lava-295444/1
    2023-03-14T19:22:20.830240  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:22:20.830545  + <8>[   22.417907] <LAVA_SIGNAL_STARTRUN 1_bootrr 295444_1.5.2.4.5> 
    ... (17 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/6410c97f48847e89848c8677
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:22:22.923220  /lava-295444/1/../bin/lava-test-case
    2023-03-14T19:22:22.923601  <8>[   24.523272] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-14T19:22:22.923851  /lava-295444/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6410c97f48847e89848c8679
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:22:23.983827  /lava-295444/1/../bin/lava-test-case
    2023-03-14T19:22:23.984266  <8>[   25.560054] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/6410c97f48847e89848c867e
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:22:25.059493  /lava-295444/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/6410c97f48847e89848c867f
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:22:25.062738  <8>[   26.675568] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-14T19:22:26.119705  /lava-295444/1/../bin/lava-test-case
    2023-03-14T19:22:26.121173  <8>[   27.696755] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-14T19:22:26.121469  /lava-295444/1/../bin/lava-test-case
    2023-03-14T19:22:26.121699  <8>[   27.714240] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2023-03-14T19:22:26.121927  /lava-295444/1/../bin/lava-test-case
    2023-03-14T19:22:26.122146  <8>[   27.733393] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-probed RESULT=pass>
    2023-03-14T19:22:26.122367  /lava-295444/1/../bin/lava-test-case
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc144e411778078c8675
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc144e411778078c8676
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+crypto             | 5
Details:     https://kernelci.org/test/plan/id/6410cd6ab8a784e0988c866f
Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cd6ab8a784e0988c8676
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:38:58.010498  <8>[   43.818160] <LAVA_SIGNAL_ENDRUN 0_dmesg 295487_1.5.2.4.1>
    2023-03-14T19:38:58.114908  / # #
    2023-03-14T19:38:58.218478  export SHELL=/bin/sh
    2023-03-14T19:38:58.219177  #
    2023-03-14T19:38:58.320402  / # export SHELL=/bin/sh. /lava-295487/environment
    2023-03-14T19:38:58.321171  
    2023-03-14T19:38:58.424014  / # . /lava-295487/environment/lava-295487/bin/lava-test-runner /lava-295487/1
    2023-03-14T19:38:58.424751  
    2023-03-14T19:38:58.442877  / # /lava-295487/bin/lava-test-runner /lava-295487/1
    2023-03-14T19:38:58.497582  + export 'TESTRUN_ID=1_bootrr' 
    ... (15 line(s) more)
* baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/6410cd6ab8a784e0988c867a
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:39:00.593426  /lava-295487/1/../bin/lava-test-case
    2023-03-14T19:39:00.593980  <8>[   46.390108] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-14T19:39:00.594175  /lava-295487/1/../bin/lava-test-case
* baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6410cd6ab8a784e0988c867c
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:39:01.631178  /lava-295487/1/../bin/lava-test-case
    2023-03-14T19:39:01.631476  <8>[   47.427886] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-14T19:39:01.631632  /lava-295487/1/../bin/lava-test-case
    2023-03-14T19:39:01.631776  <8>[   47.444828] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
* baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/6410cd6ab8a784e0988c8681
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:39:02.732093  /lava-295487/1/../bin/lava-test-case
* baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/6410cd6ab8a784e0988c8682
        failing since 21 days (last pass: v6.2-575-g5b0ed5964928, first fail: v6.2-1847-gdb77b8502a40)
2023-03-14T19:39:02.737134  <8>[   48.543483] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-14T19:39:03.792122  /lava-295487/1/../bin/lava-test-case
    2023-03-14T19:39:03.792729  <8>[   49.564679] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-14T19:39:03.792889  /lava-295487/1/../bin/lava-test-case
    2023-03-14T19:39:03.793036  <8>[   49.581908] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2023-03-14T19:39:03.793183  /lava-295487/1/../bin/lava-test-case
    2023-03-14T19:39:03.793322  <8>[   49.600868] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-probed RESULT=pass>
    2023-03-14T19:39:03.793460  /lava-295487/1/../bin/lava-test-case
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron   | gcc-10   | multi_v7_defconfig+crypto    | 1
Details:     https://kernelci.org/test/plan/id/6410d0d744d777b9378c863a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410d0d744d777b9378c863b
        new failure (last pass: v6.3-rc2-6-gfc89d7fb499b)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron   | clang-11 | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca5f3b612ec1ee8c865c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410ca5f3b612ec1ee8c865d
        failing since 11 days (last pass: v6.2-12485-gf3a2439f20d91, first fail: v6.2-13277-g2eb29d59ddf0)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron   | gcc-10   | defconfig                    | 2
Details:     https://kernelci.org/test/plan/id/6410c76581581501958c865b
Results:     51 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c76581581501958c8662
        new failure (last pass: v6.3-rc2-6-gfc89d7fb499b)
2023-03-14T19:13:14.789356  / # #
    2023-03-14T19:13:14.891402  export SHELL=/bin/sh
    2023-03-14T19:13:14.892057  #
    2023-03-14T19:13:14.993457  / # export SHELL=/bin/sh. /lava-295440/environment
    2023-03-14T19:13:14.994005  
    2023-03-14T19:13:15.095413  / # . /lava-295440/environment/lava-295440/bin/lava-test-runner /lava-295440/1
    2023-03-14T19:13:15.096205  
    2023-03-14T19:13:15.101069  / # /lava-295440/bin/lava-test-runner /lava-295440/1
    2023-03-14T19:13:15.166037  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:13:15.166375  + cd /l<8>[   15.076253] <LAVA_SIGNAL_STARTRUN 1_bootrr 295440_1.5.2.4.5> 
    ... (10 line(s) more)
* baseline.bootrr.dwc3-usb1-probed: https://kernelci.org/test/case/id/6410c76581581501958c8672
        new failure (last pass: v6.3-rc2-6-gfc89d7fb499b)
2023-03-14T19:13:17.543129  /lava-295440/1/../bin/lava-test-case
    2023-03-14T19:13:17.543554  <8>[   17.548538] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb1-probed RESULT=fail>
    2023-03-14T19:13:17.543846  /lava-295440/1/../bin/lava-test-case
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca648dbc1a0ede8c8654
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca648dbc1a0ede8c865d
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:26:04.317268  / # #
    2023-03-14T19:26:04.419998  export SHELL=/bin/sh
    2023-03-14T19:26:04.420397  #
    2023-03-14T19:26:04.521779  / # export SHELL=/bin/sh. /lava-3410683/environment
    2023-03-14T19:26:04.522530  <3>[   18.511842] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:26:04.523028  
    2023-03-14T19:26:04.624870  / # . /lava-3410683/environment/lava-3410683/bin/lava-test-runner /lava-3410683/1
    2023-03-14T19:26:04.626253  
    2023-03-14T19:26:04.643039  / # /lava-3410683/bin/lava-test-runner /lava-3410683/1
    2023-03-14T19:26:04.699014  + export 'TESTRUN_ID=1_bootrr' 
    ... (13 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6410c7425f756526e48c8646
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c7425f756526e48c864f
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:12:59.193480  <8>[   17.725528] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410537_1.5.2.4.1>
    2023-03-14T19:12:59.297978  / # #
    2023-03-14T19:12:59.399899  export SHELL=/bin/sh
    2023-03-14T19:12:59.400438  #
    2023-03-14T19:12:59.501831  / # export SHELL=/bin/sh. /lava-3410537/environment
    2023-03-14T19:12:59.502340  
    2023-03-14T19:12:59.502603  / # <3>[   17.970315] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:12:59.603900  . /lava-3410537/environment/lava-3410537/bin/lava-test-runner /lava-3410537/1
    2023-03-14T19:12:59.604796  
    2023-03-14T19:12:59.608879  / # /lava-3410537/bin/lava-test-runner /lava-3410537/1 
    ... (12 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6410c8700b119108648c863e
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c8700b119108648c8647
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:17:43.496452  <8>[   17.855781] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410571_1.5.2.4.1>
    2023-03-14T19:17:43.600466  / # #
    2023-03-14T19:17:43.702482  export SHELL=/bin/sh
    2023-03-14T19:17:43.702850  #
    2023-03-14T19:17:43.804273  / # export SHELL=/bin/sh. /lava-3410571/environment
    2023-03-14T19:17:43.805109  
    2023-03-14T19:17:43.805567  / # <3>[   18.100479] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:17:43.907296  . /lava-3410571/environment/lava-3410571/bin/lava-test-runner /lava-3410571/1
    2023-03-14T19:17:43.907924  
    2023-03-14T19:17:43.912092  / # /lava-3410571/bin/lava-test-runner /lava-3410571/1 
    ... (14 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbccbc19bf099c8c8670
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbccbc19bf099c8c8671
        failing since 36 days (last pass: v6.2-rc6-289-g870c3a9a2bc4, first fail: v6.2-rc7)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6410cc1c4e411778078c86d4
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cc1c4e411778078c86dd
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:33:35.599207  <8>[   17.720923] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410781_1.5.2.4.1>
    2023-03-14T19:33:35.703217  / # #
    2023-03-14T19:33:35.804943  export SHELL=/bin/sh
    2023-03-14T19:33:35.805595  #
    2023-03-14T19:33:35.907072  / # export SHELL=/bin/sh. /lava-3410781/environment
    2023-03-14T19:33:35.907487  <3>[   17.953494] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:33:35.907724  
    2023-03-14T19:33:36.009030  / # . /lava-3410781/environment/lava-3410781/bin/lava-test-runner /lava-3410781/1
    2023-03-14T19:33:36.009704  
    2023-03-14T19:33:36.019635  / # /lava-3410781/bin/lava-test-runner /lava-3410781/1 
    ... (14 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6410ccf75572369ba78c8631
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ccf75572369ba78c863a
        failing since 18 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:37:11.468883  / # #
    2023-03-14T19:37:11.570637  export SHELL=/bin/sh
    2023-03-14T19:37:11.571135  #
    2023-03-14T19:37:11.672458  / # export SHELL=/bin/sh. /lava-3410814/environment
    2023-03-14T19:37:11.672861  
    2023-03-14T19:37:11.673096  / # <3>[  102.836946] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:37:11.774376  . /lava-3410814/environment/lava-3410814/bin/lava-test-runner /lava-3410814/1
    2023-03-14T19:37:11.775977  
    2023-03-14T19:37:11.791130  / # /lava-3410814/bin/lava-test-runner /lava-3410814/1
    2023-03-14T19:37:11.845997  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-u200              | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbf78d174936e28c8641
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbf78d174936e28c8642
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc4e6eb77141118c8652
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc4e6eb77141118c8653
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc75fc852b996b8c8660
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc75fc852b996b8c8661
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64 | lab-collabora | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbe7305f2fac1e8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbe7305f2fac1e8c8630
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12b-odroid-n2         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbf28d174936e28c863e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbf28d174936e28c863f
        failing since 21 days (last pass: v6.2-340-geca3a04f140a, first fail: v6.2-575-g5b0ed5964928)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca9a9fe1feecd88c86c2
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca9a9fe1feecd88c86cb
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:26:30.619861  / # #
    2023-03-14T19:26:30.721822  export SHELL=/bin/sh
    2023-03-14T19:26:30.722332  #
    2023-03-14T19:26:30.823747  / # export SHELL=/bin/sh. /lava-3410703/environment
    2023-03-14T19:26:30.824271  
    2023-03-14T19:26:30.925682  / # . /lava-3410703/environment/lava-3410703/bin/lava-test-runner /lava-3410703/1
    2023-03-14T19:26:30.926471  
    2023-03-14T19:26:30.930675  / # /lava-3410703/bin/lava-test-runner /lava-3410703/1
    2023-03-14T19:26:31.008626  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:26:31.009004  + cd /lava-3410703/1/tests/1_bootrr 
    ... (15 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6410c75a263a656ef88c863e
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c75a263a656ef88c8647
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:13:20.098573  <8>[   18.094156] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410533_1.5.2.4.1>
    2023-03-14T19:13:20.203810  / # #
    2023-03-14T19:13:20.305481  export SHELL=/bin/sh
    2023-03-14T19:13:20.305828  #
    2023-03-14T19:13:20.407120  / # export SHELL=/bin/sh. /lava-3410533/environment
    2023-03-14T19:13:20.407478  
    2023-03-14T19:13:20.508816  / # . /lava-3410533/environment/lava-3410533/bin/lava-test-runner /lava-3410533/1
    2023-03-14T19:13:20.509424  
    2023-03-14T19:13:20.515220  / # /lava-3410533/bin/lava-test-runner /lava-3410533/1
    2023-03-14T19:13:20.587045  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6410c896211d7f44ad8c865a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c896211d7f44ad8c8663
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:18:07.108437  <8>[   18.199925] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410586_1.5.2.4.1>
    2023-03-14T19:18:07.214288  / # #
    2023-03-14T19:18:07.316001  export SHELL=/bin/sh
    2023-03-14T19:18:07.316398  #
    2023-03-14T19:18:07.417719  / # export SHELL=/bin/sh. /lava-3410586/environment
    2023-03-14T19:18:07.418082  
    2023-03-14T19:18:07.519380  / # . /lava-3410586/environment/lava-3410586/bin/lava-test-runner /lava-3410586/1
    2023-03-14T19:18:07.519996  
    2023-03-14T19:18:07.524941  / # /lava-3410586/bin/lava-test-runner /lava-3410586/1
    2023-03-14T19:18:07.601925  + export 'TESTRUN_ID=1_bootrr' 
    ... (17 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbfc305f2fac1e8c8641
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbfc305f2fac1e8c8642
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6410cc5cd017501fe88c863b
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cc5cd017501fe88c8644
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:34:39.121604  / # #
    2023-03-14T19:34:39.223621  export SHELL=/bin/sh
    2023-03-14T19:34:39.224091  #<3>[   17.694984] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:34:39.224413  
    2023-03-14T19:34:39.325905  / # export SHELL=/bin/sh. /lava-3410790/environment
    2023-03-14T19:34:39.326368  
    2023-03-14T19:34:39.427849  / # . /lava-3410790/environment/lava-3410790/bin/lava-test-runner /lava-3410790/1
    2023-03-14T19:34:39.428672  
    2023-03-14T19:34:39.437676  / # /lava-3410790/bin/lava-test-runner /lava-3410790/1
    2023-03-14T19:34:39.469743  + export 'TESTRUN_ID=1_bootrr' 
    ... (16 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6410ccd5688fd3826d8c8640
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ccd5688fd3826d8c8649
        failing since 18 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:36:42.030817  / # #
    2023-03-14T19:36:42.132922  export SHELL=/bin/sh
    2023-03-14T19:36:42.133452  #
    2023-03-14T19:36:42.234818  / # export SHELL=/bin/sh. /lava-3410828/environment
    2023-03-14T19:36:42.235362  
    2023-03-14T19:36:42.336836  / # . /lava-3410828/environment/lava-3410828/bin/lava-test-runner /lava-3410828/1
    2023-03-14T19:36:42.337703  
    2023-03-14T19:36:42.356018  / # /lava-3410828/bin/lava-test-runner /lava-3410828/1
    2023-03-14T19:36:42.411854  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:36:42.412192  + cd /lava-3410828/1/tests/1_bootrr 
    ... (15 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca984ecadbfd628c8665
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca984ecadbfd628c866e
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:26:39.549395  <8>[   18.509414] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410692_1.5.2.4.1>
    2023-03-14T19:26:39.656525  / # #
    2023-03-14T19:26:39.758860  export SHELL=/bin/sh
    2023-03-14T19:26:39.759526  #
    2023-03-14T19:26:39.861094  / # export SHELL=/bin/sh. /lava-3410692/environment
    2023-03-14T19:26:39.861721  
    2023-03-14T19:26:39.963299  / # . /lava-3410692/environment/lava-3410692/bin/lava-test-runner /lava-3410692/1
    2023-03-14T19:26:39.964054  
    2023-03-14T19:26:39.981759  / # /lava-3410692/bin/lava-test-runner /lava-3410692/1
    2023-03-14T19:26:40.054694  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6410c76f24f3934c358c86e1
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c76f24f3934c358c86ea
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:13:32.585830  / # #
    2023-03-14T19:13:32.687805  export SHELL=/bin/sh
    2023-03-14T19:13:32.688250  #
    2023-03-14T19:13:32.789715  / # export SHELL=/bin/sh. /lava-3410529/environment
    2023-03-14T19:13:32.790143  
    2023-03-14T19:13:32.891572  / # . /lava-3410529/environment/lava-3410529/bin/lava-test-runner /lava-3410529/1
    2023-03-14T19:13:32.892326  
    2023-03-14T19:13:32.911044  / # /lava-3410529/bin/lava-test-runner /lava-3410529/1
    2023-03-14T19:13:32.943094  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:13:32.982873  + cd /lava-3410529/1/tests/1_bootrr 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6410c8923509aec5aa8c8673
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c8923509aec5aa8c867c
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:18:18.880947  <8>[   17.963176] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410578_1.5.2.4.1>
    2023-03-14T19:18:18.986232  / # #
    2023-03-14T19:18:19.087913  export SHELL=/bin/sh
    2023-03-14T19:18:19.088261  #
    2023-03-14T19:18:19.189606  / # export SHELL=/bin/sh. /lava-3410578/environment
    2023-03-14T19:18:19.190009  
    2023-03-14T19:18:19.291411  / # . /lava-3410578/environment/lava-3410578/bin/lava-test-runner /lava-3410578/1
    2023-03-14T19:18:19.292106  
    2023-03-14T19:18:19.297685  / # /lava-3410578/bin/lava-test-runner /lava-3410578/1
    2023-03-14T19:18:19.374472  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6410cc87fe3424a09e8c868e
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cc87fe3424a09e8c8697
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:35:13.034937  <8>[   17.989000] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410782_1.5.2.4.1>
    2023-03-14T19:35:13.141549  / # #
    2023-03-14T19:35:13.243870  export SHELL=/bin/sh
    2023-03-14T19:35:13.244541  #
    2023-03-14T19:35:13.346086  / # export SHELL=/bin/sh. /lava-3410782/environment
    2023-03-14T19:35:13.346755  
    2023-03-14T19:35:13.448348  / # . /lava-3410782/environment/lava-3410782/bin/lava-test-runner /lava-3410782/1
    2023-03-14T19:35:13.449391  
    2023-03-14T19:35:13.467003  / # /lava-3410782/bin/lava-test-runner /lava-3410782/1
    2023-03-14T19:35:13.532874  + export 'TESTRUN_ID=1_bootrr' 
    ... (10 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6410cd4db8a784e0988c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cd4db8a784e0988c8653
        failing since 18 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:38:40.097082  / # #
    2023-03-14T19:38:40.198987  export SHELL=/bin/sh
    2023-03-14T19:38:40.199412  #
    2023-03-14T19:38:40.300815  / # export SHELL=/bin/sh. /lava-3410816/environment
    2023-03-14T19:38:40.301243  
    2023-03-14T19:38:40.402671  / # . /lava-3410816/environment/lava-3410816/bin/lava-test-runner /lava-3410816/1
    2023-03-14T19:38:40.403429  
    2023-03-14T19:38:40.422628  / # /lava-3410816/bin/lava-test-runner /lava-3410816/1
    2023-03-14T19:38:40.454661  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:38:40.489422  + cd /lava-3410816/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbf86c488dada98c8656
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbf96c488dada98c8657
        failing since 35 days (last pass: v6.2-rc6-239-g0136d86b7852, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbd585859fefc98c8672
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbd585859fefc98c8673
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc7ca07635b2968c864d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc7ca07635b2968c864e
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbe9f0bf88596c8c864f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbe9f0bf88596c8c8650
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc00305f2fac1e8c864c
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc00305f2fac1e8c864d
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc516eb77141118c868d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc516eb77141118c868e
        failing since 36 days (last pass: v6.2-rc6-289-g870c3a9a2bc4, first fail: v6.2-rc7)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64 | lab-baylibre  | clang-11 | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca6540bfc178078c8635
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca6540bfc178078c863e
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:26:17.005495  / # #
    2023-03-14T19:26:17.107573  export SHELL=/bin/sh
    2023-03-14T19:26:17.108309  #
    2023-03-14T19:26:17.210234  / # export SHELL=/bin/sh. /lava-3410698/environment
    2023-03-14T19:26:17.210617  
    2023-03-14T19:26:17.210856  / # <3>[   18.421786] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:26:17.312311  . /lava-3410698/environment/lava-3410698/bin/lava-test-runner /lava-3410698/1
    2023-03-14T19:26:17.313396  
    2023-03-14T19:26:17.328123  / # /lava-3410698/bin/lava-test-runner /lava-3410698/1
    2023-03-14T19:26:17.371180  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1
Details:     https://kernelci.org/test/plan/id/6410c756e181d737538c863f
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c756e181d737538c8648
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:13:19.482458  / # #
    2023-03-14T19:13:19.585207  export SHELL=/bin/sh
    2023-03-14T19:13:19.585921  #
    2023-03-14T19:13:19.687767  / # export SHELL=/bin/sh. /lava-3410550/environment
    2023-03-14T19:13:19.688143  
    2023-03-14T19:13:19.688370  / # <3>[   18.018262] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:13:19.789707  . /lava-3410550/environment/lava-3410550/bin/lava-test-runner /lava-3410550/1
    2023-03-14T19:13:19.790796  
    2023-03-14T19:13:19.805801  / # /lava-3410550/bin/lava-test-runner /lava-3410550/1
    2023-03-14T19:13:19.860479  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+videodec           | 1
Details:     https://kernelci.org/test/plan/id/6410c8710b119108648c864c
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c8710b119108648c8655
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:17:46.676733  / # #
    2023-03-14T19:17:46.779903  export SHELL=/bin/sh
    2023-03-14T19:17:46.780352  #
    2023-03-14T19:17:46.881697  / # export SHELL=/bin/sh. /lava-3410583/environment
    2023-03-14T19:17:46.882207  
    2023-03-14T19:17:46.882484  / # <3>[   18.072272] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:17:46.983973  . /lava-3410583/environment/lava-3410583/bin/lava-test-runner /lava-3410583/1
    2023-03-14T19:17:46.984726  
    2023-03-14T19:17:47.001873  / # /lava-3410583/bin/lava-test-runner /lava-3410583/1
    2023-03-14T19:17:47.056687  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbcabc19bf099c8c866d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbcabc19bf099c8c866e
        failing since 36 days (last pass: v6.2-rc6-289-g870c3a9a2bc4, first fail: v6.2-rc7)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1
Details:     https://kernelci.org/test/plan/id/6410cc1b9f3ddeca468c864a
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410cc1b9f3ddeca468c8653
        failing since 18 days (last pass: v6.2-6742-g307e14c03906, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:33:37.344542  / # #
    2023-03-14T19:33:37.445968  export SHELL=/bin/sh
    2023-03-14T19:33:37.446394  #
    2023-03-14T19:33:37.547816  / # export SHELL=/bin/sh. /lava-3410780/environment
    2023-03-14T19:33:37.548159  
    2023-03-14T19:33:37.548323  / # <3>[   18.068493] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:33:37.649522  . /lava-3410780/environment/lava-3410780/bin/lava-test-runner /lava-3410780/1
    2023-03-14T19:33:37.650923  
    2023-03-14T19:33:37.663182  / # /lava-3410780/bin/lava-test-runner /lava-3410780/1
    2023-03-14T19:33:37.719246  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1
Details:     https://kernelci.org/test/plan/id/6410ccf85572369ba78c863d
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ccf85572369ba78c8646
        failing since 18 days (last pass: v6.2-6669-g9fc2f99030b5, first fail: v6.2-8488-g0df82189bc42)
2023-03-14T19:37:11.562326  / # #
    2023-03-14T19:37:11.664388  export SHELL=/bin/sh
    2023-03-14T19:37:11.664830  #
    2023-03-14T19:37:11.766144  / # export SHELL=/bin/sh. /lava-3410815/environment
    2023-03-14T19:37:11.766605  
    2023-03-14T19:37:11.766838  / # <3>[  101.902267] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-14T19:37:11.868136  . /lava-3410815/environment/lava-3410815/bin/lava-test-runner /lava-3410815/1
    2023-03-14T19:37:11.868744  
    2023-03-14T19:37:11.881423  / # /lava-3410815/bin/lava-test-runner /lava-3410815/1
    2023-03-14T19:37:11.937385  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/6410cd29098b708bca8c8634
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cd29098b708bca8c8635
        failing since 48 days (last pass: v6.2-rc5-13-g2475bf0250de, first fail: v6.2-rc5-27-gfb6e71db53f3)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/6410cd193322a822988c866d
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cd193322a822988c866e
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/6410cd183322a822988c866a
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cd183322a822988c866b
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre  | gcc-10   | oxnas_v6_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6410c52592966b65068c8633
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410c52592966b65068c8634
        failing since 154 days (last pass: v6.0-9423-g493ffd6605b2d, first fail: v6.0-10822-g60bb8154d1d7)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3288-rock2-square          | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6410c68442aaa63fe78c864e
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410c68442aaa63fe78c864f
        failing since 84 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.1-13822-g6feb57c2fd7c)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6410c57e70a1101cd78c8644
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410c57e70a1101cd78c8645
        failing since 84 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.1-13822-g6feb57c2fd7c)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/6410cdc638daf63d148c8695
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cdc638daf63d148c8696
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64 | lab-clabbe    | clang-11 | defconfig+CON..._64K_PAGES=y | 1
Details:     https://kernelci.org/test/plan/id/6410ca6b8dbc1a0ede8c8662
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-11 (Debian clang version 11.0.1-2)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca6b8dbc1a0ede8c866b
        failing since 61 days (last pass: v6.2-rc2-320-g93928d485d9df, first fail: v6.2-rc3-30-ge8f60cd7db24)
2023-03-14T19:26:17.925791  <8>[   21.917278] <LAVA_SIGNAL_ENDRUN 0_dmesg 412900_1.5.2.4.1>
    2023-03-14T19:26:18.036473  / # #
    2023-03-14T19:26:18.138604  export SHELL=/bin/sh
    2023-03-14T19:26:18.139309  #
    2023-03-14T19:26:18.240657  / # export SHELL=/bin/sh. /lava-412900/environment
    2023-03-14T19:26:18.241371  
    2023-03-14T19:26:18.344101  / # . /lava-412900/environment/lava-412900/bin/lava-test-runner /lava-412900/1
    2023-03-14T19:26:18.345054  
    2023-03-14T19:26:18.351126  / # /lava-412900/bin/lava-test-runner /lava-412900/1
    2023-03-14T19:26:18.389163  + export 'TESTRUN_ID=1_bootrr' 
    ... (42 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc86fe3424a09e8c864f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc86fe3424a09e8c8650
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64 | lab-collabora | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbdaf0bf88596c8c862f
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbdaf0bf88596c8c8630
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sc7180-trogdor-kingoftown    | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/6410cd2b098b708bca8c863b
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cd2b098b708bca8c863c
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora | gcc-10   | defconfig+arm...ok+kselftest | 1
Details:     https://kernelci.org/test/plan/id/6410cd1a3322a822988c8670
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cd1a3322a822988c8671
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-11-g05ecb680708a)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cc9d7ffb0045648c8635
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cc9d7ffb0045648c8636
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1
Details:     https://kernelci.org/test/plan/id/6410cbe754ca4822868c8630
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410cbe754ca4822868c8631
        failing since 35 days (last pass: v6.2-rc7, first fail: v6.2-rc7-13-g513c1a3d3f19)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/6410c746c490d0ea008c8694
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c746c490d0ea008c869d
        failing since 15 days (last pass: v6.2-12018-g2fcd07b7ccd5f, first fail: v6.2-12485-gf3a2439f20d91)
2023-03-14T19:12:55.837083  / # #
    2023-03-14T19:12:55.942649  export SHELL=/bin/sh
    2023-03-14T19:12:55.944153  #
    2023-03-14T19:12:56.047499  / # export SHELL=/bin/sh. /lava-3410516/environment
    2023-03-14T19:12:56.049079  
    2023-03-14T19:12:56.152423  / # . /lava-3410516/environment/lava-3410516/bin/lava-test-runner /lava-3410516/1
    2023-03-14T19:12:56.155131  
    2023-03-14T19:12:56.163443  / # /lava-3410516/bin/lava-test-runner /lava-3410516/1
    2023-03-14T19:12:56.300216  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:12:56.301339  + cd /lava-3410516/1/tests/1_bootrr 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | clang-16 | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6410ca563b612ec1ee8c864b
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230308024507+c1949c6a310a-1~exp1~20230308144518.50))
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca563b612ec1ee8c8654
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T19:25:59.210601  / # #
    2023-03-14T19:25:59.313010  export SHELL=/bin/sh
    2023-03-14T19:25:59.313686  #
    2023-03-14T19:25:59.415296  / # export SHELL=/bin/sh. /lava-3410682/environment
    2023-03-14T19:25:59.415965  
    2023-03-14T19:25:59.517611  / # . /lava-3410682/environment/lava-3410682/bin/lava-test-runner /lava-3410682/1
    2023-03-14T19:25:59.518669  
    2023-03-14T19:25:59.534669  / # /lava-3410682/bin/lava-test-runner /lava-3410682/1
    2023-03-14T19:25:59.632603  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:25:59.633104  + cd /lava-3410682/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1
Details:     https://kernelci.org/test/plan/id/6410c9de0eb6c07c428c864e
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c9de0eb6c07c428c8657
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T19:23:57.332941  / # #
    2023-03-14T19:23:57.435466  export SHELL=/bin/sh
    2023-03-14T19:23:57.436109  #
    2023-03-14T19:23:57.537514  / # export SHELL=/bin/sh. /lava-3410642/environment
    2023-03-14T19:23:57.538046  
    2023-03-14T19:23:57.639450  / # . /lava-3410642/environment/lava-3410642/bin/lava-test-runner /lava-3410642/1
    2023-03-14T19:23:57.640562  
    2023-03-14T19:23:57.656917  / # /lava-3410642/bin/lava-test-runner /lava-3410642/1
    2023-03-14T19:23:57.748673  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:23:57.749354  + cd /lava-3410642/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+ima       | 1
Details:     https://kernelci.org/test/plan/id/6410c9f2d3072f4b518c8664
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c9f2d3072f4b518c866d
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T19:24:08.970641  / # #
    2023-03-14T19:24:09.072531  export SHELL=/bin/sh
    2023-03-14T19:24:09.073174  #
    2023-03-14T19:24:09.174802  / # export SHELL=/bin/sh. /lava-3410654/environment
    2023-03-14T19:24:09.175469  
    2023-03-14T19:24:09.277180  / # . /lava-3410654/environment/lava-3410654/bin/lava-test-runner /lava-3410654/1
    2023-03-14T19:24:09.277942  
    2023-03-14T19:24:09.294867  / # /lava-3410654/bin/lava-test-runner /lava-3410654/1
    2023-03-14T19:24:09.387700  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:24:09.388323  + cd /lava-3410654/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig           | 1
Details:     https://kernelci.org/test/plan/id/6410ca9e292cd8ccad8c86d0
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410ca9e292cd8ccad8c86d9
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T19:26:38.062518  / # #
    2023-03-14T19:26:38.164421  export SHELL=/bin/sh
    2023-03-14T19:26:38.164983  #
    2023-03-14T19:26:38.266359  / # export SHELL=/bin/sh. /lava-3410721/environment
    2023-03-14T19:26:38.266856  
    2023-03-14T19:26:38.368204  / # . /lava-3410721/environment/lava-3410721/bin/lava-test-runner /lava-3410721/1
    2023-03-14T19:26:38.368980  
    2023-03-14T19:26:38.373649  / # /lava-3410721/bin/lava-test-runner /lava-3410721/1
    2023-03-14T19:26:38.478563  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:26:38.479160  + cd /lava-3410721/1/tests/1_bootrr 
    ... (9 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig+crypto    | 1
Details:     https://kernelci.org/test/plan/id/6410d05af9336957928c86af
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410d05af9336957928c86b8
        failing since 6 days (last pass: v6.3-rc1, first fail: v6.3-rc1-2-g8ca09d5fa354)
2023-03-14T19:51:36.715619  / # #
    2023-03-14T19:51:36.817340  export SHELL=/bin/sh
    2023-03-14T19:51:36.817699  #
    2023-03-14T19:51:36.919009  / # export SHELL=/bin/sh. /lava-3410871/environment
    2023-03-14T19:51:36.919380  
    2023-03-14T19:51:37.020707  / # . /lava-3410871/environment/lava-3410871/bin/lava-test-runner /lava-3410871/1
    2023-03-14T19:51:37.021325  
    2023-03-14T19:51:37.026900  / # /lava-3410871/bin/lava-test-runner /lava-3410871/1
    2023-03-14T19:51:37.131823  + export 'TESTRUN_ID=1_bootrr'
    2023-03-14T19:51:37.132306  + cd /lava-3410871/1/tests/1_bootrr 
    ... (10 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1
Details:     https://kernelci.org/test/plan/id/6410c7335f756526e48c8639
Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6410c7335f756526e48c8642
        failing since 1 day (last pass: v6.3-rc1-242-g81ff855485a36, first fail: v6.3-rc2)
2023-03-14T19:12:25.873517  <8>[    9.694931] <LAVA_SIGNAL_ENDRUN 0_dmesg 3410520_1.5.2.4.1>
    2023-03-14T19:12:25.978897  / # #
    2023-03-14T19:12:26.080611  export SHELL=/bin/sh
    2023-03-14T19:12:26.080972  #
    2023-03-14T19:12:26.182300  / # export SHELL=/bin/sh. /lava-3410520/environment
    2023-03-14T19:12:26.182672  
    2023-03-14T19:12:26.284028  / # . /lava-3410520/environment/lava-3410520/bin/lava-test-runner /lava-3410520/1
    2023-03-14T19:12:26.284680  
    2023-03-14T19:12:26.290159  / # /lava-3410520/bin/lava-test-runner /lava-3410520/1
    2023-03-14T19:12:26.436086  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)
platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
tegra124-nyan-big            | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1
Details:     https://kernelci.org/test/plan/id/6410c6e7d3ebf593508c8634
Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  HTML log:    https://storage.kernelci.org//mainline/master/v6.3-rc2-16-g4979bf8668255/arm...
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230...
* baseline.login: https://kernelci.org/test/case/id/6410c6e7d3ebf593508c8635
        failing since 83 days (last pass: v6.1-13031-g77856d911a8c, first fail: v6.1-13822-g6feb57c2fd7c)