stable-rc/linux-4.19.y baseline: 149 runs, 42 regressions (v4.19.255-191-gab9c8d4442969)
Regressions Summary -------------------
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ at91sam9g20ek | arm | lab-broonie | gcc-10 | at91_dt_defconfig | 1 cubietruck | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 imx6dl-riotboard | arm | lab-pengutronix | gcc-10 | imx_v6_v7_defconfig | 1 imx6dl-riotboard | arm | lab-pengutronix | gcc-10 | multi_v7_defconfig | 1 imx6q-sabrelite | arm | lab-collabora | gcc-10 | multi_v7_defconfig | 1 imx6qp-sabresd | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1 imx6sx-sdb | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1 imx6sx-sdb | arm | lab-nxp | gcc-10 | multi_v7_defconfig | 1 imx6ul-14x14-evk | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1 imx6ul-14x14-evk | arm | lab-nxp | gcc-10 | multi_v7_defconfig | 1 imx6ul-pico-hobbit | arm | lab-pengutronix | gcc-10 | imx_v6_v7_defconfig | 1 imx6ul-pico-hobbit | arm | lab-pengutronix | gcc-10 | multi_v7_defconfig | 1 imx7d-sdb | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1 jetson-tk1 | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 jetson-tk1 | arm | lab-baylibre | gcc-10 | tegra_defconfig | 1 odroid-xu3 | arm | lab-collabora | gcc-10 | exynos_defconfig | 1 odroid-xu3 | arm | lab-collabora | gcc-10 | multi_v7_defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 rk3288-rock2-square | arm | lab-collabora | gcc-10 | multi_v7_defconfig | 1 rk3399-gru-kevin | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 sun4i-a10-olinuxino-lime | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 sun50i-a64-bananapi-m64 | arm64 | lab-clabbe | gcc-10 | defconfig | 1 sun5i-a13-olinuxino-micro | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 sun7i-a20-cubieboard2 | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 sun7i-a20-cubieboard2 | arm | lab-clabbe | gcc-10 | sunxi_defconfig | 1 sun7i-a20-olinuxino-lime2 | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 sun8i-a33-olinuxino | arm | lab-clabbe | gcc-10 | sunxi_defconfig | 1 sun8i-h2-plus-orangepi-r1 | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 sun8i-h2-plus-orangepi-zero | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1 sun8i-h3-orangepi-pc | arm | lab-clabbe | gcc-10 | sunxi_defconfig | 1 zynqmp-zcu102 | arm64 | lab-cip | gcc-10 | defconfig | 1 zynqmp-zcu102 | arm64 | lab-cip | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/job/stable-rc/branch/linux-4.19.y/kernel/v4.19.255...
Test: baseline Tree: stable-rc Branch: linux-4.19.y Describe: v4.19.255-191-gab9c8d4442969 URL: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git SHA: ab9c8d444296931571bf9154ac64138346b1496d
Test Regressions ----------------
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ at91sam9g20ek | arm | lab-broonie | gcc-10 | at91_dt_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2f9d33879150a8daf085
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: at91_dt_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2f9d33879150a8daf086 new failure (last pass: v4.19.254)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ cubietruck | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa35c8ea3a5c8bccdaf074
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa35c8ea3a5c8bccdaf075 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6dl-riotboard | arm | lab-pengutronix | gcc-10 | imx_v6_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa3403797eec87fcdaf067
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: imx_v6_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa3403797eec87fcdaf068 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6dl-riotboard | arm | lab-pengutronix | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa36e7fcb6de5d1edaf05c
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa36e7fcb6de5d1edaf05d new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6q-sabrelite | arm | lab-collabora | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2face1db134eb1daf057
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2face1db134eb1daf058 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6qp-sabresd | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2f3b1c248b92fadaf062
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: imx_v6_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2f3b1c248b92fadaf063 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6sx-sdb | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2f4d1446c192ccdaf082
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: imx_v6_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2f4d1446c192ccdaf083 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6sx-sdb | arm | lab-nxp | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa30dc7e9aff5f12daf056
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa30dc7e9aff5f12daf057 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6ul-14x14-evk | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2f4b1446c192ccdaf07c
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: imx_v6_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2f4b1446c192ccdaf07d new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6ul-14x14-evk | arm | lab-nxp | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa30da9ac443c5f5daf07e
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa30da9ac443c5f5daf07f new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6ul-pico-hobbit | arm | lab-pengutronix | gcc-10 | imx_v6_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa3af70cdb71c6e8daf05e
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: imx_v6_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa3af70cdb71c6e8daf05f new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx6ul-pico-hobbit | arm | lab-pengutronix | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa3db36e500056a9daf088
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa3db36e500056a9daf089 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ imx7d-sdb | arm | lab-nxp | gcc-10 | imx_v6_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2f4fa83c72b654daf065
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: imx_v6_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2f4fa83c72b654daf066 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ jetson-tk1 | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa416abf5162aa6edaf069
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa416abf5162aa6edaf06a new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ jetson-tk1 | arm | lab-baylibre | gcc-10 | tegra_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa3eaecde8ae5c71daf056
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: tegra_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa3eaecde8ae5c71daf057 new failure (last pass: v4.19.252-49-g8b84863f2dd59)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ odroid-xu3 | arm | lab-collabora | gcc-10 | exynos_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa446a939f4ac54edaf080
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: exynos_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa446a939f4ac54edaf081 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ odroid-xu3 | arm | lab-collabora | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa488f6b94185fdfdaf07c
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa488f6b94185fdfdaf07d new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa33e9797eec87fcdaf056
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa33e9797eec87fcdaf057 new failure (last pass: v4.19.230-41-g73351b9c55d9)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa356582262b3959daf071
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa356582262b3959daf072 failing since 97 days (last pass: v4.19.241-59-g7070c1b6eeed, first fail: v4.19.241-79-ge28b1117a7ab)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2faded25e63b03daf057
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2faded25e63b03daf058 new failure (last pass: v4.19.230-41-g73351b9c55d9)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa34257d21433e9ddaf067
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa34257d21433e9ddaf068 failing since 96 days (last pass: v4.19.241-59-g7070c1b6eeed, first fail: v4.19.241-89-g71a9ee8b0cfd)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa35a181ca380785daf07b
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa35a181ca380785daf07c failing since 97 days (last pass: v4.19.241-59-g7070c1b6eeed, first fail: v4.19.241-79-ge28b1117a7ab)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa33ea0b4d9a500bdaf074
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa33ea0b4d9a500bdaf075 failing since 11 days (last pass: v4.19.230-41-g73351b9c55d9, first fail: v4.19.254)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa35a35298305425daf066
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa35a35298305425daf067 new failure (last pass: v4.19.230-41-g73351b9c55d9)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2faea2aa6fec9fdaf059
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2faea2aa6fec9fdaf05a failing since 11 days (last pass: v4.19.230-41-g73351b9c55d9, first fail: v4.19.254)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa31014f76735635daf06e
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa31014f76735635daf06f new failure (last pass: v4.19.230-41-g73351b9c55d9)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa33fd0b4d9a500bdaf081
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa33fd0b4d9a500bdaf082 failing since 96 days (last pass: v4.19.241-59-g7070c1b6eeed, first fail: v4.19.241-89-g71a9ee8b0cfd)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa358d412fada5eddaf07a
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa358d412fada5eddaf07b failing since 97 days (last pass: v4.19.241-59-g7070c1b6eeed, first fail: v4.19.241-79-ge28b1117a7ab)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ rk3288-rock2-square | arm | lab-collabora | gcc-10 | multi_v7_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa33450e69789a8adaf066
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa33450e69789a8adaf067 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ rk3399-gru-kevin | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa300ee41c2b5e1bdaf078
Results: 83 PASS, 7 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.bootrr.rockchip-i2s1-probed: https://kernelci.org/test/case/id/62fa300ee41c2b5e1bdaf09a failing since 161 days (last pass: v4.19.232, first fail: v4.19.232-45-g5da8d73687e7)
2022-08-15T11:37:27.348461 /lava-7037767/1/../bin/lava-test-case<8>[ 35.760626] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-i2s0-probed RESULT=pass> 2022-08-15T11:37:27.348533 2022-08-15T11:37:28.359572 /lava-7037767/1/../bin/lava-test-case
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun4i-a10-olinuxino-lime | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa4a92a7647692b3daf086
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa4a92a7647692b3daf087 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun50i-a64-bananapi-m64 | arm64 | lab-clabbe | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2ffa790b794707daf07b
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2ffa790b794707daf07c new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun5i-a13-olinuxino-micro | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa35268add52fbbedaf05b
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa35268add52fbbedaf05c new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun7i-a20-cubieboard2 | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2e41eb94f4cd3ddaf05b
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2e41eb94f4cd3ddaf05c new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun7i-a20-cubieboard2 | arm | lab-clabbe | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2e56292ddbf81ddaf05a
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2e56292ddbf81ddaf05b new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun7i-a20-olinuxino-lime2 | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa585b3949e1d008355718
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa585b3949e1d008355719 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun8i-a33-olinuxino | arm | lab-clabbe | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2e4133451993b8daf067
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2e4233451993b8daf068 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun8i-h2-plus-orangepi-r1 | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa3415797eec87fcdaf07f
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa3415797eec87fcdaf080 new failure (last pass: v4.19.254)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun8i-h2-plus-orangepi-zero | arm | lab-baylibre | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa620d9ec4a6c2c3355690
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa620d9ec4a6c2c3355691 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ sun8i-h3-orangepi-pc | arm | lab-clabbe | gcc-10 | sunxi_defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa303672ff014699daf083
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: sunxi_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa303672ff014699daf084 new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ zynqmp-zcu102 | arm64 | lab-cip | gcc-10 | defconfig | 1
Details: https://kernelci.org/test/plan/id/62fa2faea2aa6fec9fdaf05c
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa2faea2aa6fec9fdaf05d new failure (last pass: v4.19.254-33-g02c6011ece11)
platform | arch | lab | compiler | defconfig | regressions ----------------------------+-------+-----------------+----------+----------------------------+------------ zynqmp-zcu102 | arm64 | lab-cip | gcc-10 | defconfig+arm64-chromebook | 1
Details: https://kernelci.org/test/plan/id/62fa315221d029a9cedaf09a
Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... HTML log: https://storage.kernelci.org//stable-rc/linux-4.19.y/v4.19.255-191-gab9c8d44... Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220...
* baseline.login: https://kernelci.org/test/case/id/62fa315221d029a9cedaf09b new failure (last pass: v4.19.254-33-g02c6011ece11)
kernel-build-reports@lists.linaro.org