[Please ignore this email if it is already reported]
Linux next-20220713 boot failed on arm, arm64, x86_64 and i386 [1].
Reported-by: Linux Kernel Functional Testing lkft@linaro.org Reported-by: Naresh Kamboju naresh.kamboju@linaro.org
metadata: git_ref: master git_repo: https://gitlab.com/Linaro/lkft/mirrors/next/linux-next git_sha: 4662b7adea50bb62e993a67f611f3be625d3df0d git_describe: next-20220713 kernel_version: 5.19.0-rc6 kernel-config: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO/config build-url: https://gitlab.com/Linaro/lkft/mirrors/next/linux-next/-/pipelines/586982028 artifact-location: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO vmlinux.xz: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO/vmlinux.xz System.map: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO/System.map toolchain: gcc-11
Here is the boot log output from arm64 juno-r2 device.
[ 0.000000] Booting Linux on physical CPU 0x0000000100 [0x410fd033] [ 0.000000] Linux version 5.19.0-rc6-next-20220713 (tuxmake@tuxmake) (aarch64-linux-gnu-gcc (Debian 11.3.0-3) 11.3.0, GNU ld (GNU Binutils for Debian) 2.38) #1 SMP PREEMPT @1657717522 [ 0.000000] Machine model: ARM Juno development board (r2) [ 0.000000] earlycon: pl11 at MMIO 0x000000007ff80000 (options '') [ 0.000000] printk: bootconsole [pl11] enabled [ 0.000000] efi: UEFI not found. [ 0.000000] NUMA: No NUMA configuration found [ 0.000000] NUMA: Faking a node at [mem 0x0000000080000000-0x00000009ffffffff] [ 0.000000] NUMA: NODE_DATA [mem 0x9fefd1b40-0x9fefd3fff] [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000080000000-0x00000000ffffffff] [ 0.000000] DMA32 empty [ 0.000000] Normal [mem 0x0000000100000000-0x00000009ffffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000080000000-0x00000000feffffff] [ 0.000000] node 0: [mem 0x0000000880000000-0x00000009ffffffff] [ 0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000009ffffffff] [ 0.000000] On node 0, zone Normal: 4096 pages in unavailable ranges [ 0.000000] cma: Reserved 32 MiB at 0x00000000fd000000 [ 0.000000] psci: probing for conduit method from DT. [ 0.000000] psci: PSCIv1.1 detected in firmware. [ 0.000000] psci: Using standard PSCI v0.2 function IDs [ 0.000000] psci: Trusted OS migration not required [ 0.000000] psci: SMC Calling Convention v1.0 [ 0.000000] percpu: Embedded 30 pages/cpu s82856 r8192 d31832 u122880 [ 0.000000] Detected VIPT I-cache on CPU0 [ 0.000000] CPU features: detected: ARM erratum 843419 [ 0.000000] CPU features: detected: ARM erratum 845719 [ 0.000000] Fallback order for Node 0: 0 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 2060288 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: console=ttyAMA0,115200n8 root=/dev/nfs rw nfsroot=10.66.16.120:/var/lib/lava/dispatcher/tmp/5283518/extract-nfsrootfs-ulkeoqdy,tcp,hard,vers=3,wsize=65536 earlycon=pl011,0x7ff80000 console_msg_format=syslog earlycon default_hugepagesz=2M hugepages=256 sky2.mac_address=0x00,0x02,0xF7,0x00,0x68,0x51 ip=dhcp <6>[ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) <6>[ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) <6>[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off <0>[ 0.000000] Kernel panic - not syncing: swiotlb_init_remap: nslabs = 0 too small <4>[ 0.000000] CPU: 0 PID: 0 Comm: swapper Not tainted 5.19.0-rc6-next-20220713 #1 <4>[ 0.000000] Hardware name: ARM Juno development board (r2) (DT) <4>[ 0.000000] Call trace: <4>[ 0.000000] dump_backtrace+0xe8/0x130 <4>[ 0.000000] show_stack+0x24/0x60 <4>[ 0.000000] dump_stack_lvl+0x8c/0xb8 <4>[ 0.000000] dump_stack+0x18/0x34 <4>[ 0.000000] panic+0x188/0x38c <4>[ 0.000000] swiotlb_init_remap+0x50/0x54 <4>[ 0.000000] swiotlb_init+0x20/0x2c <4>[ 0.000000] mem_init+0x38/0x48 <4>[ 0.000000] start_kernel+0x448/0x738 <4>[ 0.000000] __primary_switched+0xb8/0xc0 <0>[ 0.000000] ---[ end Kernel panic - not syncing: swiotlb_init_remap: nslabs = 0 too small ]---
Full test log link, [1] https://lkft.validation.linaro.org/scheduler/job/5283518#L582
Best regards Naresh Kamboju
-- Linaro LKFT https://lkft.linaro.org
On 7/14/22 13:17, Naresh Kamboju wrote:
[Please ignore this email if it is already reported]
Linux next-20220713 boot failed on arm, arm64, x86_64 and i386 [1].
Reported-by: Linux Kernel Functional Testing lkft@linaro.org Reported-by: Naresh Kamboju naresh.kamboju@linaro.org
There are couple of recent commits in swiotlb area, could you please check reverting them, if that solves the problem.
26ffb91fa5e0fb282e8 ("swiotlb: split up the global swiotlb lock") c51ba246cb172c9e947 ("swiotlb: fail map correctly with failed io_tlb_default_mem")
metadata: git_ref: master git_repo: https://gitlab.com/Linaro/lkft/mirrors/next/linux-next git_sha: 4662b7adea50bb62e993a67f611f3be625d3df0d git_describe: next-20220713 kernel_version: 5.19.0-rc6 kernel-config: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO/config build-url: https://gitlab.com/Linaro/lkft/mirrors/next/linux-next/-/pipelines/586982028 artifact-location: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO vmlinux.xz: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO/vmlinux.xz System.map: https://builds.tuxbuild.com/2BtFIR2DegCrbRCCTSZF93YVeiO/System.map toolchain: gcc-11
Here is the boot log output from arm64 juno-r2 device.
[ 0.000000] Booting Linux on physical CPU 0x0000000100 [0x410fd033] [ 0.000000] Linux version 5.19.0-rc6-next-20220713 (tuxmake@tuxmake) (aarch64-linux-gnu-gcc (Debian 11.3.0-3) 11.3.0, GNU ld (GNU Binutils for Debian) 2.38) #1 SMP PREEMPT @1657717522 [ 0.000000] Machine model: ARM Juno development board (r2) [ 0.000000] earlycon: pl11 at MMIO 0x000000007ff80000 (options '') [ 0.000000] printk: bootconsole [pl11] enabled [ 0.000000] efi: UEFI not found. [ 0.000000] NUMA: No NUMA configuration found [ 0.000000] NUMA: Faking a node at [mem 0x0000000080000000-0x00000009ffffffff] [ 0.000000] NUMA: NODE_DATA [mem 0x9fefd1b40-0x9fefd3fff] [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000080000000-0x00000000ffffffff] [ 0.000000] DMA32 empty [ 0.000000] Normal [mem 0x0000000100000000-0x00000009ffffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000080000000-0x00000000feffffff] [ 0.000000] node 0: [mem 0x0000000880000000-0x00000009ffffffff] [ 0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000009ffffffff] [ 0.000000] On node 0, zone Normal: 4096 pages in unavailable ranges [ 0.000000] cma: Reserved 32 MiB at 0x00000000fd000000 [ 0.000000] psci: probing for conduit method from DT. [ 0.000000] psci: PSCIv1.1 detected in firmware. [ 0.000000] psci: Using standard PSCI v0.2 function IDs [ 0.000000] psci: Trusted OS migration not required [ 0.000000] psci: SMC Calling Convention v1.0 [ 0.000000] percpu: Embedded 30 pages/cpu s82856 r8192 d31832 u122880 [ 0.000000] Detected VIPT I-cache on CPU0 [ 0.000000] CPU features: detected: ARM erratum 843419 [ 0.000000] CPU features: detected: ARM erratum 845719 [ 0.000000] Fallback order for Node 0: 0 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 2060288 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: console=ttyAMA0,115200n8 root=/dev/nfs rw nfsroot=10.66.16.120:/var/lib/lava/dispatcher/tmp/5283518/extract-nfsrootfs-ulkeoqdy,tcp,hard,vers=3,wsize=65536 earlycon=pl011,0x7ff80000 console_msg_format=syslog earlycon default_hugepagesz=2M hugepages=256 sky2.mac_address=0x00,0x02,0xF7,0x00,0x68,0x51 ip=dhcp <6>[ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) <6>[ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) <6>[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off <0>[ 0.000000] Kernel panic - not syncing: swiotlb_init_remap: nslabs = 0 too small <4>[ 0.000000] CPU: 0 PID: 0 Comm: swapper Not tainted 5.19.0-rc6-next-20220713 #1 <4>[ 0.000000] Hardware name: ARM Juno development board (r2) (DT) <4>[ 0.000000] Call trace: <4>[ 0.000000] dump_backtrace+0xe8/0x130 <4>[ 0.000000] show_stack+0x24/0x60 <4>[ 0.000000] dump_stack_lvl+0x8c/0xb8 <4>[ 0.000000] dump_stack+0x18/0x34 <4>[ 0.000000] panic+0x188/0x38c <4>[ 0.000000] swiotlb_init_remap+0x50/0x54 <4>[ 0.000000] swiotlb_init+0x20/0x2c <4>[ 0.000000] mem_init+0x38/0x48 <4>[ 0.000000] start_kernel+0x448/0x738 <4>[ 0.000000] __primary_switched+0xb8/0xc0 <0>[ 0.000000] ---[ end Kernel panic - not syncing: swiotlb_init_remap: nslabs = 0 too small ]---
Full test log link, [1] https://lkft.validation.linaro.org/scheduler/job/5283518#L582
Best regards Naresh Kamboju
-- Linaro LKFT https://lkft.linaro.org
Hi Christoph and Anshuman,
On Thu, 14 Jul 2022 at 13:52, Christoph Hellwig hch@lst.de wrote:
On Thu, Jul 14, 2022 at 01:50:02PM +0530, Anshuman Khandual wrote:
26ffb91fa5e0fb282e8 ("swiotlb: split up the global swiotlb lock")
This has been replace with 20347fca71a387a3751f7bb270062616ddc5317a that should fix the issue.
Thanks for your inputs. As per your suggestion, I have reverted those two patches on Linux next tree and built for arm64 and the boot test successfully.
467f49f87d84 Revert "swiotlb: split up the global swiotlb lock" 2706e93f7f8a Revert "swiotlb: fail map correctly with failed io_tlb_default_mem"
Boot pass log link, https://lkft.validation.linaro.org/scheduler/job/5284375#L583
Best Regards Naresh Kamboju
-- Linaro LKFT https://lkft.linaro.org
-
Anshuman Khandual -
Christoph Hellwig -
Naresh Kamboju