Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting with Linux next-20250312 and persisting through next-20250319.
First seen on the next-20250312 Good: next-20250311 Bad: next-20250312 .. next-20250319
Regressions found on FVP: - boot
Regression Analysis: - New regression? Yes - Reproducible? Yes
Boot regression: Fast model boot failure with Linux next-20250312 Reported-by: Linux Kernel Functional Testing lkft@linaro.org
Anders bisected this to this commit id,
# first bad commit: [858c7bfcb35e1100b58bb63c9f562d86e09418d9] arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
NOTE: LKFT is currently running FVP Fast Models version 11.24. Planned upgrade to the Fast Models version 11.28 in this sprint.
## Boot log <No crash log on the console>
## Source * Kernel version: 6.14.0-rc7 * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6 * Git describe: next-20250319 * Project details: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319 * DUT: arm64 Fast Model (FVP-AEMvA) * Toolchains: gcc-13 and clang-20
## Build * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes... * Build history: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes... * Build details: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes... * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho... * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
-- Linaro LKFT https://lkft.linaro.org
On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote:
Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting with Linux next-20250312 and persisting through next-20250319.
First seen on the next-20250312 Good: next-20250311 Bad: next-20250312 .. next-20250319
Regressions found on FVP:
- boot
Regression Analysis:
- New regression? Yes
- Reproducible? Yes
Boot regression: Fast model boot failure with Linux next-20250312 Reported-by: Linux Kernel Functional Testing lkft@linaro.org
Anders bisected this to this commit id,
# first bad commit: [858c7bfcb35e1100b58bb63c9f562d86e09418d9] arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
NOTE: LKFT is currently running FVP Fast Models version 11.24. Planned upgrade to the Fast Models version 11.28 in this sprint.
What firmware (and version therof) are you running within the model?
For example, if the EL3 firmware lacks support for FEAT_FGT2 or FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die.
It would be really helpful if you could capture that in the report in future.
Mark.
## Boot log
<No crash log on the console>
## Source
- Kernel version: 6.14.0-rc7
- Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
- Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
- Git describe: next-20250319
- Project details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
- DUT: arm64 Fast Model (FVP-AEMvA)
- Toolchains: gcc-13 and clang-20
## Build
- Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build history:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
- Kernel config:
https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
-- Linaro LKFT https://lkft.linaro.org
On Wed, 19 Mar 2025 at 20:25, Mark Rutland mark.rutland@arm.com wrote:
On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote:
Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting with Linux next-20250312 and persisting through next-20250319.
First seen on the next-20250312 Good: next-20250311 Bad: next-20250312 .. next-20250319
Regressions found on FVP:
- boot
Regression Analysis:
- New regression? Yes
- Reproducible? Yes
Boot regression: Fast model boot failure with Linux next-20250312 Reported-by: Linux Kernel Functional Testing lkft@linaro.org
Anders bisected this to this commit id,
# first bad commit: [858c7bfcb35e1100b58bb63c9f562d86e09418d9] arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
NOTE: LKFT is currently running FVP Fast Models version 11.24. Planned upgrade to the Fast Models version 11.28 in this sprint.
What firmware (and version therof) are you running within the model?
Fast Models [11.24.11 (Nov 29 2023)] Booting Trusted Firmware BL1: v2.9(release):v2.9.0 BL2: v2.9(release):v2.9.0 BL31: v2.9(release):v2.9.0 UEFI firmware (version built at 22:31:25 on May 26 2023) UEFI v2.70 (EDK II, 0x00010000)
We need to update the firmware version at our end.
For example, if the EL3 firmware lacks support for FEAT_FGT2 or FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die.
It would be really helpful if you could capture that in the report in future.
Mark.
## Boot log
<No crash log on the console>
## Source
- Kernel version: 6.14.0-rc7
- Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
- Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
- Git describe: next-20250319
- Project details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
- DUT: arm64 Fast Model (FVP-AEMvA)
- Toolchains: gcc-13 and clang-20
## Build
- Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build history:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
- Kernel config:
https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
-- Linaro LKFT https://lkft.linaro.org
- Naresh
On Thu, 20 Mar 2025 16:03:32 +0530 Naresh Kamboju naresh.kamboju@linaro.org wrote:
Hi,
On Wed, 19 Mar 2025 at 20:25, Mark Rutland mark.rutland@arm.com wrote:
On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote:
Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting with Linux next-20250312 and persisting through next-20250319.
First seen on the next-20250312 Good: next-20250311 Bad: next-20250312 .. next-20250319
Regressions found on FVP:
- boot
Regression Analysis:
- New regression? Yes
- Reproducible? Yes
Boot regression: Fast model boot failure with Linux next-20250312 Reported-by: Linux Kernel Functional Testing lkft@linaro.org
Anders bisected this to this commit id,
# first bad commit: [858c7bfcb35e1100b58bb63c9f562d86e09418d9] arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
NOTE: LKFT is currently running FVP Fast Models version 11.24. Planned upgrade to the Fast Models version 11.28 in this sprint.
What firmware (and version therof) are you running within the model?
Fast Models [11.24.11 (Nov 29 2023)] Booting Trusted Firmware BL1: v2.9(release):v2.9.0 BL2: v2.9(release):v2.9.0 BL31: v2.9(release):v2.9.0 UEFI firmware (version built at 22:31:25 on May 26 2023) UEFI v2.70 (EDK II, 0x00010000)
We need to update the firmware version at our end.
Oh yes, please, v2.9.0 is quite old by now, especially for a moving target like the FVP, and when enabling new architecture features. FWIW, after Anshuman pointed me the problem, I made a patch for TF-A to enable PMUv3p9: https://review.trustedfirmware.org/c/TF-A/trusted-firmware-a/+/35884 You would need that for this Linux commit here to work. FEAT_FGT2 should be enabled already by default for the FVP.
Please feel free to leave a comment at the TF-A gerrit, stating that you need the patch, that should accelerate the upstream process.
Cheers, Andre
For example, if the EL3 firmware lacks support for FEAT_FGT2 or FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die.
It would be really helpful if you could capture that in the report in future.
Mark.
## Boot log
<No crash log on the console>
## Source
- Kernel version: 6.14.0-rc7
- Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
- Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
- Git describe: next-20250319
- Project details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
- DUT: arm64 Fast Model (FVP-AEMvA)
- Toolchains: gcc-13 and clang-20
## Build
- Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build history:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/tes...
- Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
- Kernel config:
https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyho...
-- Linaro LKFT https://lkft.linaro.org
- Naresh
-
Andre Przywara -
Mark Rutland -
Naresh Kamboju