# My apology if this kind of discussion is not appropriate in this ML.
On Tue, Apr 09, 2019 at 04:20:48PM +0100, Yang Zhang wrote:
On Tue, 9 Apr 2019 at 16:18, Udit Kumar udit.kumar@nxp.com wrote:
Thanks for information AKASHI
IMO for EBBR, we need to define subset of test-cases, which are required in EBBR specs.
+1
Since I have been away from SCT long time, I almost forgot details of how SCT runs but at the first glance, it would be quite simple and straightforward as SCT already has a feature to run only a specific list of test cases (through TestCase.ini file).
* create a list of test cases (TestCase.ini is automatically generated by SCT if we want to run all.) * check/mark only interested cases (There are always two types of tests: conformance and function.) * run SCT with this list
The issue would be who maintain this list and where :) and I don't know that the 'granularity' of each test case would fit well for our subset.
I expect some fail in u-boot. Also need to find a better way to build uefi-sct
+1
I used pre-built binary of SCT.
-Takahiro Akashi
Regards Udit
-----Original Message----- From: AKASHI Takahiro takahiro.akashi@linaro.org Sent: Tuesday, April 9, 2019 10:53 AM To: Grant Likely Grant.Likely@arm.com Cc: Udit Kumar udit.kumar@nxp.com; Dong Wei Dong.Wei@arm.com; Eric FINCO eric.finco@st.com; Robert Oshana robert.oshana@nxp.com; Tony Wu tonywu@realtek.com; boot-architecture@lists.linaro.org; arm.ebbr- discuss arm.ebbr-discuss@arm.com; LEDGE SC ledge-sc@linaro.org;
Varis,
Pekka p-varis@ti.com; nd nd@arm.com Subject: [EXT] Re: EBBR SC meeting on-site at Connect
WARNING: This email was created outside of NXP. DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
On Sat, Apr 06, 2019 at 07:42:46PM +0000, Grant Likely wrote:
Hi Udit,
We talked about testing. We generally agreed that UEFI-SCT is important, even though it is limited. LuvOS (which includes UEFI-SCT) is a good candidate to do more complete testing, and we also talked about getting UEFI test cases into the U-Boot CI testing.
Just FYI, it was last July that I ran UEFI SCT with U-Boot on qemu. Here is a summary of the result:
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.goo
gle.com%2Fspreadsheets%2Fd%2F17e45yojM2nLdRovx0gcgHIAmvv9b_yc9iIUjZ 2LY22c%2Fedit%3Fusp%3Dsharing&data=02%7C01%7Cudit.kumar%40nxp. com%7Cc5b24ae4bd26466e1a7008d6bcab1c5c%7C686ea1d3bc2b4c6fa92cd99 c5c301635%7C0%7C0%7C636903840436702643&sdata=00NOqcpsKPi8DkJ u8y%2F7mLqSI8qQGFSGqzBhbpo3bbE%3D&reserved=0 (Please note that this is not for public review, but just informative.)
In my experience, I saw lots of failure cases (some or most of them are
trivial
and can be duplicated ones though), and running through all the test
cases took
a whole week. This is partly because SCT crashes occasionally and I
needed to
restart it next morning :)
So I'm not sure that U-Boot UEFI is ready for automated testing with SCT. (We made lots of improvements recently, but I have had no time to re-run
SCT
these days. Give me a fast machine :)
-Takahiro Akashi
Linaro LEDGE is looking at adding U-Boot testing to their backlog, but they don't have any engineering resources who can be assigned to the work right now. I'm also going to try and resource this from Arm.
g.
On 04/04/2019 16:08, Udit Kumar wrote:
Hi Grant
>- other business
See, if you can add compliance test suits for EBBR, or subset of UEFI-SCT is enough ?
Regards
Udit
*From:* arm.ebbr-discuss-bounces@arm.com arm.ebbr-discuss-bounces@arm.com *On Behalf Of *Grant Likely *Sent:* Wednesday, April 3, 2019 12:49 PM *To:* Dong Wei Dong.Wei@arm.com; Eric FINCO eric.finco@st.com; Robert Oshana robert.oshana@nxp.com; Tony Wu
boot-architecture@lists.linaro.org; arm.ebbr-discuss arm.ebbr-discuss@arm.com; LEDGE SC ledge-sc@linaro.org; Varis, Pekka p-varis@ti.com *Subject:* Re: [Arm.ebbr-discuss] EBBR SC meeting on-site at Connect
Agenda for today:
EBBR v1.0 released (yay!)
goals for v1.1 or v2.0
other issues
secure world interfaces
non-block storage
identification of protected blocks
other business
Grant Likely
Sr. Technical Director SW Engineering
*From:*Grant Likely *Sent:* Wednesday, April 3, 2019 1:49:23 PM *To:* Dong Wei; Eric FINCO; robert.oshana@nxp.com; Tony Wu; boot-architecture@lists.linaro.org; arm.ebbr-discuss; LEDGE SC; Varis, Pekka *Subject:* Re: EBBR SC meeting on-site at Connect
details for those who had trouble with the calendar invite:
Room: Lotus 5-6
Time: 5:00pm
Sorry for those of you who aren’t here. I’m not going to have a dial in, but I’ll take good notes.
g.
boot-architecture mailing list boot-architecture@lists.linaro.org https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flist s.linaro.org%2Fmailman%2Flistinfo%2Fboot-
architecture&data=02%7C01
%7Cudit.kumar%40nxp.com%7Cc5b24ae4bd26466e1a7008d6bcab1c5c%7C686 ea1d3b
c2b4c6fa92cd99c5c301635%7C0%7C0%7C636903840436702643&sdata=F Rd8%2B
nzRF827ZMG1fYeDwEr90V%2BZHvIHbFiIPAhBFiQ%3D&reserved=0
Arm.ebbr-discuss mailing list Arm.ebbr-discuss@arm.com
boot-architecture@lists.linaro.org
-
AKASHI Takahiro