Hi,
We have only 43 (or 42 depending on your timezone) days until the Linaro final release [1] and as we get closer, the need for more structured testing is essential. An idea that has been incubating for some time is to have a weekly 'test day' where individuals can spend a couple of hours downloading, installing and testing a Linaro image on their hardware. Which image(s) you can test will obviously depend on the hardware available but currently we produce:
* OMAP3 Headless * OMAP3 ALIP * OMAP3 Plasma Handset * OMAP3 EFL Netbook * Versatile Express Headless * UX500 Headless
and in conjunction with a hardware pack from:
* OMAP4 Headless * iMX51 Headless * OMAP3 X11 Base
Starting this Thursday (30th) I propose that each and every Thursday leading up to the final release is a 'Linaro Image Test Day'. If you have any of this hardware available, please spend a little time testing and reporting bugs. As an experiment, we will be setting up the Linaro qatracker each Thursday morning, UTC, with the information for that days images. If you find it useful, please report your testing results at:
For information on how to install the images on your hardware please take a look at:
http://wiki.linaro.org/Source/ImageInstallation
Regards, Jamie. -- Linaro Release Manager
Great initiative!
On Mon, Sep 27, 2010 at 09:56:10PM +0100, Jamie Bennett wrote:
- OMAP3 Headless
- OMAP3 ALIP
- OMAP3 Plasma Handset
- OMAP3 EFL Netbook
- Versatile Express Headless
- UX500 Headless
and in conjunction with a hardware pack from:
- OMAP4 Headless
- iMX51 Headless
- OMAP3 X11 Base
Does the OMAP3 version support the IGEPv2?
Maybe you want to actually list the boards we intend to support, as OMAP3 and iMX51 are available in a few different incarnations, and not all of them are known to work, right?
Could we register people that are willing to test in a wikipage and have a synchronization meeting on #linaro at the end of the UTC day where we tally up results?
On 27 Sep 2010, at 23:12, Christian Robottom Reis kiko@linaro.org wrote:
Great initiative!
On Mon, Sep 27, 2010 at 09:56:10PM +0100, Jamie Bennett wrote:
- OMAP3 Headless
- OMAP3 ALIP
- OMAP3 Plasma Handset
- OMAP3 EFL Netbook
- Versatile Express Headless
- UX500 Headless
and in conjunction with a hardware pack from:
- OMAP4 Headless
- iMX51 Headless
- OMAP3 X11 Base
Does the OMAP3 version support the IGEPv2?
Yes.
Maybe you want to actually list the boards we intend to support, as OMAP3 and iMX51 are available in a few different incarnations, and not all of them are known to work, right?
Good idea, I'll capture this information on a wiki page and post back the URL when it's done.
Could we register people that are willing to test in a wikipage and have a synchronization meeting on #linaro at the end of the UTC day where we tally up results?
I'll add that to the wiki page too.
Christian Robottom Reis
Regards, Jamie.
On Mon, Sep 27, 2010 at 07:12:28PM -0300, Christian Robottom Reis wrote:
Great initiative!
On Mon, Sep 27, 2010 at 09:56:10PM +0100, Jamie Bennett wrote:
- OMAP3 Headless
- OMAP3 ALIP
- OMAP3 Plasma Handset
- OMAP3 EFL Netbook
- Versatile Express Headless
- UX500 Headless
and in conjunction with a hardware pack from:
- OMAP4 Headless
- iMX51 Headless
- OMAP3 X11 Base
Does the OMAP3 version support the IGEPv2?
Maybe you want to actually list the boards we intend to support, as OMAP3 and iMX51 are available in a few different incarnations, and not all of them are known to work, right?
Could we register people that are willing to test in a wikipage and have a synchronization meeting on #linaro at the end of the UTC day where we tally up results?
OK, I put together:
http://wiki.linaro.org/Process/ReleaseTesting
As we are starting to produce a number of images now, I've split them up into two categories, 'Primary' and 'Secondary'. Of course it would be nice if all images were tested but if we can get through the Primary ones each week that would be great.
I encourage anyone who has hardware to join in testing this Thursday (and subsequent Thursdays) and add your name to the page listed above.
As a side note, test cases still need to be written for a number of architectures and images. Currently we only have Headless OMAP and Headless Versatile Express. If you can contribute by adding a test case wiki page that would be awesome.
Christian Robottom Reis | [+55] 16 9112 6430 | http://launchpad.net/~kiko
Regards, Jamie.
On Tue, Sep 28, 2010 at 11:28:26AM +0100, Jamie Bennett wrote:
OK, I put together:
http://wiki.linaro.org/Process/ReleaseTesting
As we are starting to produce a number of images now, I've split them up into two categories, 'Primary' and 'Secondary'. Of course it would be nice if all images were tested but if we can get through the Primary ones each week that would be great.
Awesome; I've added myself (and done some minor wiki reshuffling in the process) and will be around this Thursday to sync up.
Could we add some links to either that page or https://wiki.linaro.org/Releases/1011/WeeklyTesting that explain how testing is supposed to be carried out?
As a side note, test cases still need to be written for a number of architectures and images. Currently we only have Headless OMAP and Headless Versatile Express. If you can contribute by adding a test case wiki page that would be awesome.
Sure. Are those supposed to be kept under /Boards? Having links to those is also a good idea.
On Tue, Sep 28, 2010 at 06:50:03PM -0300, Christian Robottom Reis wrote:
On Tue, Sep 28, 2010 at 11:28:26AM +0100, Jamie Bennett wrote:
OK, I put together:
http://wiki.linaro.org/Process/ReleaseTesting
As we are starting to produce a number of images now, I've split them up into two categories, 'Primary' and 'Secondary'. Of course it would be nice if all images were tested but if we can get through the Primary ones each week that would be great.
Awesome; I've added myself (and done some minor wiki reshuffling in the process) and will be around this Thursday to sync up.
Could we add some links to either that page or https://wiki.linaro.org/Releases/1011/WeeklyTesting that explain how testing is supposed to be carried out?
I've added a few links to the Process/ReleaseTesting page which should help explaining how to test the images.
As a side note, test cases still need to be written for a number of architectures and images. Currently we only have Headless OMAP and Headless Versatile Express. If you can contribute by adding a test case wiki page that would be awesome.
Sure. Are those supposed to be kept under /Boards? Having links to those is also a good idea.
Currently they reside under Platform/QA/TestCases, whether this is the best place for them is another matter. One could argue that they belong under /Boards, /Bugs, /Process or where they are now, I'm not of a strong opinion for a particular one and I'm open to them being moved.
Christian Robottom Reis | [+55] 16 9112 6430 | http://launchpad.net/~kiko
Regards, Jamie.
On Wed, Sep 29, 2010 at 3:53 PM, Jamie Bennett jamie.bennett@linaro.org wrote:
On Tue, Sep 28, 2010 at 06:50:03PM -0300, Christian Robottom Reis wrote:
On Tue, Sep 28, 2010 at 11:28:26AM +0100, Jamie Bennett wrote:
OK, I put together:
Could we add some links to either that page or https://wiki.linaro.org/Releases/1011/WeeklyTesting that explain how testing is supposed to be carried out?
I've added a few links to the Process/ReleaseTesting page which should help explaining how to test the images.
Great guide on https://wiki.linaro.org/Releases/DailyBuilds. But I can not find image like linaro-headless-imx51 on http://snapshots.linaro.org/10.11-daily/ to start testing on imx51.
If you read the guide, especially the hardware pack section, you should get an idea of what to do. You need to grab the headless image from snapshots.linaro.org and combine it with the imx hardware pack from jameswestby.net to produce an image for your board. The instructions on how to do this are on the page you mentioned.
If you have any problems doing this please get back in contact and I'll help you through it.
Regards, Jamie On 6 Oct 2010 03:08, "Shawn Guo" shawn.gsc@gmail.com wrote:
On Wed, Sep 29, 2010 at 3:53 PM, Jamie Bennett jamie.bennett@linaro.org
wrote:
On Tue, Sep 28, 2010 at 06:50:03PM -0300, Christian Robottom Reis wrote:
On Tue, Sep 28, 2010 at 11:28:26AM +0100, Jamie Bennett wrote:
OK, I put together:
Could we add some links to either that page or https://wiki.linaro.org/Releases/1011/WeeklyTesting that explain how testing is supposed to be carried out?
I've added a few links to the Process/ReleaseTesting page which should help explaining how to test the images.
Great guide on https://wiki.linaro.org/Releases/DailyBuilds. But I can not find image like linaro-headless-imx51 on http://snapshots.linaro.org/10.11-daily/ to start testing on imx51.
-- Regards, Shawn
On Wed, Oct 6, 2010 at 3:04 PM, Jamie Bennett jamie.bennett@linaro.org wrote:
If you read the guide, especially the hardware pack section, you should get an idea of what to do. You need to grab the headless image from snapshots.linaro.org and combine it with the imx hardware pack from jameswestby.net to produce an image for your board. The instructions on how to do this are on the page you mentioned.
If you have any problems doing this please get back in contact and I'll help you through it.
Actually, I do not have problem to set up imx51 image for myself, since I'm building rootfs from lh build with some changes on the headless config. But I think a pre-built linaro-headless-imx51 should be more straight-forward for people on imx51 to go, and better for everyone testing imx51 on the same page. (Just a thought)
On 6 Oct 2010, at 10:19, Shawn Guo wrote:
On Wed, Oct 6, 2010 at 3:04 PM, Jamie Bennett jamie.bennett@linaro.org wrote:
If you read the guide, especially the hardware pack section, you should get an idea of what to do. You need to grab the headless image from snapshots.linaro.org and combine it with the imx hardware pack from jameswestby.net to produce an image for your board. The instructions on how to do this are on the page you mentioned.
If you have any problems doing this please get back in contact and I'll help you through it.
Actually, I do not have problem to set up imx51 image for myself, since I'm building rootfs from lh build with some changes on the headless config. But I think a pre-built linaro-headless-imx51 should be more straight-forward for people on imx51 to go, and better for everyone testing imx51 on the same page. (Just a thought)
Your right, it would be easier. The problem lies with the number of platforms we support and the number of 'flavours' we produce. Lets take a look. Currently we have support in some shape or form for:
Beagle Board C3/4 IGEPv2 (slight customisation due to wireless driver) Beagle XM ARM Versatile Express Samsung Ux500 iMX51
We also have these flavours: Headless Netbook ALIP Plasma
So if we were to release pre-built images for each board with each flavour, we would need to produce a staggering 24 image and this number is only going to rise. Having a tool to take one board specific part and combine it with one flavour is the most future-proof way of making images.
-- Regards, Shawn
Regards, Jamie.
On Tue, Sep 28, 2010 at 6:28 PM, Jamie Bennett jamie.bennett@linaro.org wrote:
As we are starting to produce a number of images now, I've split them up into two categories, 'Primary' and 'Secondary'. Of course it would be nice if all images were tested but if we can get through the Primary ones each week that would be great.
I encourage anyone who has hardware to join in testing this Thursday (and subsequent Thursdays) and add your name to the page listed above.
I have i.mx51 board (Babbage 3.0) on hands to contribute. I can not edit the wiki page. Maybe you can put my name on i.MX51 row.
As a side note, test cases still need to be written for a number of architectures and images. Currently we only have Headless OMAP and Headless Versatile Express. If you can contribute by adding a test case wiki page that would be awesome.
My problem is l-m-c has not support i.MX51 yet, though I sent the patch to Alexander.
Could we add some links to either that page or https://wiki.linaro.org/Releases/1011/WeeklyTesting that explain how testing is supposed to be carried out?
This will be helpful especially for someone new like me.
On Sep 29, 2010, at 09:56, Shawn Guo wrote:
On Tue, Sep 28, 2010 at 6:28 PM, Jamie Bennett jamie.bennett@linaro.org wrote:
As we are starting to produce a number of images now, I've split them up into two categories, 'Primary' and 'Secondary'. Of course it would be nice if all images were tested but if we can get through the Primary ones each week that would be great.
I encourage anyone who has hardware to join in testing this Thursday (and subsequent Thursdays) and add your name to the page listed above.
I've added myself to the wiki. I'll try and test on my Beagle C4.
Is there an IRC channel too?
I also received a Tegra 2 at DebConf which I'd like to use to test Linaro on. I'll add that to the wiki eventually but I have a couple releases the coming weeks so it may be better for me to wait for the next release testing Thursday run. :-)
Could we add some links to either that page or https://wiki.linaro.org/Releases/1011/WeeklyTesting that explain how testing is supposed to be carried out?
This will be helpful especially for someone new like me.
For me as well. I assume it is a wiki since that might be a good way to get feedback on the install / testing process.
Warm regards,
Jeremiah
On Thu, Sep 30, 2010, Jeremiah Foster wrote:
Is there an IRC channel too?
Yup, #linaro on freenode
I also received a Tegra 2 at DebConf which I'd like to use to test Linaro on. I'll add that to the wiki eventually but I have a couple releases the coming weeks so it may be better for me to wait for the next release testing Thursday run. :-)
Ah, we don't have kernels for that one, nor does the image writing script support this target board; I'm not sure what it expects for boot media?
On Wed, Sep 29, 2010 at 03:56:50PM +0800, Shawn Guo wrote:
I have i.mx51 board (Babbage 3.0) on hands to contribute. I can not edit the wiki page.
Hmm. Do you have a Launchpad account? If so, you can just log in to the wiki and edit that page.
On Mon, Sep 27, 2010 at 3:56 PM, Jamie Bennett jamie.bennett@linaro.orgwrote:
Hi,
We have only 43 (or 42 depending on your timezone) days until the Linaro final release [1] and as we get closer, the need for more structured testing is essential. An idea that has been incubating for some time is to have a weekly 'test day' where individuals can spend a couple of hours downloading, installing and testing a Linaro image on their hardware. Which image(s) you can test will obviously depend on the hardware available but currently we produce:
- OMAP3 Headless
- OMAP3 ALIP
- OMAP3 Plasma Handset
- OMAP3 EFL Netbook
- Versatile Express Headless
- UX500 Headless
I will work on getting testcases written up on the wiki for this similar to
what is at https://wiki.linaro.org/Platform/QA/TestCases/HeadlessOMAP before this Thursday. I we currently have OMAP3 Headless and VExpress Headless written up, and John Rigby has agreed to help me get a Ux500 version written since he has a board. Anyone who has knowledge of the other images, I welcome your input in writing up test instructions for them.
Thanks, Paul Larson
Sounds great!
I'll certainly volunteer for the ALIP side of things as well helping out with Beagle and Beagle XM.
I have some very very simple unit tests identified for ALIP at: https://wiki.linaro.org/Platform/UserPlatforms/Heads/ALIP
Regards, Tom
"We want great men who, when fortune frowns will not be discouraged." - Colonel Henry Knox w) tom.gall att linaro.org w) tom_gall att vnet.ibm.com h) tom_gall att mac.com
On Sep 27, 2010, at 5:23 PM, Paul Larson wrote:
On Mon, Sep 27, 2010 at 3:56 PM, Jamie Bennett jamie.bennett@linaro.org wrote: Hi,
We have only 43 (or 42 depending on your timezone) days until the Linaro final release [1] and as we get closer, the need for more structured testing is essential. An idea that has been incubating for some time is to have a weekly 'test day' where individuals can spend a couple of hours downloading, installing and testing a Linaro image on their hardware. Which image(s) you can test will obviously depend on the hardware available but currently we produce:
- OMAP3 Headless
- OMAP3 ALIP
- OMAP3 Plasma Handset
- OMAP3 EFL Netbook
- Versatile Express Headless
- UX500 Headless
I will work on getting testcases written up on the wiki for this similar to what is at https://wiki.linaro.org/Platform/QA/TestCases/HeadlessOMAP before this Thursday. I we currently have OMAP3 Headless and VExpress Headless written up, and John Rigby has agreed to help me get a Ux500 version written since he has a board. Anyone who has knowledge of the other images, I welcome your input in writing up test instructions for them.
Thanks, Paul Larson _______________________________________________ linaro-dev mailing list linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-dev
On 10 Sep 27, Jamie Bennett wrote:
Hi,
We have only 43 (or 42 depending on your timezone) days until the Linaro final release [1] and as we get closer, the need for more structured testing is essential. An idea that has been incubating for some time is to have a weekly 'test day' where individuals can spend a couple of hours downloading, installing and testing a Linaro image on their hardware. Which image(s) you can test will obviously depend on the hardware available but currently we produce:
- OMAP3 Headless
- OMAP3 ALIP
- OMAP3 Plasma Handset
- OMAP3 EFL Netbook
- Versatile Express Headless
- UX500 Headless
and in conjunction with a hardware pack from:
- OMAP4 Headless
- iMX51 Headless
- OMAP3 X11 Base
Starting this Thursday (30th) I propose that each and every Thursday leading up to the final release is a 'Linaro Image Test Day'. If you have any of this hardware available, please spend a little time testing and reporting bugs. As an experiment, we will be setting up the Linaro qatracker each Thursday morning, UTC, with the information for that days images. If you find it useful, please report your testing results at:
For information on how to install the images on your hardware please take a look at:
Jamie,
Thanks for this. Some feedback trying to think like an outsider follows:
The instructions are still too confusing - spread out over too many wiki pages and many levels of indirection. e.g. How does one _use_ the hwpack? I can't find anything on the links above. On looking at the cmdline options for 'linaro-media-create' I do find the option. But it isn't too obvious reading the wiki.
IMHO, as we continuously add support for more platforms and even more boards, it will become untenable to maintain these wiki pages. Something similar to 'testdrive' for Ubuntu is required for the next cycle.
Why can't l-m-c ask some basic questions and just DTRT? Questions would be: - What SoC? - What board? - What release (milestone)? - Image type (headless, alip, qemu, etc.)
Each of these would be a multiple choice question. This should get rid of the several levels of indirection required just to download all the right components before trying to prepare an image.
Regards, Amit
On Wed, 2010-09-29 at 15:45 +0300, Amit Kucheria wrote:
IMHO, as we continuously add support for more platforms and even more boards, it will become untenable to maintain these wiki pages. Something similar to 'testdrive' for Ubuntu is required for the next cycle.
Why can't l-m-c ask some basic questions and just DTRT? Questions would be:
- What SoC?
- What board?
- What release (milestone)?
- Image type (headless, alip, qemu, etc.)
Each of these would be a multiple choice question. This should get rid of the several levels of indirection required just to download all the right components before trying to prepare an image.
This would make l-m-c an unmaintainable beast IMHO. It is all about creating the boot media, not acquiring the components needed for this.
However it might not be a bad thing to have a separate script that asks those questions and just downloads the components, particularly if that script could be data driven and easy to maintain.
Scott
On Wed, Sep 29, 2010 at 5:14 PM, Scott Bambrough scott.bambrough@linaro.org wrote:
On Wed, 2010-09-29 at 15:45 +0300, Amit Kucheria wrote:
IMHO, as we continuously add support for more platforms and even more boards, it will become untenable to maintain these wiki pages. Something similar to 'testdrive' for Ubuntu is required for the next cycle.
Why can't l-m-c ask some basic questions and just DTRT? Questions would be: - What SoC? - What board? - What release (milestone)? - Image type (headless, alip, qemu, etc.)
Each of these would be a multiple choice question. This should get rid of the several levels of indirection required just to download all the right components before trying to prepare an image.
This would make l-m-c an unmaintainable beast IMHO. It is all about creating the boot media, not acquiring the components needed for this.
Agreed, it should be a separate script. Something like 'testdrive' that is the 'UI' that downloads the components, creates the qemu image, etc.
However it might not be a bad thing to have a separate script that asks those questions and just downloads the components, particularly if that script could be data driven and easy to maintain.
It should be easily data driven. That datafile could contain all of the information required for the questions above.
And with the right packaging, upgrades to linaro-testdrive will continually add support for new platforms and boards.
Regards, Amit
On Wed, 29 Sep 2010 17:27:48 +0300, Amit Kucheria amit.kucheria@linaro.org wrote:
And with the right packaging, upgrades to linaro-testdrive will continually add support for new platforms and boards.
That will require some changes to l-m-c as well, to allow us to specify board customisations, rather than hardcoding them.
Thanks,
James
Dnia poniedziałek, 27 września 2010 o 22:56:10 Jamie Bennett napisał(a):
As an experiment, we will be setting up the Linaro qatracker each Thursday morning, UTC, with the information for that days images. If you find it useful, please report your testing results at:
Would be nicer if system would send mails after registration.
Regards,
Dnia czwartek, 30 września 2010 o 15:15:43 Marcin Juszkiewicz napisał(a):
Would be nicer if system would send mails after registration.
Got email, filled report against headless on beagleboard C3.
Regards,
-
Amit Kucheria -
Christian Robottom Reis -
James Westby -
Jamie Bennett -
Jeremiah Foster -
Loïc Minier -
Marcin Juszkiewicz -
Marcin Juszkiewicz -
Paul Larson -
Scott Bambrough -
Shawn Guo -
Tom Gall