That's one possibility, but is 3 enough? We could get into a game where 3, 10, 100 is never enough to catch the problem.  The other obvious thing that jumps out at me here is that reboot and shutdown are tested on the ubuntu side, but not on android.  If we covered both of those, we would already have multiple boots covered.  I would be ok with 3 boots as a reasonable number, but I think it would be even better if we added it implicitly by adding reboot and halt as tests.

Thanks,
Paul Larson

On Tue, May 8, 2012 at 8:32 AM, Zach Pfeffer <zach.pfeffer@linaro.org> wrote:
Paul,

What do you think about adding a condition to the "boots" test that
stipulates that the board needs to boot 3 times?

I was looking at:
https://docs.google.com/a/linaro.org/spreadsheet/ccc?key=0AkxwyUNxNaAadDE1MlJmY19PQzlJOUY5OXk0SWJYT1E#gid=3
and found that the "boots" column should have probably been yellow for
a bit based on bug
https://bugs.launchpad.net/linaro-android/+bug/900681 which I see
again on iMX53.

--
Zach Pfeffer
Android Platform Team Lead, Linaro Platform Teams
Linaro.org | Open source software for ARM SoCs
Follow Linaro: http://www.facebook.com/pages/Linaro
http://twitter.com/#!/linaroorg - http://www.linaro.org/linaro-blog