On 12 June 2012 23:19, Alexander Sack <asac@linaro.org> wrote:
On Tue, Jun 12, 2012 at 7:43 PM, Zach Pfeffer <zach.pfeffer@linaro.org> wrote:
> On 12 June 2012 12:32, Alexander Sack <asac@linaro.org> wrote:
>> Hi,
>>
>> I am very happy to see all those monkeyrunner tests to suddenly show
>> up on the panda side. Thanks for everybody who worked on making those
>> happen!
>
> Aye. Well done team.
>
>> https://android-build.linaro.org/builds/~linaro-android/panda-ics-gcc47-tilt-stable-blob/#build=40
>>
>> Now I am curious if and how we can get a description on what they do?
>> What's the idea?

Thanks to TianHong for developing initial tests and  Yong Qin for adding monkeyrunner support. We still need to refine the tests . Currently only the monkeyrunner is being run to drive the applications. I think the pass/fail is being decided on
on the success/failure of monkeyrunner.

The current results are not showing the reality. Few of the tests in the current list are not compatible with what LAVA expects(some places there are hardcoded paths in the monkeyrunner script) . These need to be cleaned up.

Second phase to be done is we should compare the images captured by monkeyrunner with the expected result to decide whether the tests actually passed or failed.
 

>>
>> I felt that having them documented on our
>> https://wiki.linaro.org/Platform/QA/TestCases/Android page in a new
>> "automation" section would be one option to keep all our tests
>> documented in a single place. Other ideas?
>
> Maybe we should output the documentation from the script - that way
> it'll live with the script.

I think thats a fantastic idea. We could dump a .wiki style file that
we can auto upload to wiki.linaro.org :).

--
Alexander Sack
Technical Director, Linaro Platform Teams
http://www.linaro.org | Open source software for ARM SoCs
http://twitter.com/#!/linaroorg - http://www.linaro.org/linaro-blog

_______________________________________________
linaro-android mailing list
linaro-android@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-android