On 12 June 2012 23:19, Alexander Sack asac@linaro.org wrote:

On Tue, Jun 12, 2012 at 7:43 PM, Zach Pfeffer zach.pfeffer@linaro.org wrote:

...

On 12 June 2012 12:32, Alexander Sack asac@linaro.org wrote:

...

Hi,

I am very happy to see all those monkeyrunner tests to suddenly show up on the panda side. Thanks for everybody who worked on making those happen!

Aye. Well done team.

...

https://android-build.linaro.org/builds/~linaro-android/panda-ics-gcc47-tilt...

...

...

Now I am curious if and how we can get a description on what they do? What's the idea?

Thanks to TianHong for developing initial tests and Yong Qin for adding monkeyrunner support. We still need to refine the tests . Currently only the monkeyrunner is being run to drive the applications. I think the pass/fail is being decided on on the success/failure of monkeyrunner.

The current results are not showing the reality. Few of the tests in the current list are not compatible with what LAVA expects(some places there are hardcoded paths in the monkeyrunner script) . These need to be cleaned up.

Second phase to be done is we should compare the images captured by monkeyrunner with the expected result to decide whether the tests actually passed or failed.

...

...

I felt that having them documented on our https://wiki.linaro.org/Platform/QA/TestCases/Android page in a new "automation" section would be one option to keep all our tests documented in a single place. Other ideas?

Maybe we should output the documentation from the script - that way it'll live with the script.

I think thats a fantastic idea. We could dump a .wiki style file that we can auto upload to wiki.linaro.org :).

-- Alexander Sack Technical Director, Linaro Platform Teams http://www.linaro.org | Open source software for ARM SoCs http://twitter.com/#%21/linaroorg - http://www.linaro.org/linaro-blog

---

linaro-android mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android