On 13 June 2012 22:20, Botao Sun
<botao.sun@linaro.org> wrote:
Hi Zygmunt,
I may can provide some information here.
1. The Connectivity Manager APK has been integrated to all Android images, and you can launch it via command line, which is described on this link:
2. I remember that Yongqin did some experiments before, which proved that this test suite can be run in LAVA, he may would like to give you more details.
I just verified that the wifi and the eth can coexist, so in theory it should be able to run on LAVA.
But when I run the test that time, there are many test errors, not only the test failures.
So we don't know how to prepare the environment to make the test runs well (even with some failures) on lava.
So I suggest that first make this test works well as a test tool on android, then consider to integrate it into lava.
IMO, the integration into lava should be easy to do comparing to making the test itself runs well.
Thanks,
Yongqin Liu
3. Some test functions need to be commented out according to our board feature status, for example, those 3G tests. Otherwise, it will block the rest of tests. To find out which test function should be deleted, you have to look into the code.
4. The source code need to be read carefully and understood well since we need to figure out what every test function does. Some of them may also need to be modified to adapt to our board.
5. Once 3 & 4 finished, then we can integrated this test suite with those test functions we want, and pass the test result to LAVA to display. The test result of this APK is already well-formatted, so it won't be a big deal.
FYI.
Thank you.
BR
Botao Sun
On Wed, Jun 13, 2012 at 11:58 PM, Zygmunt Krynicki
<zygmunt.krynicki@linaro.org> wrote:
Hey everyone.
I'm trying to figure out a way to get connectivity manager tests enabled and pushed to LAVA. I read the code briefly (please correct any misconceptions I may have) and I see a few steps that need to be taken to achieve that.
1) We need to build them into our images. That's the obvious bit. It may be done already, I'm still digging through the code and the build system.
2) We need to script them so that they can execute given the correct environment. This part feels rather simple as there are explicit ADB commands in the comments throughout that code. I will try to build a comprehensive list of tests with notes and update you as I go. Still is should be relatively easy to script the execution
3) We need to work with the LAVA team to prepare a proper environment. So far this seems to be the biggest technical challenge. From my shallow understanding of the code we'd have to setup a few wireless access points with various configurations (or alternate the configuration on a single access point but that seems harder and more error prone) and see if we can get repeatable outcome from those connection tests.
The thing that worries me is the susceptibility to background noise / other transmissions / etc. It seems that most "interesting" tests are related to wireless communication. I wonder what is your opinion on this. Should we just enable all the tests that we technically can and ignore the fact that our test environment is not isolated?
Thanks for the feedback
ZK
--
Zygmunt Krynicki
Linaro Validation Team
s/Validation/Android/
_______________________________________________
linaro-android mailing list
linaro-android@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-android