On Wed, Jun 13, 2012 at 11:16 PM, Zach Pfeffer zach.pfeffer@linaro.org wrote:
On 13 June 2012 08:58, Zygmunt Krynicki zygmunt.krynicki@linaro.org wrote:
Hey everyone.
I'm trying to figure out a way to get connectivity manager tests enabled and pushed to LAVA. I read the code briefly (please correct any misconceptions I may have) and I see a few steps that need to be taken to achieve that.
- We need to build them into our images. That's the obvious bit. It may be
done already, I'm still digging through the code and the build system.
- We need to script them so that they can execute given the correct
environment. This part feels rather simple as there are explicit ADB commands in the comments throughout that code. I will try to build a comprehensive list of tests with notes and update you as I go. Still is should be relatively easy to script the execution
When I looked through the Connectivity Manager tests it looked like we could execute parts of it, so it may be that we need to decompose the test suite a bit, i.e. only execute tests when we have infrastructure for the tests then run those tests manually to see what the infrastructure needs may be.
- We need to work with the LAVA team to prepare a proper environment. So
far this seems to be the biggest technical challenge. From my shallow understanding of the code we'd have to setup a few wireless access points with various configurations (or alternate the configuration on a single access point but that seems harder and more error prone) and see if we can get repeatable outcome from those connection tests.
The thing that worries me is the susceptibility to background noise / other transmissions / etc. It seems that most "interesting" tests are related to wireless communication. I wonder what is your opinion on this. Should we just enable all the tests that we technically can and ignore the fact that our test environment is not isolated?
Yeah, maybe we could mark off a few "wireless test only" LAVA targets.
we can do that. For now let's get things going and once we see real noise problems figure out how to best solve the problem.