On 20 June 2012 09:34, Andy Doan andy.doan@linaro.org wrote:
On 06/20/2012 12:01 AM, Fathi Boudra wrote:
cc LAVA mailing list.
On 20 June 2012 06:19, Zach Pfeffer wrote:
Hey Andy,
During our call with ARM (invite on the way), the fact that LAVA has a network dependency came up again.
Could you expand on the network dependency issue? Filing a bug is even better.
We also have an issue with Connectivity Manager testing. Is there anything that can be done in 12.07 (SD mux) to get over this?
I don't think the SD mux will be available or deployed in 12.07, so we have to think about this another way.
I think the "black box" idea we spoke about at Connect might be the path to solve this. For those who weren't at the bar at midnight in Hong Kong: The "black box" idea is a change to how LAVA would run tests. Instead of having the LAVA dispatcher drive everything host side, we'd boot into a test image, let it do stuff, pull files from a know partition, analyze and report results.
Hehe...
If we were to do that, decisions like networking would be completely up to you(the test image). This concept works best with an SD-mux set up. However, it could work with our master images also.
I still worry 12.07 might be a little ambitious for such a fundamental change, but I think we should discuss.
Yeah, that's cool - though I think to hit our benchmark variance numbers and to test things like Connectivity Manager we'll need this. It should help LAVA to because it'll take a failure point out of the system.
Andy, what are you thinking are the big blockers for this with the master image approach?
-andy