Hi, Andy Doan & Paul Sokolovsky & Vishal Bhoj & All
Now lava-test-shell is supported by LAVA, and android team is considering adding the support on android-build.
I want to add following 3 interfaces on the android-build,
*1. lava-test-shell-url(url= http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... timeout=59400)* where timeout is optional when submitted, the action in job will be something like this:
{ "command": "lava_test_shell", "parameters": { "testdef_urls": [" http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... "], "timeout": 59400 } }
*2. lava-test-shell-git(repo=git://git.linaro.org/qa/test-definitions.git revision=master testdef=android/binder.yaml timeout=-1) * where revison/testdef/timeout is optional when submitted, the action in job will be something like this: { "command": "lava_test_shell", "parameters": { "testdef_repos": [ { "git-repo": "git:// git.linaro.org/qa/test-definitions.git", "revision": "master", "testdef": "android/binder.yaml" } ], "timeout": -1 } } *3. lava-test-shell-bzr(repo=lp:~terceiro/+junk/lava-dev revision=112 timeout=-1)* where revison/testdef/timeout is optional when submitted, the action in job will be something like this: { "command": "lava_test_shell", "parameters": { "testdef_repos": [ { "bzr-repo": "lp:~terceiro/+junk/lava-dev", "revision": "112", "testdef": "jobs/android-busybox.yaml" } ], "timeout": -1 } }
By these 3 types interface, we can do most of the things lava-test-shell supported. Although we can't specify the array form with one interface one time, we can do the same things by specifying multiple times the interface of the same type. like *lava-test-shell-url(url=url1),**lava-test-shell-url(url=url2),* so I think it's enough for us to use on android-build.
About this, how do you think about that? Please feel free to give your comments. Thanks in advance!
On 02/03/2013 04:37 AM, YongQin Liu wrote:
Hi, Andy Doan & Paul Sokolovsky & Vishal Bhoj & All
Now lava-test-shell is supported by LAVA, and android team is considering adding the support on android-build.
I want to add following 3 interfaces on the android-build,
*1. lava-test-shell-url(url=http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... timeout=59400)*
I'd say this is optional. Do you guys really see a usage for this one?
*2. lava-test-shell-git(repo=git://git.linaro.org/qa/test-definitions.git
This seems like the main one to me. I suspect being android, you'll be keeping all your definitions in git. Git also happens to be the primary place we've been doing our work:
http://git.linaro.org/gitweb?p=ubuntu/test-definitions.git
That repo might be a good place for you to work off of as well.
*3. lava-test-shell-bzr(repo=lp:~terceiro/+junk/lava-dev revision=112 timeout=-1)*
Again, this is optional. I'm not sure you'll have a use case for it in Android.
By these 3 types interface, we can do most of the things lava-test-shell supported. Although we can't specify the array form with one interface one time, we can do the same things by specifying multiple times the interface of the same type.
Some people might *prefer* that :) Joking aside, there has been debate in the past whether or not we should reboot in between each test. This "limitation" would ensure reboots happen and might make Zach and Alexander happier.
like *lava-test-shell-url(url=url1),**lava-test-shell-url(url=url2),* so I think it's enough for us to use on android-build.
About this, how do you think about that? Please feel free to give your comments. Thanks in advance!
I think you are on the right track. I'd suggest just focusing on approach #2 since that's probably the only way you guys are ever going to use this.
Hi, Andy
Thanks for the comment.
On 4 February 2013 02:48, Andy Doan andy.doan@linaro.org wrote:
On 02/03/2013 04:37 AM, YongQin Liu wrote:
Hi, Andy Doan & Paul Sokolovsky & Vishal Bhoj & All
Now lava-test-shell is supported by LAVA, and android team is considering adding the support on android-build.
I want to add following 3 interfaces on the android-build,
*1. lava-test-shell-url(url=http:/**/cbuild.validation.linaro.org:** 80/helpers/scheduler/lava/**testdef/lava-pandaes-usbdrive/** gcc-4.8~bzr121031~christophe-**lyon-vect-cost-modelhttp://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-pandaes-usbdrive/gcc-4.8~bzr121031~christophe-lyon-vect-cost-modeltimeout=59400)*
I'd say this is optional. Do you guys really see a usage for this one?
Yes, in some case this may be an option.
*2. lava-test-shell-git(repo=git:/**/git.linaro.org/qa/test-**definitions.githttp://git.linaro.org/qa/test-definitions.git
This seems like the main one to me. I suspect being android, you'll be keeping all your definitions in git. Git also happens to be the primary place we've been doing our work:
http://git.linaro.org/gitweb?**p=ubuntu/test-definitions.githttp://git.linaro.org/gitweb?p=ubuntu/test-definitions.git
That repo might be a good place for you to work off of as well.
Yes, but seems we'd better to store the android and ubuntu test definition separately. Then we can specify one git url and run all the test there. otherwise seems we need to specify lava-test-shell-git(repo, testdef) for each test.
*3.
lava-test-shell-bzr(repo=lp:~**terceiro/+junk/lava-dev revision=112 timeout=-1)*
Again, this is optional. I'm not sure you'll have a use case for it in Android.
yes, I guess this will be rarely used in the future on android too.
By these 3 types interface, we can do most of the things lava-test-shell
supported. Although we can't specify the array form with one interface one time, we can do the same things by specifying multiple times the interface of the same type.
Some people might *prefer* that :) Joking aside, there has been debate in the past whether or not we should reboot in between each test. This "limitation" would ensure reboots happen and might make Zach and Alexander happier.
I understand what you said here now. For each lava-test-shell action, lava will reboot to master image to install and then reboot to android image to run the test. This may make Zach happier:)
like *lava-test-shell-url(url=url1)**,**lava-test-shell-url(url=**url2),*
so I think it's enough for us to use on android-build.
About this, how do you think about that? Please feel free to give your comments. Thanks in advance!
I think you are on the right track. I'd suggest just focusing on approach #2 since that's probably the only way you guys are ever going to use this.
On 02/06/2013 01:39 AM, YongQin Liu wrote:
*2. lava-test-shell-git(repo=git:/__/git.linaro.org/qa/test-__definitions.git <http://git.linaro.org/qa/test-definitions.git> This seems like the main one to me. I suspect being android, you'll be keeping all your definitions in git. Git also happens to be the primary place we've been doing our work: http://git.linaro.org/gitweb?__p=ubuntu/test-definitions.git <http://git.linaro.org/gitweb?p=ubuntu/test-definitions.git> That repo might be a good place for you to work off of as well.Yes, but seems we'd better to store the android and ubuntu test definition separately.
I think having them in one repository would probably benefit Linaro and our members more. We would then have an official place for all Linaro tests that we could tag each month like "release-13.02".
Additionally some tests, say busybox and bigLITTLE could be done with a single test-definition that works for Android/Ubuntu/OE.
NOTE: the repo may need to be renamed and the files re-organized to do something like this, but I think its a worthy goal.
NOTE: we should probably involve Alexander in this decision :)
Then we can specify one git url and run all the test there. otherwise seems we need to specify lava-test-shell-git(repo, testdef) for each test.
Hi, Paul
I submitted my change here:
https://code.launchpad.net/~liuyq0307/linaro-android-build-tools/lava-test-s...
Could you please help to review that? And about the following mail, do you have any comments?
Thanks, Yongqin Liu
On 3 February 2013 18:37, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Andy Doan & Paul Sokolovsky & Vishal Bhoj & All
Now lava-test-shell is supported by LAVA, and android team is considering adding the support on android-build.
I want to add following 3 interfaces on the android-build,
*1. lava-test-shell-url(url= http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... timeout=59400)* where timeout is optional when submitted, the action in job will be something like this:
{ "command": "lava_test_shell", "parameters": { "testdef_urls": [" http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... "], "timeout": 59400 } }
*2. lava-test-shell-git(repo=git://git.linaro.org/qa/test-definitions.git revision=master testdef=android/binder.yaml timeout=-1)
- where revison/testdef/timeout is optional when submitted, the action in job will be something like this: { "command": "lava_test_shell", "parameters": { "testdef_repos": [ { "git-repo": "git://
git.linaro.org/qa/test-definitions.git", "revision": "master", "testdef": "android/binder.yaml" } ], "timeout": -1 } } *3. lava-test-shell-bzr(repo=lp:~terceiro/+junk/lava-dev revision=112 timeout=-1)* where revison/testdef/timeout is optional when submitted, the action in job will be something like this: { "command": "lava_test_shell", "parameters": { "testdef_repos": [ { "bzr-repo": "lp:~terceiro/+junk/lava-dev", "revision": "112", "testdef": "jobs/android-busybox.yaml" } ], "timeout": -1 } }
By these 3 types interface, we can do most of the things lava-test-shell supported. Although we can't specify the array form with one interface one time, we can do the same things by specifying multiple times the interface of the same type. like *lava-test-shell-url(url=url1),**lava-test-shell-url(url=url2),* so I think it's enough for us to use on android-build.
About this, how do you think about that? Please feel free to give your comments. Thanks in advance!
-- Thanks, Yongqin Liu
#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android linaro-validation@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/pipermail/linaro-validation
Hello,
On Wed, 6 Feb 2013 15:42:26 +0800 YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Paul
I submitted my change here:
https://code.launchpad.net/~liuyq0307/linaro-android-build-tools/lava-test-s...
Could you please help to review that?
And about the following mail, do you have any comments?
I was a bit out of context when received that mail, but as Andy had suggestions, I skipped asking basic questions, and now seeing the patch, I gathered it all together. Yes, seems ok to me, and I merged your patch, thanks.
Thanks, Yongqin Liu
On 3 February 2013 18:37, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Andy Doan & Paul Sokolovsky & Vishal Bhoj & All
Now lava-test-shell is supported by LAVA, and android team is considering adding the support on android-build.
I want to add following 3 interfaces on the android-build,
*1. lava-test-shell-url(url= http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... timeout=59400)* where timeout is optional when submitted, the action in job will be something like this:
{ "command": "lava_test_shell", "parameters": { "testdef_urls": [" http://cbuild.validation.linaro.org:80/helpers/scheduler/lava/testdef/lava-p... "], "timeout": 59400 } }
*2. lava-test-shell-git(repo=git://git.linaro.org/qa/test-definitions.git revision=master testdef=android/binder.yaml timeout=-1) * where revison/testdef/timeout is optional when submitted, the action in job will be something like this: { "command": "lava_test_shell", "parameters": { "testdef_repos": [ { "git-repo": "git:// git.linaro.org/qa/test-definitions.git", "revision": "master", "testdef": "android/binder.yaml" } ], "timeout": -1 } } *3. lava-test-shell-bzr(repo=lp:~terceiro/+junk/lava-dev revision=112 timeout=-1)* where revison/testdef/timeout is optional when submitted, the action in job will be something like this: { "command": "lava_test_shell", "parameters": { "testdef_repos": [ { "bzr-repo": "lp:~terceiro/+junk/lava-dev", "revision": "112", "testdef": "jobs/android-busybox.yaml" } ], "timeout": -1 } }
By these 3 types interface, we can do most of the things lava-test-shell supported. Although we can't specify the array form with one interface one time, we can do the same things by specifying multiple times the interface of the same type. like *lava-test-shell-url(url=url1),**lava-test-shell-url(url=url2),* so I think it's enough for us to use on android-build.
About this, how do you think about that? Please feel free to give your comments. Thanks in advance!
-- Thanks, Yongqin Liu
#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android linaro-validation@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/pipermail/linaro-validation
linaro-android@lists.linaro.org
-
Andy Doan -
Paul Sokolovsky -
YongQin Liu