Hi,
if you check the android-build LAVA result table for https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-i... you will notice we see quite some details for the benchmarks. However, we don't see the individual pass/fails for the "simple pass/fail" tests.
For example:
1. lava, mmtest etc. - don't display what tests succeeded/failed - just the aggregated number 2. glmark2 etc. - display all the individual measurements
What can we do to display details for all test runs on android-build? I am in particular keen about seeing the individual "lava" results inline on android-build.
On 06/12/2012 01:59 PM, Alexander Sack wrote:
Hi,
if you check the android-build LAVA result table for https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-i... you will notice we see quite some details for the benchmarks. However, we don't see the individual pass/fails for the "simple pass/fail" tests.
For example:
- lava, mmtest etc. - don't display what tests succeeded/failed -
just the aggregated number 2. glmark2 etc. - display all the individual measurements
What can we do to display details for all test runs on android-build? I am in particular keen about seeing the individual "lava" results inline on android-build.
We probably only have to change the lava-dashboard code to make this work. Currently, android-build grabs a JSON feed for this:
The mmtest portion is like:
"mmtest", "results": {"fail": 85, "total_multiplied": 357, "total": 119, "measurements": [], "pass": 34}}
ie - the "measurements" section is empty because dashboard function handling the request filters out tests that don't have measurements:
So its probably not too hard to fix.
On Tue, Jun 12, 2012 at 9:08 PM, Andy Doan andy.doan@linaro.org wrote:
On 06/12/2012 01:59 PM, Alexander Sack wrote:
Hi,
if you check the android-build LAVA result table for
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-i... you will notice we see quite some details for the benchmarks. However, we don't see the individual pass/fails for the "simple pass/fail" tests.
For example:
1. lava, mmtest etc. - don't display what tests succeeded/failed - just the aggregated number 2. glmark2 etc. - display all the individual measurements
What can we do to display details for all test runs on android-build? I am in particular keen about seeing the individual "lava" results inline on android-build.
We probably only have to change the lava-dashboard code to make this work. Currently, android-build grabs a JSON feed for this:
The mmtest portion is like:
"mmtest", "results": {"fail": 85, "total_multiplied": 357, "total": 119, "measurements": [], "pass": 34}}
ie - the "measurements" section is empty because dashboard function handling the request filters out tests that don't have measurements:
It's kind of hard to imagine for me why one would not give the details for the pass/fail test runs. So yes, please let's include that content in this view.
On 06/12/2012 02:13 PM, Alexander Sack wrote:
On Tue, Jun 12, 2012 at 9:08 PM, Andy Doanandy.doan@linaro.org wrote:
On 06/12/2012 01:59 PM, Alexander Sack wrote:
Hi,
if you check the android-build LAVA result table for
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-i... you will notice we see quite some details for the benchmarks. However, we don't see the individual pass/fails for the "simple pass/fail" tests.
For example:
- lava, mmtest etc. - don't display what tests succeeded/failed -
just the aggregated number 2. glmark2 etc. - display all the individual measurements
What can we do to display details for all test runs on android-build? I am in particular keen about seeing the individual "lava" results inline on android-build.
We probably only have to change the lava-dashboard code to make this work. Currently, android-build grabs a JSON feed for this:
The mmtest portion is like:
"mmtest", "results": {"fail": 85, "total_multiplied": 357, "total": 119, "measurements": [], "pass": 34}}
ie - the "measurements" section is empty because dashboard function handling the request filters out tests that don't have measurements:
It's kind of hard to imagine for me why one would not give the details for the pass/fail test runs. So yes, please let's include that content in this view.
On Tue, Jun 12, 2012 at 9:18 PM, Andy Doan andy.doan@linaro.org wrote:
On 06/12/2012 02:13 PM, Alexander Sack wrote:
On Tue, Jun 12, 2012 at 9:08 PM, Andy Doanandy.doan@linaro.org wrote:
On 06/12/2012 01:59 PM, Alexander Sack wrote:
Hi,
if you check the android-build LAVA result table for
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-i... you will notice we see quite some details for the benchmarks. However, we don't see the individual pass/fails for the "simple pass/fail" tests.
For example:
1. lava, mmtest etc. - don't display what tests succeeded/failed - just the aggregated number 2. glmark2 etc. - display all the individual measurements
What can we do to display details for all test runs on android-build? I am in particular keen about seeing the individual "lava" results inline on android-build.
We probably only have to change the lava-dashboard code to make this work. Currently, android-build grabs a JSON feed for this:
The mmtest portion is like:
"mmtest", "results": {"fail": 85, "total_multiplied": 357, "total": 119, "measurements": [], "pass": 34}}
ie - the "measurements" section is empty because dashboard function handling the request filters out tests that don't have measurements:
It's kind of hard to imagine for me why one would not give the details for the pass/fail test runs. So yes, please let's include that content in this view.
Great and while we are at it, the view on android-build probably also wants to know about the direct download links to the attachments for each individual test. They could for instance then even display the screenshot that we seem to attach for each test nowadays in the same table ... nice!
linaro-android@lists.linaro.org
-
Alexander Sack -
Andy Doan