Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1: --------------- 1. antutu 5 - *HUNG/CRASH *(No log as the test didn't complete ) 2. caffeinemark - *CRASH *- (Every other time this test fails) - logcat & snapshot attached 3. cfbench - *PASS*
Benchmark job 2: --------------- 4. smartbench2014 - *PASS* 5. gearsES1eclair - *CRASH* (There's no log for this because the script does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3: --------------- 6. vellamo - testing in progress (currently the benchmark sounds like it's paused on Networking Loader, since a while)
Benchmark job 4: --------------- 7. andebench2014 - 8. javawhetstone - 9. jbench - 10. linpackjava - 11. scimark -
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Milosz is out of office all this week. We need to find another way to
check
things out :-/
On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Misolz
Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?
Thanks, Yongqin Liu
On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org
wrote:
Hi, All
The job for the benchmarks failed again. Seems there is a problem to run the vellamo on Juno, the test timed
out
and caused the sync problem. So I split the job into 3 small jobs:
Benchmark Job#1 https://validation.linaro.org/scheduler/job/287238.0 finished. but there is no benchmark result for benchmarks application of
antutu5,
Caffeinemark, and CF-Bench. And also all the benchmark result for nbench are zero.
Benchmark Job#2 https://validation.linaro.org/scheduler/job/287240.0 Smartbench2012 seems not started correctly. And the gearses1eclair test was timed out, and caused the sync
problem.
Benchmark Job#3: vellamo job, timed out again. https://validation.linaro.org/scheduler/job/287242.0
Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, LinpackJava, and Scimark https://validation.linaro.org/scheduler/job/287503.0
Thanks, Yongqin Liu On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org
wrote:
> > Hi, Jakub > > The 2 cts jobs finished. > > Thanks, > Yongqin Liu > On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org
wrote:
>> >> Hi, All >> >> Following are job status for Juno build #335 on LAVA: >> The 3 resubmitted jobs are running on LAVA now. >> >> Normal Job: >> https://validation.linaro.org/scheduler/job/282224 finished >> >> benchmark-lite: >> https://validation.linaro.org/scheduler/job/282229.0 finished >> >> >> linaro-android_armv8-android-juno-lsk-benchmark-application >> https://validation.linaro.org/scheduler/job/282231.0 finished >> >> >> linaro-android_armv8-android-juno-lsk_cts_32bit: >> https://validation.linaro.org/scheduler/job/282225.1 Canceled >> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >> https://validation.linaro.org/scheduler/job/286312.0 resubmitted > > Finished >> >> >> linaro-android_armv8-android-juno-lsk_cts_64bit: >> https://validation.linaro.org/scheduler/job/282227.0 Canceled >> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >> https://validation.linaro.org/scheduler/job/286310.0 resubmitted > > Finished. >> >> >> Benchmarks: >> https://validation.linaro.org/scheduler/job/282233.0 Canceled >> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
Hi, Mahanth
Thanks for the help!
On 19 March 2015 at 23:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat &
snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
About these 5 apks, scimark and javawhetstone should be fixed by this
change: https://review.linaro.org/#/c/5144/
The other 3 andebench2014, jbench, linpackjava should be OK. So you don't need to check these 5 now I think.
Thanks, Yongqin Liu
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Milosz is out of office all this week. We need to find another way to
check
things out :-/
On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org
wrote:
Hi, Misolz
Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?
Thanks, Yongqin Liu
On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org
wrote:
> > Hi, All > > The job for the benchmarks failed again. > Seems there is a problem to run the vellamo on Juno, the test timed
out
> and caused the sync problem. > So I split the job into 3 small jobs: > > Benchmark Job#1 > https://validation.linaro.org/scheduler/job/287238.0 finished. > but there is no benchmark result for benchmarks application of
antutu5,
> Caffeinemark, and CF-Bench. > And also all the benchmark result for nbench are zero. > > Benchmark Job#2 > https://validation.linaro.org/scheduler/job/287240.0 > Smartbench2012 seems not started correctly. > And the gearses1eclair test was timed out, and caused the sync
problem.
> > > Benchmark Job#3: vellamo job, timed out again. > https://validation.linaro.org/scheduler/job/287242.0 > > > Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, > LinpackJava, and Scimark > https://validation.linaro.org/scheduler/job/287503.0 > > > Thanks, > Yongqin Liu > On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org
wrote:
>> >> Hi, Jakub >> >> The 2 cts jobs finished. >> >> Thanks, >> Yongqin Liu >> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org
wrote:
>>> >>> Hi, All >>> >>> Following are job status for Juno build #335 on LAVA: >>> The 3 resubmitted jobs are running on LAVA now. >>> >>> Normal Job: >>> https://validation.linaro.org/scheduler/job/282224 finished >>> >>> benchmark-lite: >>> https://validation.linaro.org/scheduler/job/282229.0 finished >>> >>> >>> linaro-android_armv8-android-juno-lsk-benchmark-application >>> https://validation.linaro.org/scheduler/job/282231.0 finished >>> >>> >>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >> >> Finished >>> >>> >>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286310.0 resubmitted >> >> Finished. >>> >>> >>> Benchmarks: >>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
So, do you need me to test these changes? https://review.linaro.org/#/c/5144/
On 19 March 2015 at 16:04, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Mahanth
Thanks for the help!
On 19 March 2015 at 23:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat
& snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
About these 5 apks, scimark and javawhetstone should be fixed by this
change: https://review.linaro.org/#/c/5144/
The other 3 andebench2014, jbench, linpackjava should be OK. So you don't need to check these 5 now I think.
Thanks, Yongqin Liu
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Milosz is out of office all this week. We need to find another way
to check
things out :-/
On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org
wrote:
> > Hi, Misolz > > Could you please help to check if the benchmark tests mentioned
below
> can work on the Juno with the 5.1 build#335? > > Thanks, > Yongqin Liu > > On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org
wrote:
>> >> Hi, All >> >> The job for the benchmarks failed again. >> Seems there is a problem to run the vellamo on Juno, the test
timed out
>> and caused the sync problem. >> So I split the job into 3 small jobs: >> >> Benchmark Job#1 >> https://validation.linaro.org/scheduler/job/287238.0 finished. >> but there is no benchmark result for benchmarks application of
antutu5,
>> Caffeinemark, and CF-Bench. >> And also all the benchmark result for nbench are zero. >> >> Benchmark Job#2 >> https://validation.linaro.org/scheduler/job/287240.0 >> Smartbench2012 seems not started correctly. >> And the gearses1eclair test was timed out, and caused the sync
problem.
>> >> >> Benchmark Job#3: vellamo job, timed out again. >> https://validation.linaro.org/scheduler/job/287242.0 >> >> >> Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, >> LinpackJava, and Scimark >> https://validation.linaro.org/scheduler/job/287503.0 >> >> >> Thanks, >> Yongqin Liu >> On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org
wrote:
>>> >>> Hi, Jakub >>> >>> The 2 cts jobs finished. >>> >>> Thanks, >>> Yongqin Liu >>> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org
wrote:
>>>> >>>> Hi, All >>>> >>>> Following are job status for Juno build #335 on LAVA: >>>> The 3 resubmitted jobs are running on LAVA now. >>>> >>>> Normal Job: >>>> https://validation.linaro.org/scheduler/job/282224 finished >>>> >>>> benchmark-lite: >>>> https://validation.linaro.org/scheduler/job/282229.0 finished >>>> >>>> >>>> linaro-android_armv8-android-juno-lsk-benchmark-application >>>> https://validation.linaro.org/scheduler/job/282231.0 finished >>>> >>>> >>>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >>> >>> Finished >>>> >>>> >>>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>>> https://validation.linaro.org/scheduler/job/286310.0
resubmitted
>>> >>> Finished. >>>> >>>> >>>> Benchmarks: >>>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>>> >>>> >>>> -- >>>> Best Regards, >>>> Yongqin Liu >>>> --------------------------------------------------------------- >>>> #mailing list >>>> linaro-android@lists.linaro.org >>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >>> >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
On 20 March 2015 at 00:09, Mahanth Gouda mahanth.gouda@linaro.org wrote:
So, do you need me to test these changes? https://review.linaro.org/#/c/5144/
I think you can test the changes later for the review.
I had gotten the result via running them with my personal repository
Thanks, Yongqin Liu
On 19 March 2015 at 16:04, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Mahanth
Thanks for the help!
On 19 March 2015 at 23:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat
& snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
About these 5 apks, scimark and javawhetstone should be fixed by this
change: https://review.linaro.org/#/c/5144/
The other 3 andebench2014, jbench, linpackjava should be OK. So you don't need to check these 5 now I think.
Thanks, Yongqin Liu
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote: > Milosz is out of office all this week. We need to find another way to check > things out :-/ > > On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org wrote: >> >> Hi, Misolz >> >> Could you please help to check if the benchmark tests mentioned below >> can work on the Juno with the 5.1 build#335? >> >> Thanks, >> Yongqin Liu >> >> On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org wrote: >>> >>> Hi, All >>> >>> The job for the benchmarks failed again. >>> Seems there is a problem to run the vellamo on Juno, the test timed out >>> and caused the sync problem. >>> So I split the job into 3 small jobs: >>> >>> Benchmark Job#1 >>> https://validation.linaro.org/scheduler/job/287238.0 finished. >>> but there is no benchmark result for benchmarks application of antutu5, >>> Caffeinemark, and CF-Bench. >>> And also all the benchmark result for nbench are zero. >>> >>> Benchmark Job#2 >>> https://validation.linaro.org/scheduler/job/287240.0 >>> Smartbench2012 seems not started correctly. >>> And the gearses1eclair test was timed out, and caused the sync problem. >>> >>> >>> Benchmark Job#3: vellamo job, timed out again. >>> https://validation.linaro.org/scheduler/job/287242.0 >>> >>> >>> Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, >>> LinpackJava, and Scimark >>> https://validation.linaro.org/scheduler/job/287503.0 >>> >>> >>> Thanks, >>> Yongqin Liu >>> On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org wrote: >>>> >>>> Hi, Jakub >>>> >>>> The 2 cts jobs finished. >>>> >>>> Thanks, >>>> Yongqin Liu >>>> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org wrote: >>>>> >>>>> Hi, All >>>>> >>>>> Following are job status for Juno build #335 on LAVA: >>>>> The 3 resubmitted jobs are running on LAVA now. >>>>> >>>>> Normal Job: >>>>> https://validation.linaro.org/scheduler/job/282224 finished >>>>> >>>>> benchmark-lite: >>>>> https://validation.linaro.org/scheduler/job/282229.0 finished >>>>> >>>>> >>>>> linaro-android_armv8-android-juno-lsk-benchmark-application >>>>> https://validation.linaro.org/scheduler/job/282231.0 finished >>>>> >>>>> >>>>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>>>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>>>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>>>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >>>> >>>> Finished >>>>> >>>>> >>>>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>>>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>>>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>>>> https://validation.linaro.org/scheduler/job/286310.0 resubmitted >>>> >>>> Finished. >>>>> >>>>> >>>>> Benchmarks: >>>>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>>>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>>>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>>>> >>>>> >>>>> -- >>>>> Best Regards, >>>>> Yongqin Liu >>>>> --------------------------------------------------------------- >>>>> #mailing list >>>>> linaro-android@lists.linaro.org >>>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>>> >>>> >>>> >>>> >>>> -- >>>> Best Regards, >>>> Yongqin Liu >>>> --------------------------------------------------------------- >>>> #mailing list >>>> linaro-android@lists.linaro.org >>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >>> >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > With best regards, > > Jakub Pavelek > > Linaro Mobile Group project manager > Linaro.org│Open source software for ARM SoCs >
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
Hi, Mahanth
Another 3 apks:
- nbench - GFXBench3 - gearses2eclair, not finished yet, seems to be timed out
Could you please help to check these 3 apks as well? They are failed to get the result at my jobs.
Thanks, Yongqin Liu On 19 March 2015 at 23:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat &
snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Milosz is out of office all this week. We need to find another way to
check
things out :-/
On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org
wrote:
Hi, Misolz
Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?
Thanks, Yongqin Liu
On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org
wrote:
> > Hi, All > > The job for the benchmarks failed again. > Seems there is a problem to run the vellamo on Juno, the test timed
out
> and caused the sync problem. > So I split the job into 3 small jobs: > > Benchmark Job#1 > https://validation.linaro.org/scheduler/job/287238.0 finished. > but there is no benchmark result for benchmarks application of
antutu5,
> Caffeinemark, and CF-Bench. > And also all the benchmark result for nbench are zero. > > Benchmark Job#2 > https://validation.linaro.org/scheduler/job/287240.0 > Smartbench2012 seems not started correctly. > And the gearses1eclair test was timed out, and caused the sync
problem.
> > > Benchmark Job#3: vellamo job, timed out again. > https://validation.linaro.org/scheduler/job/287242.0 > > > Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, > LinpackJava, and Scimark > https://validation.linaro.org/scheduler/job/287503.0 > > > Thanks, > Yongqin Liu > On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org
wrote:
>> >> Hi, Jakub >> >> The 2 cts jobs finished. >> >> Thanks, >> Yongqin Liu >> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org
wrote:
>>> >>> Hi, All >>> >>> Following are job status for Juno build #335 on LAVA: >>> The 3 resubmitted jobs are running on LAVA now. >>> >>> Normal Job: >>> https://validation.linaro.org/scheduler/job/282224 finished >>> >>> benchmark-lite: >>> https://validation.linaro.org/scheduler/job/282229.0 finished >>> >>> >>> linaro-android_armv8-android-juno-lsk-benchmark-application >>> https://validation.linaro.org/scheduler/job/282231.0 finished >>> >>> >>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >> >> Finished >>> >>> >>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286310.0 resubmitted >> >> Finished. >>> >>> >>> Benchmarks: >>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
Pleas find my observations in line:
- nbench - Looks ok.
- GFXBench3 - CRASH - (I get this msg on the display - Your version of the GFXBench is outdated, please refresh the app and start again. Let me know if you need to the log cat msg for this ?)
- gearses2eclair - Looks good to me. Tried a couple of times and it looks OK.
Thanks,
Mahanth
On 19 March 2015 at 16:10, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Mahanth
Another 3 apks:
- nbench
- GFXBench3
- gearses2eclair, not finished yet, seems to be timed out
Could you please help to check these 3 apks as well? They are failed to get the result at my jobs.
Thanks, Yongqin Liu On 19 March 2015 at 23:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat
& snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Milosz is out of office all this week. We need to find another way
to check
things out :-/
On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org
wrote:
> > Hi, Misolz > > Could you please help to check if the benchmark tests mentioned
below
> can work on the Juno with the 5.1 build#335? > > Thanks, > Yongqin Liu > > On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org
wrote:
>> >> Hi, All >> >> The job for the benchmarks failed again. >> Seems there is a problem to run the vellamo on Juno, the test
timed out
>> and caused the sync problem. >> So I split the job into 3 small jobs: >> >> Benchmark Job#1 >> https://validation.linaro.org/scheduler/job/287238.0 finished. >> but there is no benchmark result for benchmarks application of
antutu5,
>> Caffeinemark, and CF-Bench. >> And also all the benchmark result for nbench are zero. >> >> Benchmark Job#2 >> https://validation.linaro.org/scheduler/job/287240.0 >> Smartbench2012 seems not started correctly. >> And the gearses1eclair test was timed out, and caused the sync
problem.
>> >> >> Benchmark Job#3: vellamo job, timed out again. >> https://validation.linaro.org/scheduler/job/287242.0 >> >> >> Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, >> LinpackJava, and Scimark >> https://validation.linaro.org/scheduler/job/287503.0 >> >> >> Thanks, >> Yongqin Liu >> On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org
wrote:
>>> >>> Hi, Jakub >>> >>> The 2 cts jobs finished. >>> >>> Thanks, >>> Yongqin Liu >>> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org
wrote:
>>>> >>>> Hi, All >>>> >>>> Following are job status for Juno build #335 on LAVA: >>>> The 3 resubmitted jobs are running on LAVA now. >>>> >>>> Normal Job: >>>> https://validation.linaro.org/scheduler/job/282224 finished >>>> >>>> benchmark-lite: >>>> https://validation.linaro.org/scheduler/job/282229.0 finished >>>> >>>> >>>> linaro-android_armv8-android-juno-lsk-benchmark-application >>>> https://validation.linaro.org/scheduler/job/282231.0 finished >>>> >>>> >>>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >>> >>> Finished >>>> >>>> >>>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>>> https://validation.linaro.org/scheduler/job/286310.0
resubmitted
>>> >>> Finished. >>>> >>>> >>>> Benchmarks: >>>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>>> >>>> >>>> -- >>>> Best Regards, >>>> Yongqin Liu >>>> --------------------------------------------------------------- >>>> #mailing list >>>> linaro-android@lists.linaro.org >>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >>> >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
Hi Mahanth,
Glad to hear that you managed to run gearses2eclair successfully, I'm afraid there is nothing more I can do on my side - I only have a TI Panda 4430 which the latest available image is 14.10, and obviously it works well on that build as I wrote the code based on it.
Thanks goodness you have the access to Juno board in Cambridge. ;)
Let me know if you need any extra explanation about the code.
Botao
On 20 March 2015 at 03:28, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Pleas find my observations in line:
nbench - Looks ok.
GFXBench3 - CRASH - (I get this msg on the display - Your version of
the GFXBench is outdated, please refresh the app and start again. Let me know if you need to the log cat msg for this ?)
- gearses2eclair - Looks good to me. Tried a couple of times and it
looks OK.
Thanks,
Mahanth
On 19 March 2015 at 16:10, YongQin Liu yongqin.liu@linaro.org wrote:
Hi, Mahanth
Another 3 apks:
- nbench
- GFXBench3
- gearses2eclair, not finished yet, seems to be timed out
Could you please help to check these 3 apks as well? They are failed to get the result at my jobs.
Thanks, Yongqin Liu On 19 March 2015 at 23:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat
& snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote: > Milosz is out of office all this week. We need to find another way to check > things out :-/ > > On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org wrote: >> >> Hi, Misolz >> >> Could you please help to check if the benchmark tests mentioned below >> can work on the Juno with the 5.1 build#335? >> >> Thanks, >> Yongqin Liu >> >> On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org wrote: >>> >>> Hi, All >>> >>> The job for the benchmarks failed again. >>> Seems there is a problem to run the vellamo on Juno, the test timed out >>> and caused the sync problem. >>> So I split the job into 3 small jobs: >>> >>> Benchmark Job#1 >>> https://validation.linaro.org/scheduler/job/287238.0 finished. >>> but there is no benchmark result for benchmarks application of antutu5, >>> Caffeinemark, and CF-Bench. >>> And also all the benchmark result for nbench are zero. >>> >>> Benchmark Job#2 >>> https://validation.linaro.org/scheduler/job/287240.0 >>> Smartbench2012 seems not started correctly. >>> And the gearses1eclair test was timed out, and caused the sync problem. >>> >>> >>> Benchmark Job#3: vellamo job, timed out again. >>> https://validation.linaro.org/scheduler/job/287242.0 >>> >>> >>> Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, >>> LinpackJava, and Scimark >>> https://validation.linaro.org/scheduler/job/287503.0 >>> >>> >>> Thanks, >>> Yongqin Liu >>> On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org wrote: >>>> >>>> Hi, Jakub >>>> >>>> The 2 cts jobs finished. >>>> >>>> Thanks, >>>> Yongqin Liu >>>> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org wrote: >>>>> >>>>> Hi, All >>>>> >>>>> Following are job status for Juno build #335 on LAVA: >>>>> The 3 resubmitted jobs are running on LAVA now. >>>>> >>>>> Normal Job: >>>>> https://validation.linaro.org/scheduler/job/282224 finished >>>>> >>>>> benchmark-lite: >>>>> https://validation.linaro.org/scheduler/job/282229.0 finished >>>>> >>>>> >>>>> linaro-android_armv8-android-juno-lsk-benchmark-application >>>>> https://validation.linaro.org/scheduler/job/282231.0 finished >>>>> >>>>> >>>>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>>>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>>>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>>>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >>>> >>>> Finished >>>>> >>>>> >>>>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>>>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>>>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>>>> https://validation.linaro.org/scheduler/job/286310.0 resubmitted >>>> >>>> Finished. >>>>> >>>>> >>>>> Benchmarks: >>>>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>>>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>>>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>>>> >>>>> >>>>> -- >>>>> Best Regards, >>>>> Yongqin Liu >>>>> --------------------------------------------------------------- >>>>> #mailing list >>>>> linaro-android@lists.linaro.org >>>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>>> >>>> >>>> >>>> >>>> -- >>>> Best Regards, >>>> Yongqin Liu >>>> --------------------------------------------------------------- >>>> #mailing list >>>> linaro-android@lists.linaro.org >>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >>> >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > With best regards, > > Jakub Pavelek > > Linaro Mobile Group project manager > Linaro.org│Open source software for ARM SoCs >
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
Thanks. Bero/YongQin - should we be worried that some benchmarks (AnTuTu5, Caffeinemark, ...) do not run on Juno with LCR?
On 19 March 2015 at 16:49, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update:
I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something?
Benchmark job 1:
- antutu 5 - *HUNG/CRASH *(No log as the test didn't complete )
- caffeinemark - *CRASH *- (Every other time this test fails) - logcat &
snapshot attached 3. cfbench - *PASS*
Benchmark job 2:
- smartbench2014 - *PASS*
- gearsES1eclair - *CRASH* (There's no log for this because the script
does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now.
Benchmark job 3:
- vellamo - testing in progress (currently the benchmark sounds like
it's paused on Networking Loader, since a while)
Benchmark job 4:
- andebench2014 -
- javawhetstone -
- jbench -
- linpackjava -
- scimark -
Please note - I've repeated all these tests at least 5 times in order to check the consistency.
Thanks & regards, Mahanth
On 19 March 2015 at 10:59, Mahanth Gouda mahanth.gouda@linaro.org wrote:
Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.
Thanks, Mahanth
On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Hi Botao and Mananth,
if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.
On 18 March 2015 at 19:01, Milosz Wasilewski < milosz.wasilewski@linaro.org> wrote:
Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:
- antutu 5 crashes (was crashing before) before it finishes
- caffeinemark crashes 4 out of 5 attempts
- nbench produces empty results for some reason (only zeros)
- GFXBench takes very long to run, we might have too short timeout
- GearsES1 crashes always and should be abandoned
I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.
milosz
On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:
Milosz is out of office all this week. We need to find another way to
check
things out :-/
On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org
wrote:
Hi, Misolz
Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?
Thanks, Yongqin Liu
On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org
wrote:
> > Hi, All > > The job for the benchmarks failed again. > Seems there is a problem to run the vellamo on Juno, the test timed
out
> and caused the sync problem. > So I split the job into 3 small jobs: > > Benchmark Job#1 > https://validation.linaro.org/scheduler/job/287238.0 finished. > but there is no benchmark result for benchmarks application of
antutu5,
> Caffeinemark, and CF-Bench. > And also all the benchmark result for nbench are zero. > > Benchmark Job#2 > https://validation.linaro.org/scheduler/job/287240.0 > Smartbench2012 seems not started correctly. > And the gearses1eclair test was timed out, and caused the sync
problem.
> > > Benchmark Job#3: vellamo job, timed out again. > https://validation.linaro.org/scheduler/job/287242.0 > > > Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, > LinpackJava, and Scimark > https://validation.linaro.org/scheduler/job/287503.0 > > > Thanks, > Yongqin Liu > On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org
wrote:
>> >> Hi, Jakub >> >> The 2 cts jobs finished. >> >> Thanks, >> Yongqin Liu >> On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org
wrote:
>>> >>> Hi, All >>> >>> Following are job status for Juno build #335 on LAVA: >>> The 3 resubmitted jobs are running on LAVA now. >>> >>> Normal Job: >>> https://validation.linaro.org/scheduler/job/282224 finished >>> >>> benchmark-lite: >>> https://validation.linaro.org/scheduler/job/282229.0 finished >>> >>> >>> linaro-android_armv8-android-juno-lsk-benchmark-application >>> https://validation.linaro.org/scheduler/job/282231.0 finished >>> >>> >>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >> >> Finished >>> >>> >>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286310.0 resubmitted >> >> Finished. >>> >>> >>> Benchmarks: >>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>> >>> >>> -- >>> Best Regards, >>> Yongqin Liu >>> --------------------------------------------------------------- >>> #mailing list >>> linaro-android@lists.linaro.org >>> http://lists.linaro.org/mailman/listinfo/linaro-android >> >> >> >> >> -- >> Best Regards, >> Yongqin Liu >> --------------------------------------------------------------- >> #mailing list >> linaro-android@lists.linaro.org >> http://lists.linaro.org/mailman/listinfo/linaro-android > > > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android
-- Best Regards, Yongqin Liu
#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
-- With best regards,
Jakub Pavelek
Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs
linaro-android@lists.linaro.org
-
Botao Sun -
Jakub Pavelek -
Mahanth Gouda -
YongQin Liu