Hi, Misolz

Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?

Thanks, Yongqin Liu

On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org wrote:

Hi, All

The job for the benchmarks failed again. Seems there is a problem to run the vellamo on Juno, the test timed out and caused the sync problem. So I split the job into 3 small jobs:

*Benchmark Job#1* https://validation.linaro.org/scheduler/job/287238.0 finished. but there is no benchmark result for benchmarks application of antutu5, Caffeinemark, and CF-Bench. And also all the benchmark result for nbench are zero.

*Benchmark Job#2* https://validation.linaro.org/scheduler/job/287240.0 Smartbench2012 seems not started correctly. And the gearses1eclair test was timed out, and caused the sync problem.

*Benchmark Job#3: *vellamo job, timed out again. https://validation.linaro.org/scheduler/job/287242.0

*Benchmark Job#4: *tests for andebench2014, Javawhetstone, JBench, LinpackJava, and Scimark https://validation.linaro.org/scheduler/job/287503.0

Thanks, Yongqin Liu On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, Jakub

The 2 cts jobs finished.

Thanks, Yongqin Liu On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, All

Following are job status for Juno build #335 on LAVA: The 3 resubmitted jobs are running on LAVA now.

Normal Job: https://validation.linaro.org/scheduler/job/282224 finished

benchmark-lite: https://validation.linaro.org/scheduler/job/282229.0 finished

linaro-android_armv8-android-juno-lsk-benchmark-application https://validation.linaro.org/scheduler/job/282231.0 finished

linaro-android_armv8-android-juno-lsk_cts_32bit: https://validation.linaro.org/scheduler/job/282225.1 Canceled https://validation.linaro.org/scheduler/job/284313.0 Incomplete https://validation.linaro.org/scheduler/job/286312.0 resubmitted

Finished

...

linaro-android_armv8-android-juno-lsk_cts_64bit: https://validation.linaro.org/scheduler/job/282227.0 Canceled https://validation.linaro.org/scheduler/job/284315.0 Incomplete *https://validation.linaro.org/scheduler/job/286310.0 https://validation.linaro.org/scheduler/job/286310.0 *resubmitted

Finished.

...

Benchmarks: https://validation.linaro.org/scheduler/job/282233.0 Canceled https://validation.linaro.org/scheduler/job/284317.0 Incomplete https://validation.linaro.org/scheduler/job/286314.0 resubmitted

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember: - antutu 5 crashes (was crashing before) before it finishes - caffeinemark crashes 4 out of 5 attempts - nbench produces empty results for some reason (only zeros) - GFXBench takes very long to run, we might have too short timeout - GearsES1 crashes always and should be abandoned

I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.

milosz

On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:

Milosz is out of office all this week. We need to find another way to check things out :-/

On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, Misolz

Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?

Thanks, Yongqin Liu

On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, All

The job for the benchmarks failed again. Seems there is a problem to run the vellamo on Juno, the test timed out and caused the sync problem. So I split the job into 3 small jobs:

Benchmark Job#1 https://validation.linaro.org/scheduler/job/287238.0 finished. but there is no benchmark result for benchmarks application of antutu5, Caffeinemark, and CF-Bench. And also all the benchmark result for nbench are zero.

Benchmark Job#2 https://validation.linaro.org/scheduler/job/287240.0 Smartbench2012 seems not started correctly. And the gearses1eclair test was timed out, and caused the sync problem.

Benchmark Job#3: vellamo job, timed out again. https://validation.linaro.org/scheduler/job/287242.0

Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, LinpackJava, and Scimark https://validation.linaro.org/scheduler/job/287503.0

Thanks, Yongqin Liu On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, Jakub

The 2 cts jobs finished.

Thanks, Yongqin Liu On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, All

Following are job status for Juno build #335 on LAVA: The 3 resubmitted jobs are running on LAVA now.

Normal Job: https://validation.linaro.org/scheduler/job/282224 finished

benchmark-lite: https://validation.linaro.org/scheduler/job/282229.0 finished

linaro-android_armv8-android-juno-lsk-benchmark-application https://validation.linaro.org/scheduler/job/282231.0 finished

linaro-android_armv8-android-juno-lsk_cts_32bit: https://validation.linaro.org/scheduler/job/282225.1 Canceled https://validation.linaro.org/scheduler/job/284313.0 Incomplete https://validation.linaro.org/scheduler/job/286312.0 resubmitted

Finished

...

linaro-android_armv8-android-juno-lsk_cts_64bit: https://validation.linaro.org/scheduler/job/282227.0 Canceled https://validation.linaro.org/scheduler/job/284315.0 Incomplete https://validation.linaro.org/scheduler/job/286310.0 resubmitted

Finished.

...

Benchmarks: https://validation.linaro.org/scheduler/job/282233.0 Canceled https://validation.linaro.org/scheduler/job/284317.0 Incomplete https://validation.linaro.org/scheduler/job/286314.0 resubmitted

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- With best regards,

Jakub Pavelek

Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs

Hi Jakub, Thanks for the help offer, I've started with this, will surely seek your help when required.

Thanks, Mahanth

On 19 March 2015 at 09:19, Jakub Pavelek jakub.pavelek@linaro.org wrote:

Hi Botao and Mananth,

if you need anything from us ping me or YongQin. We would like to investigate the failing benchmark automation ASAP, otherwise we need QAS to run those benchmarks manually and we will lose trends tracking in ImageReports.

On 18 March 2015 at 19:01, Milosz Wasilewski <milosz.wasilewski@linaro.org

...

wrote:

...

Botao and Mahanth can help. Mahanth has access to the hw. As far as I remember:

• antutu 5 crashes (was crashing before) before it finishes
• caffeinemark crashes 4 out of 5 attempts
• nbench produces empty results for some reason (only zeros)
• GFXBench takes very long to run, we might have too short timeout
• GearsES1 crashes always and should be abandoned

I don't know about the others. This is what was happening before moving to 5.1. Mahanth, please take this as high priority to investigate. Botao migh help you with Gears as he did the automation.

milosz

On 18 March 2015 at 15:56, Jakub Pavelek jakub.pavelek@linaro.org wrote:

...

Milosz is out of office all this week. We need to find another way to

check

...

things out :-/

On 18 March 2015 at 10:14, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, Misolz

Could you please help to check if the benchmark tests mentioned below can work on the Juno with the 5.1 build#335?

Thanks, Yongqin Liu

On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, All

The job for the benchmarks failed again. Seems there is a problem to run the vellamo on Juno, the test timed

out

...

...

...

and caused the sync problem. So I split the job into 3 small jobs:

Benchmark Job#1 https://validation.linaro.org/scheduler/job/287238.0 finished. but there is no benchmark result for benchmarks application of

antutu5,

...

...

...

Caffeinemark, and CF-Bench. And also all the benchmark result for nbench are zero.

Benchmark Job#2 https://validation.linaro.org/scheduler/job/287240.0 Smartbench2012 seems not started correctly. And the gearses1eclair test was timed out, and caused the sync

problem.

...

...

...

Benchmark Job#3: vellamo job, timed out again. https://validation.linaro.org/scheduler/job/287242.0

Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, LinpackJava, and Scimark https://validation.linaro.org/scheduler/job/287503.0

Thanks, Yongqin Liu On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org

wrote:

...

...

...

...

Hi, Jakub

The 2 cts jobs finished.

Thanks, Yongqin Liu On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org

wrote:

...

...

...

...

> > Hi, All > > Following are job status for Juno build #335 on LAVA: > The 3 resubmitted jobs are running on LAVA now. > > Normal Job: > https://validation.linaro.org/scheduler/job/282224 finished > > benchmark-lite: > https://validation.linaro.org/scheduler/job/282229.0 finished > > > linaro-android_armv8-android-juno-lsk-benchmark-application > https://validation.linaro.org/scheduler/job/282231.0 finished > > > linaro-android_armv8-android-juno-lsk_cts_32bit: > https://validation.linaro.org/scheduler/job/282225.1 Canceled > https://validation.linaro.org/scheduler/job/284313.0 Incomplete > https://validation.linaro.org/scheduler/job/286312.0 resubmitted

Finished > > > linaro-android_armv8-android-juno-lsk_cts_64bit: > https://validation.linaro.org/scheduler/job/282227.0 Canceled > https://validation.linaro.org/scheduler/job/284315.0 Incomplete > https://validation.linaro.org/scheduler/job/286310.0 resubmitted

Finished. > > > Benchmarks: > https://validation.linaro.org/scheduler/job/282233.0 Canceled > https://validation.linaro.org/scheduler/job/284317.0 Incomplete > https://validation.linaro.org/scheduler/job/286314.0 resubmitted > > > -- > Best Regards, > Yongqin Liu > --------------------------------------------------------------- > #mailing list > linaro-android@lists.linaro.org > http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- With best regards,

Jakub Pavelek

Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs

-- With best regards,

Jakub Pavelek

Linaro Mobile Group project manager Linaro.org│Open source software for ARM SoCs

Hi, Milosz

In summary, following tests of benchmark applications seem have problem to get the benchmark result with Android 5.1 on Juno:

- antutu5 - Caffeinemark - CF-Bench. - nbench - vellamo - Javawhetstone - GFXBench3 - gearses2eclair, not finished yet, seems to be timed out - gearses1eclair, not finished yet, seems to be timed out

Following are jobs for the benchmark tests:

Job for Javawhetstone: no benchmark result https://validation.linaro.org/scheduler/job/287553.0

Job for GFXBench3: Couldn't find View with ID='android:id/button1' in tree with root=ROOT https://validation.linaro.org/scheduler/job/287555.0

Job for gearses2eclair: https://validation.linaro.org/scheduler/job/287561.0

Job for gearses1eclair: https://validation.linaro.org/scheduler/job/287563.0

Job for smartbench2012: Finished https://validation.linaro.org/scheduler/job/287565.0

Job for antutu5, Caffeinemark, and CF-Bench. and nbench: https://validation.linaro.org/scheduler/job/287238.0

Thanks, Yongqin Liu

On 18 March 2015 at 17:11, YongQin Liu yongqin.liu@linaro.org wrote:

Hi, All

The job for the benchmarks failed again. Seems there is a problem to run the vellamo on Juno, the test timed out and caused the sync problem. So I split the job into 3 small jobs:

*Benchmark Job#1* https://validation.linaro.org/scheduler/job/287238.0 finished. but there is no benchmark result for benchmarks application of antutu5, Caffeinemark, and CF-Bench. And also all the benchmark result for nbench are zero.

*Benchmark Job#2* https://validation.linaro.org/scheduler/job/287240.0 Smartbench2012 seems not started correctly. And the gearses1eclair test was timed out, and caused the sync problem.

*Benchmark Job#3: *vellamo job, timed out again. https://validation.linaro.org/scheduler/job/287242.0

*Benchmark Job#4: *tests for andebench2014, Javawhetstone, JBench, LinpackJava, and Scimark https://validation.linaro.org/scheduler/job/287503.0

Thanks, Yongqin Liu On 17 March 2015 at 21:30, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, Jakub

The 2 cts jobs finished.

Thanks, Yongqin Liu On 17 March 2015 at 15:47, YongQin Liu yongqin.liu@linaro.org wrote:

...

Hi, All

Following are job status for Juno build #335 on LAVA: The 3 resubmitted jobs are running on LAVA now.

Normal Job: https://validation.linaro.org/scheduler/job/282224 finished

benchmark-lite: https://validation.linaro.org/scheduler/job/282229.0 finished

linaro-android_armv8-android-juno-lsk-benchmark-application https://validation.linaro.org/scheduler/job/282231.0 finished

linaro-android_armv8-android-juno-lsk_cts_32bit: https://validation.linaro.org/scheduler/job/282225.1 Canceled https://validation.linaro.org/scheduler/job/284313.0 Incomplete https://validation.linaro.org/scheduler/job/286312.0 resubmitted

Finished

...

linaro-android_armv8-android-juno-lsk_cts_64bit: https://validation.linaro.org/scheduler/job/282227.0 Canceled https://validation.linaro.org/scheduler/job/284315.0 Incomplete *https://validation.linaro.org/scheduler/job/286310.0 https://validation.linaro.org/scheduler/job/286310.0 *resubmitted

Finished.

...

Benchmarks: https://validation.linaro.org/scheduler/job/282233.0 Canceled https://validation.linaro.org/scheduler/job/284317.0 Incomplete https://validation.linaro.org/scheduler/job/286314.0 resubmitted

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android

-- Best Regards, Yongqin Liu

---

#mailing list linaro-android@lists.linaro.org linaro-dev@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-android