Hi,

On 19 March 2015 at 19:17, <pzheng@codeaurora.org> wrote:

I see a list of benchmark results (e.g., AndEMark Native, AndEMark Java,
BenchmarkPi, AnTuTu 5.3 etc.) on the following webpage and have some
questions on how the benchmarking was done.

https://wiki.linaro.org/Platform/Android/GccClangBenchmark-2014-12

1) Were the benchmarks built from source with gcc/clang, or were the
binaries (apks?) of the benchmarks used for the benchmarking?

We used binary APKs on top of custom AOSP builds. Unfortunately the most common benchmarks aren't Open Source and we don't have access to their source.

The point was benchmarking the system built with different compilers.

2) If the benchmarks were not built from source for the benchmarking, can
you explain the headings of the columns of the "Benchmark results"? I see
for example "gcc Nexus 9", "clang Nexus 9". Does the heading mean, say for
some benchmark "AnTuTu 5.3", the same AnTuTu apks were installed for
benchmarking but one was ran on AOSP built with gcc and the other were ran
on AOSP built with clang? Please correct me if I am wrong.

Yes, exactly.

ttyl

bero