I see a list of benchmark results (e.g., AndEMark Native, AndEMark Java, BenchmarkPi, AnTuTu 5.3 etc.) on the following webpage and have some questions on how the benchmarking was done.
https://wiki.linaro.org/Platform/Android/GccClangBenchmark-2014-12
1) Were the benchmarks built from source with gcc/clang, or were the binaries (apks?) of the benchmarks used for the benchmarking?
2) If the benchmarks were not built from source for the benchmarking, can you explain the headings of the columns of the "Benchmark results"? I see for example "gcc Nexus 9", "clang Nexus 9". Does the heading mean, say for some benchmark "AnTuTu 5.3", the same AnTuTu apks were installed for benchmarking but one was ran on AOSP built with gcc and the other were ran on AOSP built with clang? Please correct me if I am wrong.
3) If the benchmarks were built from source, would you mind sharing the places where you get the source code of these benchmarks and instructions on how you built them with clang (I assume most benchmarks are built with gcc by default)? Besides, was the benchmarking done with AOSP built with gcc or with clang?
I would greatly appreciate it if there is any additional detail that can be shared.
Many thanks in advance.
Hi,
On 19 March 2015 at 19:17, pzheng@codeaurora.org wrote:
I see a list of benchmark results (e.g., AndEMark Native, AndEMark Java, BenchmarkPi, AnTuTu 5.3 etc.) on the following webpage and have some questions on how the benchmarking was done.
https://wiki.linaro.org/Platform/Android/GccClangBenchmark-2014-12
- Were the benchmarks built from source with gcc/clang, or were the
binaries (apks?) of the benchmarks used for the benchmarking?
We used binary APKs on top of custom AOSP builds. Unfortunately the most common benchmarks aren't Open Source and we don't have access to their source. The point was benchmarking the system built with different compilers.
- If the benchmarks were not built from source for the benchmarking, can
you explain the headings of the columns of the "Benchmark results"? I see for example "gcc Nexus 9", "clang Nexus 9". Does the heading mean, say for some benchmark "AnTuTu 5.3", the same AnTuTu apks were installed for benchmarking but one was ran on AOSP built with gcc and the other were ran on AOSP built with clang? Please correct me if I am wrong.
Yes, exactly.
ttyl bero
linaro-android@lists.linaro.org