Hi,
On 19 March 2015 at 19:17, pzheng@codeaurora.org wrote:
I see a list of benchmark results (e.g., AndEMark Native, AndEMark Java, BenchmarkPi, AnTuTu 5.3 etc.) on the following webpage and have some questions on how the benchmarking was done.
https://wiki.linaro.org/Platform/Android/GccClangBenchmark-2014-12
- Were the benchmarks built from source with gcc/clang, or were the
binaries (apks?) of the benchmarks used for the benchmarking?
We used binary APKs on top of custom AOSP builds. Unfortunately the most common benchmarks aren't Open Source and we don't have access to their source. The point was benchmarking the system built with different compilers.
- If the benchmarks were not built from source for the benchmarking, can
you explain the headings of the columns of the "Benchmark results"? I see for example "gcc Nexus 9", "clang Nexus 9". Does the heading mean, say for some benchmark "AnTuTu 5.3", the same AnTuTu apks were installed for benchmarking but one was ran on AOSP built with gcc and the other were ran on AOSP built with clang? Please correct me if I am wrong.
Yes, exactly.
ttyl bero