This was the reason GCC disabled vectorization for a lot of fp operations for neon when in strict IEEE754 conformance mode for the ARM port which is the default. And I suspect you want LLVM to as well if it already doesn't :)

http://gcc.gnu.org/PR43703 is the bug report for more - if sourceware is back up and services running.