SLEEF Vectorized Math Library

by gbrown_ • 6 years ago

62 14 6 years ago

svantana3• 6 years ago

Interesting, but a bit weird that the benchmark doesn't include the standard math functions - the question most potential users would ask is, how much performance could I gain from this?

Personally I do a lot of approximations of math functions, which usually give me about a 10x speed increase relative to <math.h>. From the looks of it, this isn't quite that fast.

someguydave• 6 years ago

This is more for people who need to do specialized DSP math like DFTs using a variety of different cpu arches. Most vendor libraries (like Intel IPP) for vector units fail to support their competitors. So benchmarks might be relatively less important than portability.

kcbanner• 6 years ago

This library can leverage data parallelism to increase throughout vs the scalar versions. ie. One instruction performs 4 operations instead of one. If the problem you are solving is suited to this parallelism, you could get a significant speedup.

svantana3• 6 years ago

Sure, so why is that speedup not measured in the benchmark?

celrod5• 6 years ago

Recent versions of GCC as well as the Intel compilers can autovectorize with the right flags (-ffast-math with GCC, -fast with Intel), and yield better performance with the <math.h> functions than you'll get from SLEEF on x86_64.

LLVM doesn't have a vector math library, so SLEEF could help you there.

If you're using single precision and AVX512, a >10x speed increase is likely. Otherwise, you'll probably get less than that. These functions are very accurate, most to withing 1 ULP of least precision. That is, if the answer they provide isn't the correctly rounded floating point answer, then it'll be either the next or previous representable floating point number.

There is a lot of room for giving up accuracy in the name of speed (eg, using less terms in the polynomials).

svantana3• 6 years ago

Do you have a benchmark showing that gcc is faster than sleef?

Sorry I wasn't clear, by "10x" I meant 10x faster than the standard library with the fastest compiler options (-O3 -ffast-math -avx512), but I've only tested with clang.

gameswithgo• 6 years ago

i use this library as an optional feature in simdeez. it was a relief to find it, and a rust wrapper for it. its hard stuff to port it is so arcane. big thanks to sleef!

celrod5• 6 years ago

I've been relying on a Julia port of version 2 (version 3 is out now). Version 3 added a lot of new functions, and I believe it improved performance on many of the old ones.

It is much faster (when vectorized) than what you get in base Julia, but lags behind gcc (glibc) and the Intel compiler's vectorized math libraries in performance.

improbable222• 6 years ago

Curious whether you've compared it to https://github.com/chriselrod/LoopVectorization.jl ? Which if I understand right is a pure-Julia attempt to use many of the same tricks.

CamperBob2• 6 years ago

glibc has SIMD-vectorized math functions? I don't quite understand what is being compared here. Any specifics you can share?

SLEEF Vectorized Math Library

Related Stories