New SOTA 4-bit weight and KV quantization with optimized GPU performancehttps://arxiv.org/abs/2405.04532 by Hugsun • 2 years ago 3 0 2 years agoARarxiv.org