guanming0717

Yes I did, with other SOTA quant methods like HQQ, AWQ etc. You can find more info in our blog :) https://general-instinct.com/blog/frontier-moe-sub-4-bit

Thanks for sharing! I'd love to chat with him. Would you be open to introducing us? :)