Towards Optimal LLM Quantization 2 years ago
not yet but it's something we have in mind as a future feature.
HN user
not yet but it's something we have in mind as a future feature.
We continuously work on expanding SDK support, Rust is also on the list.
we don't support Falcon 2 yet but new models are always on our radar to be added to the platform.