Update on the Candle ML Framework

https://old.reddit.com/r/rust/comments/16rvlbf/update_on_the_candle_ml_framework/

by osanseviero • 3 years ago

3 1 3 years ago

old.reddit.com

We've first announced Candle, a minimalist ML framework in Rust 6 weeks ago. Since then, we've focused on adding various recent models and improved the framework so as to support the necessary features in an efficient way. You can checkout a gallery of the examples, supported models include:

- Large language models: LLaMA, LLaMA v2, Falcon, Phi-v1.5, StarCoder. - Quantized models with the llama.cpp approach: LLaMA, T5, Phi-v1.5 - Image generation: Stable Diffusion (v1.5, v2.1, and XL), Wuerstchen. - Computer Vision: DINOv2, yolo-v3, yolo-v8, Segment-Anything Model. - Text-to-speech: Whisper.

Thanks to using pure Rust, it's easy to directly rpedict in the browser using WASM. See these examples using Yolo, Whisper, SAM, T5 and Llama 2 https://huggingface.co/collections/radames/candle-wasm-examp...

Update on the Candle ML Framework

Related Stories