Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade 3 SBC with 32GB RAM

https://taoofmac.com/space/links/2024/03/01/0116

by rcarmo • 2 years ago

9 8 2 years ago

This is just 5 paras of excuses for not testing squat.

teraflop• 2 years ago

The blog post is discussing another article that actually does contain test results: https://www.cnx-software.com/2024/02/27/testing-ai-and-llm-o...

lagrange772• 2 years ago

Thanks. Oh wow, the title is the link to the discussed article.

lionkor• 2 years ago

Title should be "Not Testing..."

ditados• 2 years ago

I wonder how stable those libraries mentioned are, and how much RAM is needed, because I cannot run LLMs at all on my Pis.

imtringued• 2 years ago

This unfortunately is a red herring. Jetson Orin with 32GB is a more reasonable option. Yes it is expensive (950€ on arrow.de), but it is a niche product in the first place.

Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade 3 SBC with 32GB RAM

Related Stories