Show HN: Samosa Chat - Run Qwen3.6-35B-A3B Locally on a 16 GB Mac

https://github.com/deepanwadhwa/samosa-chat

by dwa3592 • 8 days ago

6 9 8 days ago

github.com

MrGrinchh• 8 days ago

This is pretty sick. 7tokens/second is not fast but still seems useful.

aanet• 8 days ago

+1 for pairing Samosa with Chāt :D :D

dwa35923• 8 days ago

i was pleasantly surprised to find out it hadn't been done until now.

prabhanjana_c3• 8 days ago

Very interesting. I am always curious on llama.cpp and vllm. All the best for samosa inference engine. One reason I am not running local models on my Mac now a days, is My Mac book pro is getting heated more. Otherwise would love to run couple (at least 1 to 3) of local models continuously.

dwa35923• 7 days ago

>One reason I am not running local models on my Mac now a days, is My Mac book pro is getting heated more

Samosa was optimized for keeping mac's temp in check. This is one of the important reasons for creating this - no excessive wear/tear to the machine. https://github.com/deepanwadhwa/samosa-chat#the-three-princi...

maybe give it a try and let me know if your macbook is getting heated while running this?

prabhanjana_c3• 7 days ago

Actually quite cool. My mac is not getting heated. will check more. Memory pressure is very low. I see it (memory used) just increased from 22GB to 27Gb(on 48GB pro), while using somosa command(again a very basic test). Not really measured tokens/s, but I see it's reasonable.

daef• 7 days ago

any way to run samosa in opencode?

Show HN: Samosa Chat - Run Qwen3.6-35B-A3B Locally on a 16 GB Mac

Related Stories