HN user

lastLinkedList

8 karma
Posts0
Comments10
View on HN
No posts found.

I’m curious to hear more about phone-local assistants. I rather assumed only the latest hardware ( iPhone 15+, not sure on Android side) could do local inference. Is there a way to get something going on hardware a couple years old?

preemptively adding for us AMD users - it’s pretty seamless to get Ollama working with rocm, and if you have a card that’s a bit below the waterline (lowest supported is a 6800xt, i bought a 6750xt), you can use a community patch that will enable it for your card anyway:

https://github.com/likelovewant/ollama-for-amd/wiki#demo-rel...

I specifically recommend the method where you grab the patched rocblas.dll for your card model, and replace the one that Ollama is using, as someone who is technical but isn’t proficient with building from source (yet!)

The thing I dislike the most about Instagram is it seems like at some point it will be like "I'm done showing you content from your feed, here is generically popular stuff". There's a divider and a little message, but if I'm casually scrolling I might miss it and I'm on my timeline, if I wanted to be on Discover I'd be on Discover.

I can confirm this - I got a 72 month loan on my current car when my finances were a lot worse and it was pitched to me as making it affordable. The price every month now is incredibly sustainable, but I have this suspicion that I'm way overpaying for what I bought.

Honestly, everything about that purchasing experience has taught me to steer clear of dealers unless I'm ready to buy on the spot and have done my own homework.

I think the idea is good, and the economics don't immediately suggest that is impractical more than, say, the supply chain dynamics behind widespread gas stations to me. The issue is getting there, and while China has these manufacturers pushing the swap paradigm, we'll almost need someone with Tesla level deep pockets to get over the implementation hump in the US.

That's what I'm thinking of doing when I build PCs for my partner and I later this year. I've been looking at benchmarks and I'm not as worried about the top end of performance as much as I am Intel being about ready to release a new socket design next refresh.