Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B?

https://news.ycombinator.com/item?id=47803176
by wasimsk • 3 months ago
2 2 3 months ago

I want to create a local GenAI. Tell me the server machine requirements.

Or if you can suggest both—The model & a cheap machine requirement against that, it will help a lot. By the way, for now—I have Intel i5 6th Gen CPU, Graphics card with 4 GB VRAM, 16 GB RAM & Ethernet. I will improve it if I get a good guidance here on.

Related Stories

Loading related stories...

Source preview

news.ycombinator.com