Grok Weights Available via Torrent

by kaliqt • 2 years ago

27 9 2 years ago

kaliqt• 2 years ago

They made good on their promise it would seem.

sp3322• 2 years ago

Bold to make a joke about the tsunami of spam overrunning the site.

rvz• 2 years ago

As promised, weights are available. For those who don't like Twitter / X, Here are the details from the README:

- 314B parameter Mixture of Experts model

- Base model (not finetuned)

- 8 experts (2 active)

- 86B active parameters

- Apache 2.0 license

Even more open than OpenAI.

permalac2• 2 years ago

How many H100 does one need to run this?

permalac2• 2 years ago

How many H100 does one need to run this?

sp3322• 2 years ago

ronsor• 2 years ago

It's a 314 billion parameter mixture-of-experts, apparently trained using a custom framework using Rust and Jax.

ls612• 2 years ago

So this isn't something anyone without H100s is ever running no matter how you quantize it.

ChrisArchitect• 2 years ago

Related Stories