Ask HN: Could we build an open, decentralized version of GPT-3?

https://news.ycombinator.com/item?id=23905899
by HugThem • 6 years ago
3 1 6 years ago

I find it somewhat scary, that the most advanced AI is only available to whoever gets selected by a single authority.

From what I read, the model has 175B parameters and therefore cannot run on a normal computer.

Could we build something like AI@Home where everyone contributes some memory/processor time?

Getting up to some hundred GB of memory does not seem too hard this way.

I guess the hard part is creating a decentralized NN. Not sure how much research has been done on this already.

Related Stories

Loading related stories...

Source preview

news.ycombinator.com