Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World

https://medium.com/@ruhil.vikash16/data-science-and-large-language-models-llama-vs-lama-13b-and-gpt-3-175b-a-revolution-that-will-8cc5f4c389c2

by dhdhd1 • 3 years ago

6 6 3 years ago

medium.com

dhdhd1• 3 years ago

training the GPT-3 175B model required 3.2 million core hours spread across 285,000 processor cores over several months. It is projected that the overall cost of training the model will be roughly $4.6 million.

rani082• 3 years ago

We are doomed

blackhat2017• 3 years ago

we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.

rani082• 3 years ago

One day we will be kicked out of our Jobs

smoldesu• 3 years ago

As many have said before, there are open GPT models you can use. You can't run ChatGPT yourself, but you don't have the resources to run it anyways.

You can get relatively SOTA models running locally, it just requires a lot of compute.

version_five• 3 years ago

LAION is working on an open chatgpt like model [0] and there is a project discussed here recently that is about running the llms on single gpus [1]

I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough.

Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom.

[0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen

Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World

Related Stories