Ask HN: Best UNCENSORED language model comparable to ChatGPT?

https://news.ycombinator.com/item?id=36012500

by behnamoh • 3 years ago

22 11 3 years ago

news.ycombinator.com

wkat42422• 3 years ago

Are there even any? I think all the big players censor because they're afraid of the headlines "major AI product used to do <bad thing>".

Perhaps llama considering it can be self hosted?

Bran_son• 3 years ago

"major AI product used to do* <bad thing>"

*say

wkat42422• 3 years ago

I was thinking more about it helping people doing something bad, like write malware.

In fact I expect the phishers will have a field day with this. I expect phishing to become a lot more targeted and accurate in the near future. And much harder to detect.

cratermoon• 3 years ago

What sort of censoring are you concerned about? What's excluded from ChatGPT that you want to use?

porkbeer• 3 years ago

Not op, but working on network code it suddenly refused asserting it could not help me make 'hacking tools', which was not the case. Furthermore, even if it was, those tools are legal and useful. Unwanted censorship abounds.

tikkun• 3 years ago

https://www.reddit.com/r/LocalLLaMA/wiki/models/

https://chat.lmsys.org/?arena (Then click Leaderboard)

alpark3• 3 years ago

There's a bunch of LLaMA instruction-tuned variants on huggingface and new ones are coming out every day.

I personally had the best experience with GPT4-x-vicuna: https://huggingface.co/NousResearch/gpt4-x-vicuna-13b.

There's more variants, and you can find information on them on https://www.reddit.com/r/LocalLLaMA.

The best way for you to run the model is probably through https://github.com/ggerganov/llama.cpp. This is a plain C/C++ implementation that can run LLMs pretty efficiently. It can run the LLaMA 13B variants at a pretty quick pace (~100 ms/token) on my M1 Pro macbook.

I'd be happy to answer more questions.

behnamoh• 3 years ago

Thank you. As I'm new to this field, I have been grappling with some concepts like GGML vs GPTQ models, etc. It seems the GPTQ models only run on Linux, so your suggestion is right to use llama.cpp as that works with GGML and is compatible with M1 Macs as well.

I had trouble running oobabooga on M1 Mac, something about Python arm64 vs x86_64...

I didn't know about GPT4-x-Vicuna that you mentioned. Interesting to see that it's uncensored. I knew about Wizard-Vicuna-uncensored though. It seems like GPT4-x-Vicuna is similar.

seydor• 3 years ago

I think this is the currently trending

https://huggingface.co/TheBloke/Manticore-13B-GGML

You can download it directly from oobabooga interface

overall i have found gptx-4-alpaca to be pretty good.

None of them are comparable to chatGPT of course because they are smaller, but they are still great

toonyman2020• 3 years ago

Nothing

juliensalinas• 3 years ago

You might want to try our ChatDolphin model on NLP Cloud that is very similar to Vicuna and uncensored: https://nlpcloud.com/home/playground/text-generation (select the ChatDolphin model at the top right).

I hope it will be useful.

Ask HN: Best UNCENSORED language model comparable to ChatGPT?

Related Stories