Ask HN: Openrouter Free Models

https://news.ycombinator.com/item?id=44094707

by spapas82 • 1 year ago

2 3 1 year ago

news.ycombinator.com

Hey friends. It's interesting to me that openrouter offers a bunch of completely free models, for example: https://openrouter.ai/mistralai/devstral-small:free ... What's the point of these models ? Who is hosting them and offering these resources for free? What are the disadvantages of these? I understand that they are not the best but they seem good enough to me. Why would I pay to use the OpenAI API when I can use these for free ?

bonki• 1 year ago

The free models are subject to tighter rate limiting.

They also offer free models like Quasar Alpha where they don't disclose who the model provider is. In exchange for you getting a capable model for free they get to log everything to improve upon it before a proper public release. Whatever that means, as I would expect everything and your mother to be logged and used for further training anyway.

spapas82• 1 year ago

I asked on IRC and found my asnwer: https://openrouter.ai/docs/faq#how-are-rate-limits-calculate...

For free models, rate limits are determined by the credits that you have purchased. If you have purchased at least 10 credits, your free model rate limit will be 1000 requests per day. Otherwise, you will be rate limited to 50 free model API requests per day.

lamer3• 1 year ago

Almost all of the free model providers out there say they can log your prompts. For example, I looked at the link you posted.

"To our knowledge, this provider may use your prompts and completions to train new models."

Ask HN: Openrouter Free Models

Related Stories