LLM pricing comparison tool

https://www.botgenuity.com/tools/llm-pricing

by alexbruner • 2 years ago

24 8 2 years ago

freeqaz• 2 years ago

Dang, so is Groq the cheapest for running Mixtral then? How capable is that model versus GPT 3.5 for basic tasks?

ilaksh• 2 years ago

It's not too far behind. But Groq is currently not billing and I think it's because they haven't finished programming their billing system. So with such a fast service being free, there is a lot of queueing and presently is unusable because of random response times. Once it finally processes the request it's quite fast but there is a line.

So I am going with Claude 3 Haiku. Hopefully Groq will be able to start charging soon and the load will be more tolerable to service without queues.

jstummbillig• 2 years ago

Is there a production case you are using Haiku for? If so, can you outline it?

starfox64_• 2 years ago

Sorting by price doesn't seem to work as it sorts alphabetically

alexbruner• 2 years ago

Thank you all for being such an amazing community. The sorting issue many of you reported and helped diagnose has now been fixed!

croemer• 2 years ago

Don't editorialize titles: free is unnecessary in the heading.

Lalabadie• 2 years ago

The numerical sorting on the page goes 0.25, 0.15, 0.13, 0.8. This is a friendly reminder that in JS the sort() function should always be given a comparator function.

0x008• 2 years ago

The tool is cool, but very US-centric. There is no possibility to select the Azure Datacenter.. I think pricing is different from NA to EU, if I am not mistaken.

LLM pricing comparison tool

Related Stories