Show HN: BorgLLM, Zero-config LangChain Client, key rotation and rate limit mgmt

by omneity • 1 year ago

3 1 1 year ago

omneity• 1 year ago

Hello HN!

I've been developing a lot of LLM-based apps recently, and I got tired of writing the same glue code each time to switch providers, find the base URL again, or other strategies to deal with provider idiosyncracies, so I extracted out that code into an MIT licensed package named BorgLLM.

It's a zero-config Langchain client to 100s of providers & models, it has automatic API key rotation, rate-limit fallback strategies and more concerns you won't have to put in your application code...

One liner to rule them all (you can pick any model or any provider):

llm = create_llm("anthropic:claude-sonnet-4")

And my application code is finally clean, focusing on the domain. It's not a very complex package yet it might be one of the biggest time savers I added to my development workflow.

I hope you'll find it useful. Questions and feedback points are most welcome!

Show HN: BorgLLM, Zero-config LangChain Client, key rotation and rate limit mgmt

Related Stories