kelrouter

I would recommend just connect your whatever you used or built to a LLM gateway & router to use any models without management complexity.

I built BitRouter(https://github.com/bitrouter/bitrouter), open-sourced, 0 markup for all models, free BYOK/subscription, and works with any harnesses out of the box

if the goal is OSS over closed platform, why not try open code + bitrouter (https://github.com/bitrouter/bitrouter)

full disclosure, this is my own project but I truly think it would be a potential fit of what you're looking for:)

heyyy,I'm building bitrouter (https://github.com/bitrouter/bitrouter), an open-source agentic LLM gateway & router that optimize production agentic loops in your way. Hope this can help solve your problem:)