Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing

https://github.com/Northwood-Systems/foreman

by AndrewLiu96 • 14 days ago

15 16 14 days ago

midtake• 14 days ago

Name collision with Foreman, the provisioning/patching tool.

https://en.wikipedia.org/wiki/Foreman_(software)

GuestFAUniverse• 14 days ago

Slop(py) coders don't care.

I would vote for the alternative: "Sloppy McSlopGate"

AndrewLiu966• 14 days ago

Could you point out where you see the slop in the codebase? I'm more than happy to address it and make the tool better and more useful :)

TurdF3rguson2• 14 days ago

Not to mention the George Foreman grill

AndrewLiu966• 13 days ago

That was actually one of my naming inspirations, the george foreman grill is a s tier invention

bigtechisajoke• 14 days ago

Foreman is too well known imo

AndrewLiu966• 13 days ago

Noted!

jsabess24• 14 days ago

Nice

AndrewLiu966• 13 days ago

Thanks for checking it out!

dilushin2• 14 days ago

I have something simmilar brewed in my multi-agent system, showing and saving cost data on every agent flow run.

AndrewLiu966• 13 days ago

That's awesome! I'd love to check it out and give it a try

dilushin2• 12 days ago

It is in my private repo, let see if I can OSS this part )

anirudhak47• 13 days ago

how does it compare to sakana?

AndrewLiu966• 13 days ago

I assume you're referencing Sakana Fugu? Similar in the sense that there's multiple models involved, but from what I understand Fugu is kind of a black box in terms of what model is used for what. This project is more deterministic, you can pick and choose which model to assign/use for certain tasks, plus this project is open source which Fugu isn't.

jarodrh• 12 days ago

Interesting project. Most of what I read appears to deal well with a linear agent session.

How does it handle concurrent agent/subagent spawning?

Do they fall under the same sessionId (where they're potentially fighting over the warm route breaking it with every task-type change) or get their own individual sessionIds (where you must rewrite the shared prefix for each agent)?