Show HN: I made a Mac app for rate limiting and monitoring LLM requests

https://github.com/quilrai/LLMWatcher
by winchester6788 • 6 months ago
3 2 6 months ago

https://github.com/quilrai/LLMWatcher/releases/latest/downlo... - Signed and Notarized app

I use coding agents (claude code, codex, cursor etc) a lot and wanted a lightweight app which

1 - have searchable logs of all conversations 2 - rate limit or get notified if using too much context length (-especially useful for reminding myself to use a new session)

3 - block api keys etc from going to LLM providers

4 - get overview of tokens, tools used, and other interesting information

So, I made LLMWatcher

Using base url feature supported by most of the coding agents, LLMWatcher sits in the middle of coding sessions and can do all the above + some extra goodies

Also has a LLM Gateway feature, which can be used to get monitored/ proxied URLs with controls for any LLMs

Would love some feedback on this and to know if anyone finds it useful

Note: Always wanted to make desktop apps, and Tauri made it very easy to do so. Attempted with python first but got dragged into signing and packaging hell

Related Stories

Loading related stories...

Source preview

github.com