Show HN: I made a MCP server in Go that runs Llama.cpp local

https://github.com/kbrisso/byte-vision-mcp
by kbrisso • 12 months ago
1 0 12 months ago

Hello everyone, To learn more about MCPs, I decided to build a server to run Llama.cpp locally. Currently, it functions as an inference server. I thought others who are interested in learning how this works might find it useful. I didn't find anything similar on the web.

I used this SDK to build it: https://github.com/metoro-io/mcp-golang

Thanks! Kevin

Related Stories

Loading related stories...

Source preview

github.com