LLM-cpp: 26 single-header C++17 libraries for LLM integration

by Shmungus • 5 months ago

3 3 5 months ago

Shmungus2• 5 months ago

Built this over a weekend because every C++ project I worked on needed LLM features and the options were either "wrap the Python SDK somehow" or "write the curl SSE parsing yourself again."

26 libraries across four categories — Core, Data, Ops, App. Each one is a single .hpp file. Drop in what you need, define one implementation macro, ship. No Python runtime, no package manager, no build system changes beyond linking libcurl where needed.

llm-stream has 83 unique clones already with zero promotion. Figured the rest of the suite was ready to share. Happy to answer questions on design decisions, the single-header pattern, or anything else.

mondainx• 5 months ago

Very cool, thanks for sharing. I'm sure this will come in handy!

Shmungus2• 5 months ago

100%, I hope you get some good use out of it!

LLM-cpp: 26 single-header C++17 libraries for LLM integration

Related Stories