HNGlance

Top Best New Show

TinyToT – Tree of Thoughts Inference Server

https://github.com/guilt/TinyToT

by vkaku • 13 days ago

1 1 13 days ago

GI

Related Stories

Loading related stories...

Comments

1

vkaku• 13 days ago

A lightweight, Ollama-compatible inference server that answers questions through knowledge retrieval, structured reasoning chains, and MCP tool calling — with no model weights, no training, and no GPU required.

It scores 97% on a 35-question benchmark spanning graduate-level science, medicine, law, finance, and software engineering. It runs on a laptop CPU in under 1ms per query.

Fun fact: This was able to summarize the Lord of the Rings well and work on a variety of different problems.

Source preview

github.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms