HNGlance

Top Best New Show

I built an LLM router that doesn't use an LLM

https://github.com/itsthelore/wayfinder-router

by tcballard • 29 days ago

4 2 29 days ago

GI

Related Stories

Loading related stories...

Comments

2

tcballard2• 29 days ago

Most routing systems I found either used another model as a classifier or relied on provider-specific routing. I was interested in the narrower question: how far can deterministic heuristics get before you actually need another model in the loop?

tcballard2• 29 days ago

Interestingly, a tuned length-threshold baseline performs very competitively and even beats Wayfinder on one of the benchmark sets. My intuition is that structural signals become more useful as prompt formats get more heterogeneous (code reviews, logs, tables, long instructions, etc.), but I’d love to see more real-world data.

Source preview

github.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms