Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/WebRTC/REST 3 years ago
Brilliant. Willow looks like a game-changer to me, thanks a million!
HN user
morehamish
5 karma
https://hamish.gate.ac.uk/
Posts0
Comments4
No posts found.
Great stuff. Which video card are you running in the demo video?
Looks fantastic! A question re. benchmarks: the "realtime multiple" means "how many times faster the model is processing the audio compared to real time" here? (I.e. the opposite of "real-time factor" sometimes used in speech recognition contexts?)
Also bigger beam sizes give better quality I guess?
Tnx!
What sort of hardware is the inference server at infer.tovera.io currently running on? Tnx!