Show HN: LLM-Companion: push-to-talk + TTS web chat app for OpenAI-like APIs

llm-companion is a rather fast and high-quality (I think) TTS push-to-talk chat interface with OpenAI-compatible LLM APIs, such as OpenAI, Oobabooga, vllm, llama.cpp, etc.

It uses Whisper for transcription (local), StyleTTS2 for TTS (also local).

Here's a little demo video if it in action: https://twitter.com/lxe/status/1745348827983560991

It uses streaming for both LLM results and TTS, which significantly decreases the interaction latency as compared to something like ChatGPT Voice mode.

The goal was to create a fully self-contained locally-running AI chat app, and this is the result.

Enjoy!