Show HN: Smart website search powered by open models

by lewq • 2 years ago

13 7 2 years ago

binocarlos• 2 years ago

I helped work on the RAG part of this :-)

We used https://github.com/pgvector/pgvector under the hood and found it extremely easy to integrate with our database schema - being able to just specify the structure of a table and have metadata fields alongside the embeddings made the code very easy to reason about.

lewq2• 2 years ago

Not mentioned on the website (because it’s targeted at general website owners rather than a technical audience) but we are using a 100% open source AI stack for this, with llamaindex, pgvector and llama3:instruct running on ollama hosted on a stack of GPUs we have mostly in our houses.

drphilwinder• 2 years ago

Under the hood right now it's on-prem llama3 + a pretty basic RAG pipeline. The coolest thing about this technically is that it's all running totally privately.

But the main goal is to make websites more efficient. To get your customers to the answer they need faster.

deforciant• 2 years ago

going to try on my websites!

technocat• 2 years ago

This is powered by Helix API's. Bots represent the intelligent search agents that your users will interact with. When you create one, it pulls in information from websites and feeds that to a sophisticated language model. This model is then exposed via an API, which is then called by your users.

mdrzn• 2 years ago

Don't use "Show HN" for a waitlist landing page.

lewq2• 2 years ago

oh, sorry, I didn't know that was a restriction. We legit wanted to show HN what we had built :-)

The product is ready - we can let people in straight away. In fact, secret tip, if you go to the searchbot docs, you can find the URL of the live app :-P

But we'd still like to chat to our users, hence the waitlist. We're setting up a slack channel for that. We'd love it if you'd like to be involved in trying it out and giving us feedback.

Show HN: Smart website search powered by open models

Related Stories