HN user

sroecker

56 karma
Posts1
Comments21
View on HN

Good question, as you can see I haven't touched it for a month. I wanted to show what's possible then with open source and (open) local models and there's already so much new stuff out there.

I'll probably fix some things this week and then either update it or start from scratch. Guided generation, structured extraction, function calling and multi-modal are things I wanted to add and chainlit looks interesting.

We just held a workshop about this a few weeks ago: https://red.ht/llmappdev We created a simple chatbot using local models with Ollama (llamacpp), LlamaIndex and streamlit. Have a look at the streamlit folder, it's super easy.

I used this simple example to teach about RAG, the importance of the system prompt and prompt injection. The notebook folder has a few more examples, local models can even do natural language SQL querying now.

TextSynth Server 3 years ago

That version of libnc_cuda.so doesn't seem to be compatible with ts_server though.

$25B and they can't even afford an API..

If you want analytics you have to rely on a 3rd party provider who somehow gets the information by logging into your account. I guess if you're a key account they will send you some data and maybe even some nice visualizations.

I did some research and people really track their audience with spread sheets. Influencers send screenshots of their accounts to advertisment companies to prove how many followers they have. Seriously.. If they want to monetarize their platform they should open at least part of their API.

It has been estimated on bitcointalk that around 1-2% have been lost. That's not really a large amount. You can still divide bitcoins into satoshis (1E-8) or even further with a protocol change in the future.