Show HN: Run AI models directly in the browser – no server or internet required

by nadchif • 11 months ago

11 8 11 months ago

ungreased0675• 11 months ago

Very nice

nadchif3• 11 months ago

Thanks :)

nadchif3• 11 months ago

sdotdev• 11 months ago

nice tool, can see this actually being useful especially in those times where sites go down for no reason

attogram• 11 months ago

What happens after you close the browser? Is the model still stored locally?

nadchif3• 11 months ago

The model remains cached in the OPFS.

If you're curious about the caching code, it can be found here: https://github.com/ngxson/wllama/blob/c267097dc79df8d23df8bc...

roberdam2• 11 months ago

fantastic tool!, is the limit on the length of the prompt text model dependent? or can be tweaked on the github repo?

roberdam2• 11 months ago

it turn out to be a limit on the html, you can change the maxlength="512" with the chrome console to fit your text

Related Stories