Ask HN: Bootstrapping side-project Web sites that use LLM?
https://news.ycombinator.com/item?id=35238121Say that you have an idea for a side-project Web site that would need to make GPT-4 service calls of many tokens for each B2C visitor.
To demonstrate it to visitors, you need it to be free initially.
Unlike throwing up a normal Web site, which can be hosted almost for free, the GPT-4 part with lots of tokens could make free users expensive (even with only legit users just trying it out; nevermind broken bots or malicious attackers).
If it gets traction, you'd like to either charge subscriptions for the service as a small business, or get acquired, or get funding to go bigger.
From your kitchen table, using only handful of coins you hid in a jar... how do you bootstrap this side-project startup that depends on expensive LLM?