It's not a complete replacement, but if you're in a Python ecosystem, you might find Moto to be of interest.
HN user
atls
14 karma
Posts0
Comments4
No posts found.
Local Stack Archived their GitHub repo and requires an account to run 4 months ago
Oh, the irony
AGPLv3 attempts to solve this problem, by forcing SaaS providers to open-source their modifications.
The path to ubiquitous AI (17k tokens/sec) 5 months ago
There is also the use case of delegating tasks programmatically to an LLM, for example, transforming unstructured data to structured data. This task often can’t be done reliably without either 1. lots of manual work, or 2. intelligence, especially when the structure of the individual data pieces are unknown. Problems like these can be much more efficiently solved by LLMs, and if you imagine these programs are processing very large datasets, then sub-millisecond inference is crucial.