HN user
Yep reasonix is an absolute case study of caching. They literally compiled byte level cache in their design and it is insane. i can one shot many workflows, apps in under 0.05 cents.
When gpt4 first launched, i was just walking behind my ex in a department store and playing with chatgpt on my phone (green ugly web ui). i tried to manually recursively prompt it to decompose a large goal by divide and conquer until it thinks it can create a functional and integral part back to its parent. I hit a depression point when I managed to get to a terminal state when chatgpt4 created a single json response including full containerised api endpoint for validation of media metadata which it thinks is required for building a personal photo book app. It was valid dockefile valid shell script and a perfectly formatted json! But trying to leverage that back then proved expensive and hard.many hard lessons learned.