HN user

solomatov

1,564 karma
Posts12
Comments860
View on HN

I tried a similar approach before, but it didn't work for me. I didn't get a lot of speedup if any from it. IMO, to get productivity you need some kind of YOLO mode (in a sandbox).

IMO, the goal should be to outsource as much work to the model, as possible, while minimizing effort required to understand and review what is did. For example: ask the model to find out why a bug happens, figure out proof of concept for thing X, incrementally optimize something, do a well specified refactoring with some guide, and similar things.

IMO, what people say about creating loops is a very similar thing. You maximize the work done by the model, while minimizing the amount you need to do to control it.

AI is slowing down 1 month ago

that he doesn't really understand how inference works from a technical perspective

Could you share what tells about it? I.e. where he was wrong about it?

AI is slowing down 1 month ago

progress was slowing

Do you think it's not slowing? Do I miss anything really important?

My understanding is that we have now is incremental improvement on thinking models which appeared more than a year ago. Of course, a breakthrough might happen, but I don't see one yet.

For coding you always want to go with the best model in the category, not something that would be the best model if we went 1 year back which GLM 5.1 is, and I'm saying that as a big fan of GLM cause I run a translation site where GLM is good enough for the price.

Currently, the difference is substantial, but what happens if capabilities saturate?

Does anyone has any tips for starting with Gastown? I am comfortable with couple of agents running, but not yet comfortable with what Gastown offers.

Unsloth Studio 4 months ago

What do you mean by custom LMStudio license? Your employer requires reviews of proprietary EULAs or do you try to get a custom licensing deal from LMStudio?