HN user

bestcoder69

985 karma

no

Posts10
Comments282
View on HN

I can already use multiple backends by writing different code. The value-add langchain would need to prove is whether i can get better results using their abstractions compared to me doing it manually. Every time I’ve looked at how langchain’s prompts are constructed, they went wayyy against LLM vendor guidance so I have doubts.

Also the downside of not being able to easily tweak prompts based on experiments (crucial!)

And not to mention the library doesn’t actually live up to this use case, and you immediately (IME) run into “you actually can’t use a _Chain with provider _ if you want to use their _ API”, so I ultimately did have to care about whats supposed to be abstracted over

They’ve been growth hacking the whole time pretty much, optimizing for virality. Eg integrating with every ai thing under the sun, so they could publish a seo-friendly “use gpt3 with someVecDb and lang chain” page, but for every permutation you can think. Easy for them to write since langchains abstractions are just unnecessary wrappers. They’ve also had meetups since very early on. The design seems to make langchain hard to remove since you’re no longer doing functional composition like you’d do in normal python - you’re combining Chains. You can’t insert your own log statements in between their calls so you have to onboard to langsmith for observability (their saas play). Now they have a DSL with their own binary operators :[

VC-backed, if you couldn’t guess already

This extreme scenario is unlikely to happen in the short term because of the high costs associated with additional AI servers and bottlenecks in the AI server supply chain, de Vries says.

If we suddenly start ignoring the costs, it could get very expensive, indeed.

Prompts:

- does this API design make sense?

- my team thinks __ is a good pattern, what are some cons?

- what’s a good name for a class that does x,y,z

- is this code snippet readable?

- write a bash script to automate this very tiny thing

- upload quickjs binary to the advanced data analysis model and ask it to micro benchmark a couple of approaches to the same thing

My kids are too young, tech will advance too much to know. I'll report back in about a decade about my policy around how much they're allowed to meld with F̵̡͇͈̬͍͈͉͛͗͌̓̂̊̅̓̀͆͝Ṟ̵̣̳͎̽̈́͘İ̴̛̞̹͉̲͎̿̌̇̋͑͗̒̅̚͜͝͝Ȩ̷̻͖͓͍̙̲̮̰̹̖̥͙̤̺̏͒̃N̸̛̛͈͎̖̩̲͔̫̫̗̲̆̍̌̀̾̽͐́̈́̓̚͘D̵̡̡̯͙̦̎̈́͝.

Not leaking!

When you see this kind of text you’re just in a weird state and it’s going to look like GPT was talking to someone, but it’s really just babbling with no purpose

e: Get GPT-4 to complete an empty prompt, then ask it what it was responding to! I just tried with Simonw’s llm CLI like so:

  llm -m 4 ‘’
  # it outputs a weird response
  llm -c ‘What question was that in response to?’
In my case an explanation of euthanasia, and my supposed question was “What is euthanasia?”. I did it again and it said there was no original question, so there’s some randomnes.

That’s not what’s happening. endoftext is OpenAI’s document splitting token, so when GPT encounters it, it treats it like the end of a chat. So the chat “ends” as far as the model is concerned but the app is still sampling tokens, so GPT just… does its best. The output is similar to when you hit “Generate” with no prompt in OIA playground’s text completion mode. There, you can imagine an invisible endoftext as your prompt.

GPT-4 can't reason 3 years ago

I'm wondering if this was all in a single ChatGPT session where GPT-4 happened to answer the first question wrong. This could bias future outputs towards being wrong as well, and could explain the huge difference between OP's results and commenters, maybe?

Whether someone is “unable to meaningfully consent” is unknowable, so I don’t put any stock it in at all in these kind of decisions.

I’d say that deciding that question isn’t that important (as described, fine, don’t ban WorldStarHipHop). Rather, I’d zoom out and ask whether a society where poor people brawl for income is a healthy one, and maybe think of some alternatives to do that would be better.

Also were these Kenyans all screened for mental illness, or is this a crack a few eggs situation?