HN user
Oh 100% -- anthropomorphic bias towards AI is about to get really interesting, I'd expect. Especially if prompt engineering comes to be part of the job description for tech, which seems likely.
Say "I don't know."
Back when GPT-3 was all the rage on the internet, I remember Kevin Lacker's "Giving GPT-3 a Turing Test" left a real impression on me [1]. Short read, but gets to the crux of the issue. GPT-3 is a (really sophisticated) statistical model, GPT-4 will be no different. Maybe it will showcase new emergent properties of LLMs, like GPT-3's in-prompt few-shot learning did. But the fundamental constraint of a statistical model optimized to a masking task remains -- they're really bad at introspection and confidence-assessment.
[1] https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.h...