Part of the answer to this conundrum might be the "lightswitch effect": Lightswitches are ubiquitous and easy to use, so you stop thinking about them, take them completely for granted and miss the bigger picture that even 150 years ago, this would have been considered not a small technical miracle!
LLMs seem to fall squarely into that category - the threshold to using them is incredibly low because you can "just talk to them" and they give back meaningful answers loaded with the sum total of human knowledge from the interwebs.