HN user

fwip

3,707 karma
Posts3
Comments2,425
View on HN

LLM-written text tends to have the property that it gives the impression of expertise and knowledge in excess of what the text actually contains.

In other words, it "sounds smart" without necessarily having anything to back it up. In even more critical terms, it's very good at bullshitting.

Unfortunately for us, the scientific community current relies on a certain amount of trust. (To do otherwise is very expensive! see: bitcoin). When you introduce a known-bullshitter to write your papers, every human in the loop effectively has to defend against an adversarial attack. Not just the readers at home, or the peer reviewers, but even the author needs to be wary that the facts and arguments coming out of the LLM are true and meaningful.

Personally, I've been a minor contributor to several high-profile papers. I don't know how every field does it, but in my experience, the corresponding author (generally the PI or other senior scientist), is responsible for the accuracy of the paper. They ultimately have to trust the people who did the work that the facts are true. Introducing LLMs into the mix make it more difficult for them to identify and review sections they are unsure of. (An honest person will typically write at a confidence level reflecting their certainty. LLMs do not do this in any reliable way.)

I've also found that LLMs frequently use metaphors that are unhelpful, or used out of context in a field that isn't familiar with them. This makes understanding the text more work, for no good reason. Introducing terms or definitions with low relevance reads as impressive at first glance, but avoiding the standard terminology in the field just adds confusion. (As an analogy, imagine if you were reading a CS paper that, for no particular reason, devoted a section to a new data structure called an "akimbo tree," which after much untangling, you realized was a reinvention of a randomized splay tree.)

I'd argue that it's this same pattern-seeking drive that undergirds science.

"Zeus sends the lightning, his wrath darkening the very sky," is an understandable model that connects "dark storm clouds" to a likely prediction of lightning.

That urge to explain the surprising, to find the pattern, leads directly to our understanding of the cosmos.

Okay, you can scroll back up and see that the thread is about the erosion of checks and balances. After that, you can do a web search to read either about the Clinton administration's increased partisan direction of federal agencies, or Obama's increase in both scope and number of executive orders.

Presidential powers have been ratcheting up for at lest thirty years. And neither party seems particularly interested in turning the dial back once they're in power.

You only need to rely on density in your area if you have no other network - it will happily use mobile data or Wifi connections if you have them.