"How do informational norms change when we’re all living in the same universal room?"
I different interesting question: why would we want to inhabit this universal room in the first place? The post mentions the idea of being "bigger than yourself" but to me the context collapse achieves the opposite - a sort of carboard caricature of oneself.
A thought experiment: how would you feel about betting on a market that is an the outcome of a medical procedure? On a negative outcome? On a market for a negative outcome of your own procedure?
Chris Olah and other leaders at Anthropic, OpenAI, and others would do well to consider the principles of Social Doctrine spelled out in the encyclical. The
question they should ask themselves is how their corporations advance those principles.
Olah argues that "if we want this technology to go well, it is enormously important that there be people outside those incentives."
That sounds part hypocritical and part evasive; the responsibility starts with the people inside the incentives — with him.
A 100 years ago that ratio was the other way around. There were powerful technological and financial insetives to change the public's attitude and the law.