The key thing is time horizon.
Bell Labs invested in research that would bring payoff 20+ years in the future. That's in part because they were a quasi-monopoly. (Also because there was less pressure back then on execs to focus on short-term stock prices.)
It's also because Bell Labs ran a lot on government contracts and grants. The government CAN look 20+ years in the future. And it does.
You can see the same effect in pharma today. Pharma R&D develops drugs that will hit the clinic in the next 5-10 years at most. The true basic research of identifying targets and understanding cancer/Alzheimer's mechanisms to launch future drugs -- that's all funded by the government.