That's a great idea. I see at least 2 difficulties emerging: first security, then servicing.
No private or public entity will grant access to valuable proprietary hardware, as unacceptable risks will not only come from building owners, but also from anyone entering premises.
Also, managing remote nodes evenly spreaded across all areas will be costly. Think of armies of techs on the road permanently, with access problem, dogs or pest barriers, and so on.
A way to solve this would be the allocation of a planned space per block everywhere, which would be safely secured - then available and accessible to all utility organizations: electric, isp, water, phone, data, etc. Heat, power, mini data centers, and such could serve all buildings on a block.
Then other problems emerges: having utilities plan and use these together. Would only work if all services belong to the same entity.
A way around, of course, would be for individuals to setup servers they would own, and rent to data brokers, like Holo project once planned for.