I think it's also probably an issue of trust. If someone isn't in front of you banging on their keyboard you have no assurance that they're actually doing work.
The solution is really to use communication tools like Slack and also put the focus on deliverables instead of "work units".