I wouldn't put a random number generator to command a bulldozer inputs, which is the risk you mention about giving an AI instance command of something that can interact with the real world.
That doesn't mean that an AI left to itself in a computer plugged to internet is inherently a risk.