That's pretty much what Descartes proposed! (https://en.wikipedia.org/wiki/Interactionism_(philosophy_of_....
My favourite argument against this idea is that it would violate the law of conservation of energy. In any case it looks to me that all these dualist theories of mind are non-falsifiable