Ask HN: Do you think machine consciousness is possible? 17 years ago
Try this thought experiment. Imagine there was a replicator that could take an exact copy of your current atom states and replicate them somewhere else while keeping you perfectly intact. Doesn't have to be physical - could be replicated by a computer program.
Now here's the thing - you would still feel like you, looking out of your eyes. The other versions of you would be distinctly separate to you - not you.
That bit that makes you feel you are you - that's what some would call consciousness and others would call a soul.