(I'm a Muslim). I mean... Strictly speaking as far as i am aware the mat/rug is not sacred itself. It is just a place to put your head +knees comfortably.
In fact the Prophet Muhammad SAW did not use a prayer mat and instead he placed his head on the soil (ground/earth).
Also note; Shias place their head on a stone/rock to mimic this practice: https://en.m.wikipedia.org/wiki/Turbah