It’s actually a very reasonable approximation within a certain regime:
https://arxiv.org/abs/1312.4057
There’s a reason people without training in sciences sometimes have the intuition that heavier things fall faster. This intuition isn’t developed in a vacuum (hah).