In terms of slippery slopes, this argument is climbing atop one. Where does that end? Should we ban doctors from performing surgeries that would save someone's hearing? Should we ban protective gear that might diminish the size of the deaf community?
It's simply a horrible argument to suggest that you have to protect a disadvantaged community by making sure they don't shrink. There's much better ways to be respectful of the great human beings these people are.