it would be better for a male fan of the book to just hold his tongue and not try to deny that female reader’s experience
This argument is at odds with the core idea of feminism of equality between genders. You are insinuating that a female reader would not be equipped to judge herself the "male fan's" comment.