I am not meaning to brag at all, but I am a woman considered highly attractive by a lot and I get asked out quite frequently by attractive men.
The only reason I mention that is because I recently started dating a man (not exclusively yet) who has just moved in with his Mom to save money and buy a home. I live with my Mom, who has Parkinson's, to help her.
I do not judge him remotely and find him incredibly attractive regardless. The only person who is ashamed is him! The logistics are the only issue, but we make enough that I don't mind renting out AirBnBs etc...
He is being financially responsible, and I am taking care of the woman who sacrificed her life for me to achieve my dreams and is now unwell.
Be proud, and screw those women with double standards who fail to look a little deeper. It's sexism. A lot of women unfortunately hold this stigma, but there are women like us out there who don't. Keep looking.