I have literally never heard anything like that from even the most misogynistic men I am or was acquainted with

That’s because men really don’t give a fuck if women wear the same outfit multiple times. Most of men don’t even notice.