You should want to make racists uncomfortable when they do a racism, and bigots uncomfortable when they do a bigotry. It’s part of the hidden contract to living in a nice society. Stand up for others who are affected even if you are not. Shit is not cool, and you should care that your brothers and sisters are being marginalized.