I think you replied a bit too hastily - I agree that we do treat people differently based on appearance, it's actually in my comment:
In my experience, physical appearance is a factor for how people judge you
I try my best to treat people well regardless of their appearance or physical attributes, but you're absolutely right in that some of it is implicit (i.e. we have no control over it).
By the way, unhoused people often are in that position through no fault of their own, and should absolutely be listened to, and supported in any way that we can. Many of them are educated and have very insightful things to say. It's worth keeping in mind that it's absolutely possible that all of your property and wealth could be taken away at any moment, and think about how that might shape your perspective.
Put it in the big collection of ADHD tips at the back of your brain that you immediately forget as soon as you think about something cool that you wanna say :D