If humans exist, then ignorance exist then their will always be people mislabeling people creeps with only using a few data points or "intuition" hence ignorance.
Ignorance is just a word. It doesn't explain the "why" of it.
Lets take "few data points" part of what you wrote. Here is a question. Do those people ever have bad days? If so, that should prove them that "few data points" in their own lives doesn't make them despicable overall. So why would they apply such a standard to others?