Yes, I think it scares most people. Sorta like we're not equipped to deal with what most people consider 'normal', most people aren't equipped to deal with what society deems 'different'.
However, that's not the case with everyone. Some people don't care if someone's different, and even prefer to hang out with them. Usually what that means is that they're also on the fringes of social norms or are a social outcast themselves.
The best place I've found for not scaring people away has been with non-natives. People who were not born and did not grow up in this culture, and who are in many ways learning what I'm still trying to learn ...all the little social nuances, speech patterns -the language, basically. It's way easier to talk to someone who speaks a different native language than you, because then whatever communication you're able to have, it has to be straightforward and literal because neither of you can understand it otherwise.
I still haven't quite gotten used to the reaction I get when someone realizes I'm not 'normal' (whatever that is). It's never blatantly obvious, but I've spent my entire life learning these tiny little clues and now I can instantly recognize it. Slight changes in how they look at you, how their voice changes, how they treat you as just a little bit stupid and how quickly they try to abandon whatever interaction is going on.
There are so many times where I just try to not talk anymore. I can give loads of nonverbal feedback but I refuse to speak because for some reason, that's when they notice. If I don't have to talk then I can get away with being tagged as shy and/or quiet. If I do accidentally open my mouth I'm officially labeled Not One of Them and, barring a miracle, that's who I forever am in their perception.
