Honestly, this sort of social reaction thing might seem like a big huge deal while you're in school, but I promise you, it aint gonna mean much once you're out of it, since those people will just abruptly be in the rear view mirror.
What I'm saying is, dont fret over it. If you gotta look down, look down. If others dont like it, well... too bad for them. Maybe they should try to be more understanding of others.
I did pretty much the same thing back in school, got pretty much the same reaction too. Looking back now... whole thing seems just stupid to me, the way people used to pester me for it. I still do that, too, but as an adult, nobody around me cares if I do that, particularly if I explain that I'm on the spectrum.
Also the bit about them pestering you for "games and entertainment" is laughable to me. The gaming industry is worth billions of dollars for a reason. It stopped being just a "for kids" thing decades ago. Though of course, some people think you're useless if every bloody waking hour isnt spent pursuing money, which is probably where that comes from.