I think you are probably overreacting personally. I've dealt with people like this, and just because of things they may or may not have done, doesn't necessarily put you into danger. Give him the shirts back, avoid him, and take some deep breaths man.
He and I grew up together. Everybody he knows, I know. And they all loved me growing up. They never shunned me because I was slightly different. Nobody could tell I was any different except for my best friend, he could tell I was slightly off, but not bad at all.