I completely understand, and it's not nice when we are laughed at or made fun of.
It's confusing taking things too literally isn't it. This is one of my biggest 'problems'. In fact that's what ended my marriage (mainly - he's also a sociopath) of just six weeks. My husband so-called jokingly said he'd set his vicious pit bull dog - that was crated due to its aggressiveness - onto my soft labradoodle. He said it was a joke at the time, but my adrenaline kicked in, I panicked and bolted out of the room with my dogs in tow.
Bearing in mind, his dog attacked and bit both my dogs several times previous to this - I thought him 'joking' about this was not at all funny and extremely inappropriate. He didn't agree, refused to apologise and there was no way forward for us and I left him a few days later. This was actually the 'straw that broke the camel's back'.
He knew about my aspies, supposedly 'understood' me and even allowing for me taking things far too literal, he still thought it was an OK thing to say to me.
I think we need to be less harsh on ourselves and realise we will always take things literally and try to allow for it. Although, at the time, that seems impossible. Lots of enjoyable pursuits, watching TV, reading a book can be spoilt by my literal thinking and I try to force myself to stop.
Butterfly88, I hope you are feeling a little better about it today.