It seems that your ex isn't going to accept you as you are for things you can't change. If you did get back with him, the dynamic would be him trying to mold you into an average-functioning neurotypical, and that is likely to end in disappointment for both of you.
It's probably best to move on and try to find someone else who will be better-able to mentally connect with you.
It's probably best to move on and try to find someone else who will be better-able to mentally connect with you.