I have certainly not unfollowed you

And I see no reason why I would, either.
It might be a glitch. But occasionally I "lose" followers when someone is no longer active on the forums and unfollows everyone they were previously following. I'm pretty sure a few people have unfollowed me for other reasons though.
I try not to offend anyone either but slip-ups can happen to anyone. And some people are just not going to be understanding. But others can discuss it like adults and move on.
And in the big picture, it doesn't really matter if people are "following" you or not, because there are a lot of people on here that I like and talk to regularly that I'm not "following." I usually don't "follow" people unless it's someone that I talk to privately a lot.