You are right about the anti-social feelings kicking in later. I struggle with this from time to time. Yesterday I had a similar problem. I believe it was due to very little sleep. I was talking with some people. One turned away from me to talk to someone else. He effectively created a sort of wall between me and the conversation. I just got disgusted and walked back to my desk. It’s always tough to gauge real intent and solid body language, with projected feelings and misunderstandings. I really messes with my great ability to read people at times.