If the guy keeps getting kicked in the head, you can't expect him to have a sense of humor.
You speak of Unity Building. This would be a good time to say "I'm Sorry" and I didn't mean to offend you and disrespect your legacy co-workers. You could stop all this foolishness.