Because most people have fragile egos. They care about other people's opinions of them and therefore assume, wrongly most of the time, that any comment is therefore directed at them. Then they get defensive.

Just do what is RIGHT and FAIR to others, speak your mind and stop worrying about what other people think of you. Life is soooo much easier that way!