What you're talking about is part of what passive aggressive can be, but it is not always in response to aggression. To the extent that it is in response to agression I agree, I wish more people would be "passive aggressive" in the face of aggression, but in reality there are non-aggressive situations where one can cause psychic loss to another by doing what you have a right to do, and this can evoke the same reaction. It can also be in a voluntary environment where for example maintaining a small group lets the group be efficient, but one person in the group seems always to get their most-hated tasks, yet still where the disutility of leaving the group is greater than that of doing the unwanted work. This is not aggression, but it can still evoke the same "passive-aggressive" reaction. At least 95% of the time though it's a response to aggression, and the word is likely widely overextended to places where it's not a useful concept.