Reference request: blame as the source of anger?

I am looking for a textual reference. I cannot recall the exact details but I will try my best; if anyone knows what I am referring to and can point me to the text, it would be much appreciated. The basic idea in the passage was roughly, I believe, that if one doesn't have anyone who can tell them what to do or not do...doesn't have a person who can punish them, then they won't become angry. I believe I read this in the Visuddhimagga but I'm not sure. Any help is appreciated!