Why is meditation making me more angry?

Can someone tell me what's wrong? I am extremely new to the art of meditation in general. My mind, in general, is always cluttered with either office worries or personal worries. When I remove my worries slowly via meditation (i.e. emptying my thoughts), I tend to be peaceful. But, during this state, if I encounter a situation that irks or annoys me, my reaction is much rasher or blunt than if I don't empty my mind. For example, after emptying my mind, I saw my son standing in front of the TV, then I grabbed his arm and brushed him aside. I would not have done this if I had not emptied my mind. Also, I noticed that my attention and concentration is much stronger after emptying my mind, but my compassion or empathy also gets reduced proportionately. Can someone help?