Meditation, compassion: How to handle people who dominate you in the office?

I have been doing meditation for long time and have felt a change in me. I have started developing strong compassion, and due to this I am speaking very politely to everyone and always agreeing with the views of others. In fact, I am helping others in their work. However, now people have started taking me for granted. As I speak kindly with my subordinates, they are taking advantage of me by commanding me to do their work and are trying to dominate. They have started speaking in rude ways to me as they have started feeling that I am not harmful for them and cannot do anything. I am now becoming a victim of their politics. How to overcome this problem? I cannot leave my post as this is the only way of earning my bread and butter. Being on the path of Buddhism, how to maintain relations with your colleagues?