Celibacy - why not?

In Buddhist forums where I had asked this question, there are always "advanced" practitioners who say that there is no benefit for a lay person to be celibate. So every time i read that, I stop trying to be celibate, although I see some benefit from it (though I'm not sure of it). I would like to hear the opinions of different users on this subject. Are there any benefits from practising celibacy or is it not useful? (I mean full time celibacy, not only on retreats or at Uposatha days) If the answer is that it's useful, then why is it not more recommended in Theravada Buddhism? Also monks do not recommend celibacy to lay people outside of Uposatha and retreats. Why not? I am mainly interested in the view of Theravada Buddhism, but I appreciate all views on this subject also from other sects of Buddhism and other religions like Hinduism etc. All answers are more than welcome. Please specify which tradition of Buddhism or Hinduism that you are basing your answer on.