How can one overcome agitation developed by not sitting regularly?

This one is for the lay meditators. Although i think there is a component of sloth and torpor involved in the situation. There are other factors too. At times for me breakage of a sila makes it hard for me to sit. And if this cycle is not broken it can take days to come to mindset to start sitting again and to convince myself it's ok to start from scratch. Does anyone else encounter this problem and how do you deal with it?